USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and...
-
Upload
eleanor-mccormick -
Category
Documents
-
view
217 -
download
1
Transcript of USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and...
![Page 1: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/1.jpg)
USDA–FSA-APFO
Storage provisioning within a Geospatial Data Warehouse
USDA Imagery Planning and Coordination
December 5, 2006David A. Nabity
Aerial Photography Field Office
USDA – Farm Service Agency
![Page 2: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/2.jpg)
Agenda
• APFO’s role within USDA
• Geospatial Data Warehouse• Storage and Archiving aerial imagery
• Spatial Data Provisioning System
• Web Order Entry System
![Page 3: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/3.jpg)
APFO’s role for USDA• APFO is the primary source of aerial imagery for the
U.S. Department of Agriculture
• Data Stewards for NAIP, MDOQ and historical aerial photography collected for USDA dating back to 1955.
• Provide data warehousing and archive capabilities for CLU.
• Support the implementation and use of GIS in the Service Centers by acquiring imagery and delivering in a format that is ready to use.
![Page 4: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/4.jpg)
Who We Support• USDA
• FSA - Compliance and Ortho Imagery• NRCS – Conservation• USFS – Resource Management
• Federal, State and Local Governments• Land Management Agencies• Emergency Management and Response
• Commercial• Planning• Litigation• Environmental • Development
![Page 5: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/5.jpg)
Data Access and Delivery
• Access and delivery of geospatial data to service center offices, internal, and external customers in support of business needs encompasses four major ideas:– Data warehousing– Data selection– Packaging– Delivery
![Page 6: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/6.jpg)
What is the Geospatial Data Warehouse (GDW)?
• Technical architecture, infrastructure, and data management processes through which SCA tabular and spatial data is developed, managed, and distributed to the 2700+ county offices and other authorized users
• Component of USDA Service Center Modernization Initiative
![Page 7: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/7.jpg)
Geospatial Data Warehouse
![Page 8: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/8.jpg)
How the GDW Supports FSA Farm Programs
• Provides authoritative data sets• A means for identifying current crop growing
conditions for compliance• Disaster assessment prior to and after an event• Base information for maintaining CLU
boundaries and farm records• An intuitive base map for interacting with
customers
![Page 9: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/9.jpg)
What the GDW Provides:• Web service access to national NAIP and
MDOQ imagery for SCA offices.• APFO in-house NAIP inspection process.• Data distribution via APFO Data Provisioning
System.• Support for a national CLU layer for FSA via
replication of the CLU from the field service centers.
![Page 10: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/10.jpg)
Distribution of GDW Data Resources
http://gos2.geodata.gov/wps/portal/gos http://datagateway.nrcs.usda.gov/
APFO Provisioning System http://customerstatement.usda.gov/
ARCIMS Services gdw.apfo.usda.gov
![Page 11: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/11.jpg)
Accessing the GDW Web Services Hosted at APFO
• Add GIS Server http://gdw.apfo.usda.gov
![Page 12: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/12.jpg)
GDW NAIP Preliminary 2006 QQ’sCombined 1 and 2 meter imagery
![Page 13: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/13.jpg)
GDW Disaster Response Web Service
http://gdw.apfo.usda.gov/hurricane
![Page 14: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/14.jpg)
Accessing USDA Geospatial Data Warehouse ArcIMS Web Services
![Page 15: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/15.jpg)
GDW NAIP ArcIMS Web Service http://gdw.apfo.usda.gov/naip/viewer/viewer.htm
![Page 16: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/16.jpg)
GDW MDOQ ArcIMS Web Service http://gdw.apfo.usda.gov/mdoq/viewer/viewer.htm
![Page 17: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/17.jpg)
Aerial Photography Field Office
Data Provisioning System
![Page 18: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/18.jpg)
• Provides a “view” into your data holdings– Provisioning is the process of creating custom derivative raster
products from an archive of source imagery.• Most Current Data• Historical Archive
• Catalogs • MDOQ, NAIP, and Digital Photography• Approximately 4-5 years of data will be on line
• Integrated with the GDW infrastructure
APFO Data Provisioning System
![Page 19: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/19.jpg)
Input File Format (Ingest)
MrSID (.sid)
JPEG2000 with JGW Option
Landsat ETM, SRTM, BSQ
General Raster (BIL Interleave by Line)
General Raster (BSQ Interleave)
GeoTIFF – Strip, Strip Bands Separate
GeoTIFF (n-Band)
GeoJPEG2000
TIFF with TFW Option
JPEG with JGW Option
USGS DOQ - First Generation, New Labeled
NGA Formats (CIB, CADRG, ADRG)
NITF 2.0 and 2.1 RPC
MODIS HDF Level 1B(only supported with the Copy Sources and Create Links actions)
Shuttle Radar Topography Mission (SRTM)
![Page 20: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/20.jpg)
Supported Projection Types
• Albers Conical Equal Area• Bonne• Cassini• Cylindrical Equal Area• Eckert 4• Eckert 6• Geographic• Van der Grinten• Lambert Conformal Conic• Mercator• Miller Cylindrical
• Mollweide• Orthographic• Polar Stereographic• Universal Polar Stereographic• Polyconid• Sinusoidal• Transverse Mercator• Transverse Cylindrical Equal
Area• Universal Transverse
Mercator
![Page 21: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/21.jpg)
Output File Format :JPEG
TIFF
GeoTIFF-Tiled
GeoTIFF-Tiled Band Separate
GeoTIFF-Strip
GeoTIFF-Strip Band Separate
General Raster (BIL Interleave)
General Raster (BIP Interleave)
General Raster (BSQ Interleave)
ERDAS Imagine
GeoJPEG2000
ArcGrid-ASCII (Raw Elevation Only)
MrSID (mg2 and mg3)
![Page 22: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/22.jpg)
Packaging and Delivery Methods
• Media• CD, DVD, Portable Hard Drive• Determined by system based on data set size
• Output Directory• FTP• Symbolic links to data files
– OnCourse Delivery
• Media shipped most economical means
![Page 23: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/23.jpg)
Data Provisioning Capabilities
• Raster Connect for ArcGIS
• Provision directly from the DPS into ArcGIS
![Page 24: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/24.jpg)
Web Order Entry System
• The problem of:– Our current imagery distribution systems being restricted,
underdeveloped, under publicized and inaccessible.
• Affects:– Our customers, our ability to comply with presidential and federal
mandates and our ability to compete with other entities.
• The impact of which is:– Customers are dissatisfied and seek other means for acquiring
the imagery they need, opportunities are lost because customers are unaware of what we have to offer.
![Page 25: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/25.jpg)
Web Order Entry System• APFO Goal
– A streamlined, easy to use customer interface that supports presidential mandates and GOS objectives.
• APFO Objectives– Provide a means for our customers to easily order just
the imagery they need.– Allow orders to be placed using a pre-defined AOI.– Account validation for ordering products.– Account management for registered users.– Ability to collect credit card information for billable
orders.
![Page 26: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/26.jpg)
Web Order Entry System
• Where we are at today– Contract has been awarded.– Initial requirements gathering phase is
complete.– Initial development phase is under way.
• Implementation timeline– Early summer (June or July)
![Page 27: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/27.jpg)
Web Order Entry System
• Initial customer base– Selected partners and Service Centers.
• Initial products available– NAIP quarter quadrangles (2003 – 2005)– NAIP CCM’s (2003 – 2006)– Digital Photo Indexes
![Page 28: USDA–FSA-APFO Storage provisioning within a Geospatial Data Warehouse USDA Imagery Planning and Coordination December 5, 2006 David A. Nabity Aerial Photography.](https://reader035.fdocuments.in/reader035/viewer/2022062516/56649e5f5503460f94b59609/html5/thumbnails/28.jpg)
CD/DVDExternal HDDFTPOnCourse
Geospatial Data Warehouse
Spatial Data Provisioning System Web Order Entry System
Public Internet 2,700 Field Offices
Other USDA Offices Producers
Other agenciesCost share partners
NAIPMDOQCLUPhoto Index
AOI
Packaging and Delivery
Custom Internal ApplicationsAOI
Spatial DataManagementTeam
Data Request
LinuxEarthWhereandMedia Servers