U.S. Department of the Interior U.S. Geological Survey

1
U.S. Department of the Interior U.S. Geological Survey March 2014 LP DAAC MODIS Data Services Jason Werpy 1 , Chris Doescher 2 , Chris Torbert 2 , Dave Meyer 2 1 Information Dynamics contractor to the U.S. Geological Survey (USGS) Earth Resources and Observation and Science (EROS) Center, Sioux Falls, SD, 2 USGS EROS ORNL MODIS Subsetter The ORNL (Oak Ridge National Laboratory) DAAC provides an interface that allows for users to subset certain MODIS data products. Users can specify a location, the number of pixels around that location to subset, and a selected timeframe for subsetting the MODIS data. The LP DAAC receives subset requests from ORNL for its products, creates subsets and forwards them to the ORNL DAAC for distribution to the MODIS subsetter users. (http://daac.ornl.gov/cgi-bin/MODIS/GLBVIZ_1_Glb/modis_subset_order_global_col5.pl) Data Subsetting and Reformatting Data Access The LP DAAC provides a Web Services-enabled interface to its MODIS Reprojection Tool (MRT). The MRTWeb user interface allows LP DAAC users to select MODIS tiles for reprojection, subsetting, resampling, and mosaicking and executes those services on LP DAAC servers. MRTWeb Services Often, users of MODIS land products data from the LP DAAC are interested in areas that are much smaller in size than afforded by the data granules. In order to ease the burden of downloading several full tiles or swaths of MODIS data, the LP DAAC has deployed a number of MODIS data services to facilitate spatially subsetting the data to the user’s specifications. Also, given that users may only want certain bands of data, these services can also spectrally subset the MODIS data to return only the desired bands of interest. These services are also capable of reformatting the data to different map projections and/or formats in addition to also providing the ability to resample the data resolution. The MRTWeb Services are capable of mosaicking data as well. The Data Services deployed by the LP DAAC and other data providers offer efficient tools that allow users to streamline and optimize their workflow to get more processing done with less effort. MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b01,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b01,-3,- 3,3,4,9,7,10,5,7,7,3,11,10,6,7,5,3,3,4,8,9,2,5,11,11,5,3,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b02,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b02,-7,-7,-3,-2,2,-1,-1,0,1,1,- 1,1,0,-2,2,-2,-4,-4,0,0,3,-4,-4,5,5,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b03,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_b03,177,177,180,179,175,170,172,170,168,168,169,178,171,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b04,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_b04,71,71,74,79,80,77,78,78,78,78,76,77,79,77,83,74,71,71,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b05,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b05,-42,-42,-43,-19,-42,-28,-51,- 22,-37,-37,-20,-48,-33,-41,26,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b06,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_b06,50,50,51,50,51,47,58,45,52,52,45,56,48,57,51,57,41,41,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b07,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_b07,31,31,22,39,24,45,31,45,26,26,34,18,42,23,47,20,38,38,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_day_of_year,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_day_of_year,66,66,66,66,66,66,66,66,66,66,66,66,66,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_qc_500m,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_qc_500m,1077150581,1077150581,1077150529,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_raz,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_raz,12861,12861,12861,12861,12862,12862,12863,12863,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_state_500m,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_state_500m,120,120,120,120,120,120,120,120,120,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_szen,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_szen,3994,3994,3993,3993,3992,3992,3992,3992,3991,3991,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_vzen,MOD09A1,A2004065,Lat29.997917Lon- 11.544357Samp21Line21,2007255085450,sur_refl_vzen,1154,1154,1163,1163,1172,1172,1181,1181,1190,1190,… Data Services Dataset: MOD09Q1.005., 4096, 3558, 3558, 3416, 3850, 3056, 3056, 4416 sur_refl_b01[0][6], 4093, 4093, 3332, 3332, 3204, 3204, 4758, 3786, 5392, 5392 sur_refl_b01[0][7], 4905, 2846, 3330, 3657, 3657, 5018, 5018, 5662, 5676, 5850 sur_refl_b01[0][8], 3312, 3312, 4577, 4220, 5030, 5030, 5679, 5679, 5791, 5940 sur_refl_b01[0][9], 3999, 4108, 4108, 4479, 4479, 5685, 5685, 5538, 5538, 5622 sur_refl_b01[1][0], 907, 752, 844, 814, 574, 546, 618, 853, 1059, 1079 sur_refl_b01[1][1], 742, 685, 681, 656, 566, 835, 1012, 984, 1015, 1033 sur_refl_b01[1][2], 792, 715, 656, 649, 813, 906, 847, 981, 1015, 783 sur_refl_b01[1][3], 715, 663, 689, 584, 644, 715, 981, 775, 779, 774 sur_refl_b01[1][4], 625, 577, 612, 787, 715, 909, 731, 603, 697, 834 sur_refl_b01[1][5], 697, 879, 787, 814, 942, 870, 673, 782, 838, 1140 sur_refl_b01[1][6], 877, 879, 872, 1034, 1005, 725, 792, 838, 951, 1003 sur_refl_b01[1][7], 916, 970, 879, 665, 676, 792, 928, 773, 912, 1050 sur_refl_b01[1][8], 996, 880, 833, 1054, 676, 830, 1106, 1191, 1129, 1217 sur_refl_b01[1][9], 830, 814, 979, 1040, 1101, 1061, 1076, 1097, 1146, 1149 sur_refl_b01[2][0], 1322, 1125, 1359, 1349, 966, 894, 954, 1091, 1258, 1275 sur_refl_b01[2][1], 1125, 1115, 1121, 1008, 894, 1071, 1195, 1184, 1184, 1191 sur_refl_b01[2][2], 1180, 1067, 1008, 925, 1056, 1143, 1121, 1217, 1188, 956 sur_refl_b01[2][3], 1067, 971, 912, 871, 947, 1067, 1236, 1217, 963, 1000 sur_refl_b01[2][4], 950, 845, 966, 1259, 1367, 1236, 886, 745, 793, 939 sur_refl_b01[2][5], 1293, 1475, 1475, 1367, 1391, 1022, 759, 885, 925, 1194 sur_refl_b01[2][6], 1350, 1475, 1362, 1386, 1109, 820, 942, 1004, 1248, 1260 sur_refl_b01[2][7], 1350, 1319, 1314, 1054, 748, 792, 1004, 895, 1166, 1187 sur_refl_b01[2][8], 1423, 1015, 1003, 1119, 792, 1011, 1358, 1491, 1389, 1291 sur_refl_b01[2][9], 1128, 1010, 1199, 1119, 1159, 1273, 1280, 1306, 1254, 1353 sur_refl_b01[0][0], 4144, 4570, 4570, 3031, 3352, 3352, 3352, 4705, 4705, 5857 sur_refl_b01[0][1], 4144, 2914, 2914, 4033, 4033, 5064, 5064, 5119, 5119, 6149 sur_refl_b01[0][2], 3634, 3634, 4496, 4496, 5576, 5576, 5689, 5689, 6441, 6364 sur_refl_b01[0][3], 3927, 4867, 4939, 5216, 5216, 5120, 5120, 5410, 5410, 4444 sur_refl_b01[0][4], 4250, 4250, 4067, 4067, 4491, 4491, 4742, 4742, 3109, 3109 sur_refl_b01[0][5], 4364, 4096 Applications that are aware of the OPeNDAP communications standards can easily integrate OPeNDAP data access to their users. One example of this is the Geo Data Portal ( http://cida.usgs.gov/gdp/client/?development=true ) from CIDA (Center for Integrated Data Analytics). Common Service Actions Reprojection Band Subsetting Spatial Subsetting Temporal Subsetting Mosaicking Resampling MRTSwath Web Services ORNL MODIS Subsetter Submission Form ORNL MODIS Subsetter Results OPeNDAP Interface ORNL MODIS Subsetter Interface OPeNDAP Results OPeNDAP Client Interface CIDA Geo Data Portal In order to facilitate the MODIS swath-based products, the LP DAAC has recently deployed services based on its MRTSwath Tool. These services are being made available via REST-based HTTP calls using the MRTSwath Web Services interface. Mosaic, Reproject , Resample http://mrtwebsvc.cr.usgs.gov/MRTWebProcessor/ resources/esiMrtswath? FILE_URLS=ftp://ladsweb.nascom.nasa.gov/allData/5/ MOD09/2014/050/ MOD09.A2014050.1650.005.2014056234655.hdf& FORMAT=GEOTIFF_FMT&[email protected]& SUBSET_DATA_LAYERS='500m Surface Reflectance Band 1’ &PROJECTION=GEOGRAPHIC Reproject , Resample, Subset MRTSwath Web Service Call MRTWeb Interface OPeNDAP OPenDAP (Open-source Project for a Network Data Access Protocol) is a data transport architecture and protocol based on the Hypertext Transfer Protocol (HTTP). The LP DAAC is providing OPeNDAP services (as part of a pilot project) to some users to allow them to select and subset data from the LP DAAC MODIS product collections. OPeNDAP can organize (aggregate) the data into time series that enables users to select data subsets across different observation dates. OPeNDAP also allows users to output data in different user- selectable formats (ASCII, netCDF, DODS). LP DAAC MODIS Data Services facilitate the algorithms to archives paradigm by providing quick and efficient access to data products, saving users time and effort.

description

LP DAAC MODIS Data Services Jason Werpy 1 , Chris Doescher 2 , Chris Torbert 2 , Dave Meyer 2 1 Information Dynamics contractor to the U.S . Geological Survey (USGS) Earth Resources and Observation and Science ( EROS) Center , Sioux Falls, SD, 2 USGS EROS. Data Access. - PowerPoint PPT Presentation

Transcript of U.S. Department of the Interior U.S. Geological Survey

Page 1: U.S. Department of  the Interior U.S. Geological Survey

U.S. Department of the InteriorU.S. Geological Survey

March 2014

LP DAAC MODIS Data ServicesJason Werpy1 , Chris Doescher2 , Chris Torbert2, Dave Meyer21Information Dynamics contractor to the U.S. Geological Survey (USGS) Earth Resources and Observation and Science (EROS) Center, Sioux Falls, SD, 2

USGS EROS

ORNL MODIS SubsetterThe ORNL (Oak Ridge National Laboratory) DAAC provides an interface that allows for users to subset certain MODIS data products. Users can specify a location, the number of pixels around that location to subset, and a selected timeframe for subsetting the MODIS data. The LP DAAC receives subset requests from ORNL for its products, creates subsets and forwards them to the ORNL DAAC for distribution to the MODIS subsetter users. (http://daac.ornl.gov/cgi-bin/MODIS/GLBVIZ_1_Glb/modis_subset_order_global_col5.pl)

Data Subsetting and Reformatting

Data Access

The LP DAAC provides a Web Services-enabled interface to its MODIS Reprojection Tool (MRT). The MRTWeb user interface allows LP DAAC users to select MODIS tiles for reprojection, subsetting, resampling, and mosaicking and executes those services on LP DAAC servers.

MRTWeb Services

Often, users of MODIS land products data from the LP DAAC are interested in areas that are much smaller in size than afforded by the data granules. In order to ease the burden of downloading several full tiles or swaths of MODIS data, the LP DAAC has deployed a number of MODIS data services to facilitate spatially subsetting the data to the user’s specifications. Also, given that users may only want certain bands of data, these services can also spectrally subset the MODIS data to return only the desired bands of interest. These services are also capable of reformatting the data to different map projections and/or formats in addition to also providing the ability to resample the data resolution. The MRTWeb Services are capable of mosaicking data as well. The Data Services deployed by the LP DAAC and other data providers offer efficient tools that allow users to streamline and optimize their workflow to get more processing done with less effort.

MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b01,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b01,-3,-3,3,4,9,7,10,5,7,7,3,11,10,6,7,5,3,3,4,8,9,2,5,11,11,5,3,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b02,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b02,-7,-7,-3,-2,2,-1,-1,0,1,1,-1,1,0,-2,2,-2,-4,-4,0,0,3,-4,-4,5,5,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b03,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b03,177,177,180,179,175,170,172,170,168,168,169,178,171,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b04,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b04,71,71,74,79,80,77,78,78,78,78,76,77,79,77,83,74,71,71,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b05,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b05,-42,-42,-43,-19,-42,-28,-51,-22,-37,-37,-20,-48,-33,-41,26,… MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b06,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b06,50,50,51,50,51,47,58,45,52,52,45,56,48,57,51,57,41,41,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_b07,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_b07,31,31,22,39,24,45,31,45,26,26,34,18,42,23,47,20,38,38,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_day_of_year,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_day_of_year,66,66,66,66,66,66,66,66,66,66,66,66,66,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_qc_500m,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_qc_500m,1077150581,1077150581,1077150529,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_raz,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_raz,12861,12861,12861,12861,12862,12862,12863,12863,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_state_500m,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_state_500m,120,120,120,120,120,120,120,120,120,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_szen,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_szen,3994,3994,3993,3993,3992,3992,3992,3992,3991,3991,…MOD09A1.A2004065.h17v06.005.2007255085450.sur_refl_vzen,MOD09A1,A2004065,Lat29.997917Lon-11.544357Samp21Line21,2007255085450,sur_refl_vzen,1154,1154,1163,1163,1172,1172,1181,1181,1190,1190,…

Data Services

Dataset: MOD09Q1.005., 4096, 3558, 3558, 3416, 3850, 3056, 3056, 4416sur_refl_b01[0][6], 4093, 4093, 3332, 3332, 3204, 3204, 4758, 3786, 5392, 5392sur_refl_b01[0][7], 4905, 2846, 3330, 3657, 3657, 5018, 5018, 5662, 5676, 5850sur_refl_b01[0][8], 3312, 3312, 4577, 4220, 5030, 5030, 5679, 5679, 5791, 5940sur_refl_b01[0][9], 3999, 4108, 4108, 4479, 4479, 5685, 5685, 5538, 5538, 5622sur_refl_b01[1][0], 907, 752, 844, 814, 574, 546, 618, 853, 1059, 1079sur_refl_b01[1][1], 742, 685, 681, 656, 566, 835, 1012, 984, 1015, 1033sur_refl_b01[1][2], 792, 715, 656, 649, 813, 906, 847, 981, 1015, 783sur_refl_b01[1][3], 715, 663, 689, 584, 644, 715, 981, 775, 779, 774sur_refl_b01[1][4], 625, 577, 612, 787, 715, 909, 731, 603, 697, 834sur_refl_b01[1][5], 697, 879, 787, 814, 942, 870, 673, 782, 838, 1140sur_refl_b01[1][6], 877, 879, 872, 1034, 1005, 725, 792, 838, 951, 1003sur_refl_b01[1][7], 916, 970, 879, 665, 676, 792, 928, 773, 912, 1050sur_refl_b01[1][8], 996, 880, 833, 1054, 676, 830, 1106, 1191, 1129, 1217sur_refl_b01[1][9], 830, 814, 979, 1040, 1101, 1061, 1076, 1097, 1146, 1149sur_refl_b01[2][0], 1322, 1125, 1359, 1349, 966, 894, 954, 1091, 1258, 1275sur_refl_b01[2][1], 1125, 1115, 1121, 1008, 894, 1071, 1195, 1184, 1184, 1191sur_refl_b01[2][2], 1180, 1067, 1008, 925, 1056, 1143, 1121, 1217, 1188, 956sur_refl_b01[2][3], 1067, 971, 912, 871, 947, 1067, 1236, 1217, 963, 1000sur_refl_b01[2][4], 950, 845, 966, 1259, 1367, 1236, 886, 745, 793, 939sur_refl_b01[2][5], 1293, 1475, 1475, 1367, 1391, 1022, 759, 885, 925, 1194sur_refl_b01[2][6], 1350, 1475, 1362, 1386, 1109, 820, 942, 1004, 1248, 1260sur_refl_b01[2][7], 1350, 1319, 1314, 1054, 748, 792, 1004, 895, 1166, 1187sur_refl_b01[2][8], 1423, 1015, 1003, 1119, 792, 1011, 1358, 1491, 1389, 1291sur_refl_b01[2][9], 1128, 1010, 1199, 1119, 1159, 1273, 1280, 1306, 1254, 1353sur_refl_b01[0][0], 4144, 4570, 4570, 3031, 3352, 3352, 3352, 4705, 4705, 5857sur_refl_b01[0][1], 4144, 2914, 2914, 4033, 4033, 5064, 5064, 5119, 5119, 6149sur_refl_b01[0][2], 3634, 3634, 4496, 4496, 5576, 5576, 5689, 5689, 6441, 6364sur_refl_b01[0][3], 3927, 4867, 4939, 5216, 5216, 5120, 5120, 5410, 5410, 4444sur_refl_b01[0][4], 4250, 4250, 4067, 4067, 4491, 4491, 4742, 4742, 3109, 3109sur_refl_b01[0][5], 4364, 4096

Applications that are aware of the OPeNDAP communications standards can easily integrate OPeNDAP data access to their users. One example of this is the Geo Data Portal (http://cida.usgs.gov/gdp/client/?development=true) from CIDA (Center for Integrated Data Analytics).

Common Service Actions

• Reprojection• Band Subsetting• Spatial Subsetting• Temporal Subsetting• Mosaicking• Resampling

MRTSwath Web Services

ORNL MODIS Subsetter Submission Form

ORNL MODIS Subsetter Results

OPeNDAP Interface

ORNL MODIS Subsetter Interface

OPeNDAP Results

OPeNDAP Client InterfaceCIDA Geo Data Portal

In order to facilitate the MODIS swath-based products, the LP DAAC has recently deployed services based on its MRTSwath Tool. These services are being made available via REST-based HTTP calls using the MRTSwath Web Services interface.

Mosaic,Reproject,Resample

http://mrtwebsvc.cr.usgs.gov/MRTWebProcessor/resources/esiMrtswath?FILE_URLS=ftp://ladsweb.nascom.nasa.gov/allData/5/MOD09/2014/050/MOD09.A2014050.1650.005.2014056234655.hdf& FORMAT=GEOTIFF_FMT&[email protected]&SUBSET_DATA_LAYERS='500m Surface Reflectance Band 1’ &PROJECTION=GEOGRAPHIC

Reproject,Resample,

Subset

MRTSwath Web Service Call

MRTWeb Interface

OPeNDAP OPenDAP (Open-source Project for a Network Data Access Protocol) is a data transport architecture and protocol based on the Hypertext Transfer Protocol (HTTP). The LP DAAC is providing OPeNDAP services (as part of a pilot project) to some users to allow them to select and subset data from the LP DAAC MODIS product collections. OPeNDAP can organize (aggregate) the data into time series that enables users to select data subsets across different observation dates. OPeNDAP also allows users to output data in different user-selectable formats (ASCII, netCDF, DODS).

LP DAAC MODIS Data Services facilitate the algorithms to archives paradigm by providing quick and efficient access to data products, saving users time and effort.