Grid for Flood Extent Extraction from SAR...
Transcript of Grid for Flood Extent Extraction from SAR...
![Page 1: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/1.jpg)
Grid for Flood Extent Grid for Flood Extent Extraction from SARExtraction from SARImageryImageryS. Skakun1, N. Kussul1, E. Lupian2,V. Savorsky3, Yu.Tischenko3,L. Hluchy4, P. Kopp5
1Space Research Institute NASU-NSAU, Ukraine2Space Research Institute RAS (IKI RAN), Russia3Institute of Radio-Engineering and Electronics of RAS, Russia4Institute of Informatics SAS, Slovakia5Centre National d’Etudes Spatiales (CNES), France
![Page 2: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/2.jpg)
2IKI RAN
2008
OutlineOutline
• GEOSS and Current Trends• Specific of EO Applications• Grid in EO Domain• Grid Infrastructure at Space Research Institute• Food Extent Extraction via Grid• Test Study Areas
![Page 3: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/3.jpg)
3IKI RAN
2008
GEOSS StructureGEOSS Structure
![Page 4: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/4.jpg)
4IKI RAN
2008
Data Fusion for Disaster Data Fusion for Disaster MonitoringMonitoring
Basic servics
• NDVI• Land
Cover• DEM• LAI• ...
Input dat
Models
Data assimilation• In-situ
• SYNOP• RAOB
• ДЗЗ
• AIRS• AMSR-E• QuikScat
MeteorologyWRF/MM5
Hydrology
SVAT
Applied services
Users Interested organizations
AgricultureDisastersCharter
Water resources authority
Hydrometcenter
Biodiversity assessment
Yield predictionDrought
monitoringFlood monitoring
& predction
Data asimilation• MODIS• MSG
Input data (satellite, in-situ)
![Page 5: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/5.jpg)
5IKI RAN
2008
Specific of EO Tasks (1/2)Specific of EO Tasks (1/2)
• Data of different spatial and temporal resolutions
• Heterogeneous data processing
• The need for near real-time data access
• Operational access to long-term data archives
![Page 6: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/6.jpg)
6IKI RAN
2008
Specific of EO Tasks (2/2)Specific of EO Tasks (2/2)
• Using models for trends prediction
• Complex data assimilation
• The need for high-performance computing
• Visualization of spatially distributed data
• Informational security enforcement
Atm
osph
ere
Oce
an
Biosphere
Cryosphere
![Page 7: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/7.jpg)
7IKI RAN
2008
Grid is Grid is convinientconvinient environmentenvironmentfor solving these problemsfor solving these problems
• Integration of multi-source data;• High-performance computing for
computationally intensive tasks and the need for processing in the near real-time for fast response;
• Security issues regarding satellite data policy;• Need for managing large volumes of satellite
data;• Can facilitate interactions between different
actors by providing a standard infrastructure and a collaborative framework to share data, algorithms, storage resources, and processing capabilities
![Page 8: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/8.jpg)
8IKI RAN
2008
Grid infrastructureGrid infrastructure
Архів супутниковихданих
Glite StorageElement
Glite ComputingElement
Обчислювальний
кластер
Cтанція прийомуEUMETCast
Обчислювальний кластер
Архів супутникових даних
Grid-сервер на базі GT4
Grid-сегментІКД НАНУ-НКАУ
Кластер СК ІТ-3
Grid-сервер на базі GT4
Grid-сегмент ІК НАНУ
Grid-портал
Grid-сегмент Remote Sensing Ground Station (Китай)
InterGrid
Grid-cерверина базі GT2
Український академічний
Grid-сегмент
![Page 9: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/9.jpg)
9IKI RAN
2008
Grid portalGrid portal
Enabling user access via Grid portal
![Page 10: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/10.jpg)
10IKI RAN
2008
Resources: HardwareResources: Hardware
• Space Research Institute resources:– Clusters:
• 2x2 AMD Opteron Gigabit Ethernet interconnect• 20 AMD Opteron cores & Infiniband interconnect
– Storage: up to 100 Tb
• Institute of Cybernetics:– SKIT-1 (48 CPU), SKIT-2 (64 CPU), SKIT-3 (300
cores) – SKIT-3 – 3TFlops, 5th position in TOP50 of NIS
countries
• Ukrainian Academic Grid Infrastructure
![Page 11: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/11.jpg)
11IKI RAN
2008
Flood Extent Extractionfrom Satellite Imagery
Архів супутниковихданих
Glite StorageElement
Glite ComputingElement
Обчислювальний
кластер
Cтанція прийому
EUMETCast
Обчислювальний кластер
Архів супутникових даних
Grid-сервер на базі GT4
Grid-сегментІКД НАНУ-НКАУ
Кластер СКІТ-3
Grid-сервер на базі GT4
Grid-сегмент ІК НАНУ
Grid-портал
Grid-сегмент Remote Sensing Ground Station (Китай)
InterGrid
Grid-cерверина базі GT2
Український академічний
Grid-сегмент
![Page 12: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/12.jpg)
12IKI RAN
2008
Flood Monitoring Flood Monitoring ––Access to Satellite DataAccess to Satellite Data
Currently, EnvisatASAR WSM can be
accessed & processed!
![Page 13: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/13.jpg)
13IKI RAN
2008
Flood Extent ExtractionFlood Extent ExtractionWorkflowWorkflow
1. Transformation of raw data to lat/long projection.2. Orthorectification using DEM => to remove shadowing
effects.3. Image calibration.4. Geocoding & co-registration with other data sets.5. Image processing using Kohonen neural networks (NN)
i. Image segmentation.ii. NN calibration.iii. Image classification.
6. Flood extent estimation using information of water bodies
![Page 14: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/14.jpg)
14IKI RAN
2008
Submission via Grid PortalSubmission via Grid Portal
• Deployed using GridSphere Framework• Portal provides access to
– satellite data (Envisat ASAR WSM) and– computational resources of the Grid infrastructure
• Through the portal users specify the input data, run the job, and get the output, i.e. flood extent
• The output product is a binary GeoTiff file with – 1 value indicating the presence of water– 0 value indicating no water
![Page 15: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/15.jpg)
15IKI RAN
2008
Specifying Job Submission Specifying Job Submission ParametersParameters
Executable file to run
Current directory
Executable parameters, i.e. input and output
![Page 16: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/16.jpg)
16IKI RAN
2008
Job Submission Status Job Submission Status --CompletedCompleted
Job is completed
It took approximately >30 min to process a single SAR image on a single workstation.
The use of Grid computing resources allowed us to reduce the time to <1 min !
![Page 17: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/17.jpg)
17IKI RAN
2008
Future ActionsFuture Actions
• To integrate a catalogue of satellite data (Envisat ASAR WSM) with a Grid portal and processing facilities– allow the users to easily search, process and
visualize the EO data (in particular, Envisat ASAR WSM)
• Automatic generation of KML files to be visualized in the Google Earth
![Page 18: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/18.jpg)
18IKI RAN
2008
Flood monitoring (Ukraine, Flood monitoring (Ukraine, TiszaTisza River, 2001)River, 2001)
![Page 19: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/19.jpg)
19IKI RAN
2008
Flood monitoring (China, Flood monitoring (China, HuaiheHuaihe River, 2007)River, 2007)
![Page 20: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/20.jpg)
20IKI RAN
2008
Flood monitoring (Mozambique, Flood monitoring (Mozambique, Zambezi River, 2008)Zambezi River, 2008)
![Page 21: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/21.jpg)
21IKI RAN
2008
Flood Flood –– India & Nepal, 2008India & Nepal, 2008
Flood waters derived from ESA’s Envisat satellite ima gery(20 August 2008)
![Page 22: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/22.jpg)
22IKI RAN
2008
Flood Flood –– Thailand & Laos, 2008Thailand & Laos, 2008
Flood waters derived from ESA’s Envisat satellite ima gery(16 & 20 August 2008)
![Page 23: Grid for Flood Extent Extraction from SAR Imageryd33.infospace.ru/d33_conf/2008_conf_pdf/B/Skakun.pdf · Grid for Flood Extent Extraction from SAR Imagery S. Skakun 1, N. Kussul 1,](https://reader036.fdocuments.in/reader036/viewer/2022063013/5fcd3bcbed91cb601674016b/html5/thumbnails/23.jpg)
23IKI RAN
2008
Thank You!