Sprint to Plenary: Progress towards Istanbul

GEO Joint Committee Meeting Salzburg, Austria14 September 2011

Ivan DeLoatch, Co-chair, ADCMirko AlbaniDoug NebertStP Integration Team

Outline

• Sprint to Plenary (StP) Background• StP IntegrationTeam (StP TP) • StP-IT Activities• Plenary Demo Preparation and Use Cases• Status of Implementation, Integration, and

Testing• Next Steps

Background and issues

• ADC meeting in Brazil resolved to adopt a modified approach in demonstrating value of GEOSS to share with Plenary:– Evolve from search to EO data access– Simplify registration, discovery, and access– Enable/integrate access to key inventories– Focus on Critical EO Priorities and Data-CORE– Improved data visualization and applications

• Sprint to Plenary (StP) to implement the above approach

StP action plan

1. Develop a vocabulary of EO observational parameters: AIP-4

2. Identify, assess and prioritize data sets supporting priority EO parameters: AIP-4

3. Engage data providers in enabling online access: GEOSec

4. Plenary demo definition and set-up (exploiting and integrating selected features of FedEO, GENESI-DEC, and EuroGEOSS into GCI): StP Integration Team

5. Complete GCI upgrades for the Plenary demonstration: StP Integration Team and GCI Providers

6. Package demonstration and usability testing for Plenary: StP Integration Team, GCI Providers, UIC

StP – Integration Team

The StP Integration Team (StP-IT) has been created at the ADC May 2011 Geneva meeting in order to support the StP and carry out the implementation and demo set-up.

StP Integration Team members

Co-leadsJ. Martin (GWP and FedEO)D. Nebert (CL and CSR)R. Cossu (GENESI-DEC)S. Nativi (EuroGEOSS)G. Percival (AIP)R. Shibasaki (Ontology/vocabulary)

M. AlbaniD. NebertM. Craglia

Experts

StP-IT Activities (from StP Showcase document)

1. Evaluate the potential GCI integration with the GENESI-DR/DEC and EuroGEOSS search / access

2. Anticipate vision of GEOWOW federation and infrastructure elements

3. Evaluate the implementation of additional GCI upgrades (e.g. ontology/semantic search, data-Core and DSTF tags, CWIC and FedEO)

4. Ensure the sustained operations of the GENESI-DR/DEC and EuroGEOSS data access

5. Define demonstration use cases for the GEO Plenary

6. Set-up of the demo

• Weekly teleconferences held since May, progress made in most of the activities

• Defined Resource Categories for user search results display in GWP

• Defined Baseline Architecture and Set-up for the Plenary Demo (GCI and extension components)

• Evolution, integration and test activities ongoing or planned for GCI and extension components and their IF

• Defined Data Access Use Cases for the Plenary demo (to be finalized).

Status of StP IT Activities

Resources Categories

Category Name Category Description

1. Datasets Description of individual or collection datasets. The description includes: title, organization, description of the dataset, access protocol and URL, access conditions, and other basic properties including tags (e.g. GEOSSDataCORE). Divided in two subgroups: “Unrestricted (GEOSSDataCore)” and “Other data”.

2. Monitoring and Observation Systems

Description and links to: Detection and surveillance systems, in situ and satellite based monitoring systems, Disaster response systems, etc

3. Computational Models Component process models, social and economic models, land surface models, atmospheric chemistry models, hydrologic and terrestrial water cycle models, etc

4. Initiatives International, national, and regional initiatives and programmes.

5. Websites and documents Documents, websites, identification/classification systems, bibliographic, subscription services, digital/virtual reference desks, education and training resources, courses, includes former capacity building material

6. Data Services6.1 Analysis and visualization6.2 Alerts, RSS, and Information Feeds6.3 Catalogues, Inventories and Metadata Collections

6.1 Visualization/image processing, mapping services, statistical applications, calibration/validation, assessment services, processing services, workflows, 6.2 Real-time alerts, information feeds; supports hazards planning, disasters prevention, early warning 6.3 Description of: Catalogues, archives, Data/metadata search and retrieval systems and services, data discovery systems, data delivery systems, service discovery, etc

7. Software and applications Interactive programs, downloadable software, tools, for use with EO data and services etc.

Demo Set-up key aspects

• Real-time and on-line interface to inventory catalogs (products discovery) and repositories (products access)

• Merge results from both local GWP search and remote search (EuroGEOSS search broker or CL) in a single window in the GWP.

• Improved results presentation and links to viewers and helper applications

# 1212

Current:2 windows

GEO Plenary:single window

EuroGEOSS Broker will provide categorised results to the GWP for display in the single results window

Data Access: Products Collections & Granules

Plenary Demo Baseline for Data Access:

–GWP displays in the single results window all kind of information including data products and inventories.–Individual data products from inventories are displayed in 2nd separate windows (e.g. GENESI, EuroGEOSS Access Broker, FedEO) opened automatically after user query.–Links to format-specific helper applications are associated with the data results.

DATA DISCOVERY AND ACCESS DEMO SET-UP

User query

1) All results incl. product collections

2) Products granules

Demo Setup Data Handling Tools

The downloaded product can be visualized by dedicated tools

E.g. SST product in netCDF format as visualized by PANOPLY SW

User Search

ClearinghouseClearinghouse

Catalogue XXCatalogue XX

Catalogue YYCatalogue YYSearchresults

Search

Current Baseline under test

GEO Web Portal (GWP) StP Improvements (1)

• User interface improvement:– Resource Categories, Dataset categories (GEOSS DataCore)– Results merging from local GWP DB and remote DB– Data access: Passing GWP context to data provider (local or remote)

via exposed OpenSearch specification– Improved presentation of ISO metadata

• New & Improved Map Viewer to better support WMS,WFS, WMC, KML• Enhanced 3D globe: Google Earth (GE) replacing Flash Viewer

– Improved KML & RSS visualization on GE• Improved interaction between search results and Client visualization

tools: directly open standard services in GWP Map Viewer (e.g. WMS) and Google Earth plug in

All improvements originally envisaged for the Plenary demo: prioritization might be necessary (some might be delayed). Changes impacting other GCI components are implemented in a coordinated and timely manner.

GEO Web Portal (GWP) StP Improvements (2)

• GWP V2.0.1• New featured GDC Portlet

(configurable to get data from local or remote)

• High visibility given to datasets

• Implement easy GEOSS Data-CORE discovery

• Search result harmonisation and metadata visibility improved in single portlet

GEO Web Portal (GWP) StP Improvements (3)

• Placeholder for quick metadata recognition

• Improved user navigation (Removed 1 level of Navigation)

• Configurable search by category

3D Globe in GWP

Integration activities

• Preliminary tests on interface between GWP & EuroGEOSS Broker started, additional tests planned in mid September:– EuroGEOSS broker assumed to behave as the

Clearinghouse in the interface with the GWP. – No or minor changes expected on GWP to cope with

new interface• Integration and test between EuroGEOSS Broker and

Clearinghouse complete.• Integrated search of remote inventory catalogues

(context passing) FedEO, GENESI-DEC, CWIC defined and agreed within StPIT.

Demo Scenario Use CasesFive Use cases currently considered:1.Water Cycle Management (Africa) - ESA

2.Agriculture Monitoring (Global) - TBD

3.Disaster Management (Turkey) - ESA

4.Atmospheric Monitoring (Global, Europe, China) – EUM/NOAA

5.Biodiversity(Europe) – JRC

•Specified as user actions/steps, flow of information, etc..•Around 30 datasets relevant for the use cases and for the UIC report Observation Parameters are being addressed for real time access in actual repositories (no harvest).•Different data categories, formats, sources and data access protocols: GEOSS is heterogeneous !!!

StP Demo Scenario

Demo Scenario HighlightsDifferent categories of users:• Scientific user knowledgeable about EO data and EO

resources (Expert User)• Policy/decision maker (Non-expert User)

Different categories of data (formats, protocols, resolutions):• Global data (low resolution EO space data)• Regional data (low-medium resolution EO space data)• Local data (medium-high resolution EO space data and/or

in situ data)

Demo Scenario Use Cases (2/3)

1. Water Cycle Management (Africa) – Lead ESA– Data Access in support to water resources management– Non-expert User, Regional data– Involvement of Tokyo University for dataset and use case

definition

2. Agriculture Monitoring (Global) – Lead TBD– Time series of Earth Observation satellites and in-situ

observations systems data in support to Joint Experiments on Crop Assessment and Monitoring

– Expert User, Global, Regional and Local data– Involvement of User Community and Lead for use

case finalization needed

Demo Scenario Use Cases (3/3)3. Disaster Management (Turkey) – Lead ESA

– Data Access and Processing in support of Disaster Management

– Expert and Non-expert User, Local data

– User communities to be involved for use case consolidation

4. Atmosphere Monitoring (Global, Europe, China) – Lead EUM/NOAA

– Data Access in support to Atmosphere monitoring (Ozone, NO2, etc) via Internet and Satellite (GEONETCast)

– Non-expert and Expert User, Global and Regional data

– Need involvement of User Community and Lead for finalization

5. Biodiversity (Europe) – Lead JRC– Data access in support to different climate change scenarios and to

allow ecological forecasting

– Non-expert User

Responsible needed for the finalization and implementation of use case #2 otherwise will be removed

Demo Presentation for Plenary

• One scenario use case (of the four) will be selected for Plenary presentation

• Presentation format:– Introduction and background on Sprint and

identification of new capabilities– Demo as screen-captured video to be presented

by a GEO decision maker– Summary of capabilities and implications

Resource identification

• AIP-4 and STP individuals have been developing a matrix of relevant EO data that are available for the demonstrations and support:– GEOSS Data CORE (full and open access, online)– EO Observable Vocabulary terms– Demo scenarios

Additional Features

• Semantic search capabilities• Currently Integrated in the EuroGEOSS Broker• To be moved at GWP level (interface to users), if

feasible by GEO Plenary, through a navigation tool allowing user to browse through a hierarchy of terms and perform a search on relevant ones.

• Several options available and under consideration:• Navigation tree on GWP Home Page based on UIC

report Observation Parameters in addition to SBA navigation tree

• Ontology external service accessed by GWP as client

Next Steps (1)

• Validation and testing of GEO Web Portal (GWP) and EuroGEOSS broker

• Data access part of the Plenary Demos need to work for both the two options above:– Rules for displaying of collection and granules results

defined and agreed.– Implementation to proceed for both options in parallel to

testing activities.– Consolidation of access to all datasets identified in Demo

Plenary Scenario and addition of new ones if feasible.

Next Steps (2)

• Define and deploy mechanism to launch helper applications to manipulate downloaded data

• Mechanism to organize results by identified Resource Categories– EuroGEOSS Broker able to categorize resources

according to defined categories (TBC). – Interface with GWP under test.

• Demonstrate use of GEOSS EO vocabulary (ontology) for assisted search in GWP– Currently supported by EuroGEOSS Broker

• Use cases finalization• Data asset registration and classification

Scheduling

• Complete SW integration and consolidation• Continue to perform tests on updated GCI

components and demonstration set-up as needed for the Plenary demonstration

• Cut-off date to freeze the GCI version that will be demonstrated at the Plenary: 15th October

• Finalize Use cases and all testing activities: 15th October

• Complete fine tuning and demo set up: 31st October

• Videos ready by 10th November• Plenary Demo 16-17 November

Exhibit Set-up (TBC)

• At the Plenary, from a couple of not-manned PCs in the “demo” stand, use cases can be run in automatic (e.g. Global Agriculture Monitoring use case and African Water Cycle use case videos).

• From another manned PC in the “demo” stand, a hands-on session can be run. It might be thought based on both predefined use cases and any live criteria given by the users attending the session.

• Proper DVB reception HW and SW shall be installed at the Plenary premises to access NOAA data for Atmosphere scenario via GEONETCast (TBC).

Thank you …