NASA’s EOSDIS and VOiG Objectives: A Comparison

VOiG Conference June 12, 2007 1

NASA’s EOSDIS and VOiG Objectives:A Comparison

Presentation to the Virtual Observatories in Geosciences (VOiG) Conference

Denver, COJune 12-15, 2007


Theme/Outline

• EOSDIS Evolution Plans Parallel eGY Objectives of the VOiG– EOSDIS Background– EOSDIS Vision for Evolution (Tenets)– eGY objectives– Mapping between EEE and eGY– EOSDIS and VOs


EOSDIS Background

• NASA’s EOSDIS is a petabyte-scale archive of environmental data that supports global climate change research

• EOSDIS provides for – Data ingest– Data processing– Data distribution– Archive management– User Services

• Holdings as of FY2006– Volume: 4.9 PB– Collections: >2K datasets– Granules: 56 million files– Browse: 14 million files

ACRIMSAT(12/99)

Solar Output

ACRIM

SORCE (1/03)Solar Irradiance

TIM, SIM, XPSSOLSTICE

Terra (12/99)EnergyBudget

CERES

Albedo,Aerosols,Vegetation

MISR

SurfaceImaging

MODISASTER

LowerAtmospheric

Chemistry

MOPITT

Aqua (5/02)EnergyBudget

CERES

SurfaceImaging

MODIS

AtmosphericSounders

AMSR-EAIRS/AMSU/HSB

Aura (7/04)TraceGases

TES

AtmosphericDynamics and

Chemistry

HIRDLS,MLS, OMI

Mesosphere

Stratosphere

Troposphere

TRMM(11/97)

Energy Budget

CERES, LIS

EvaporationH2O

Sea Surface Winds

OceanBiology

LandBiology

Volcanology

Ecosystem Dynamics

O3

precursor gases,

aerosols

Mission & Science 04102007.ppt

O3ClOBrOOH

trace gasesaerosols

Land Ice and Snow Cover

Rain

QuikScat(6/99)

Sea Surface Winds

SeaWinds

Temperature Moisture

Sea Ice

Fire Occurrence

METEOR 3M(12/01)

Aerosol Trace Gases

SAGE III

CloudSat(4/06)

Cloud Properties

CPR CALIPSO(4/06)

Cloud, AerosolProperties

CALIOP

Jason (12/01)Ocean Altimetry

Poseidon/JMR/DORIS

Rain

ICESat(1/03)

Ice Topographyand Altimetry

GLAS

ACRIMSAT(12/99)

Solar Output

ACRIM

ACRIMSAT(12/99)

Solar Output

ACRIM





Terra (12/99)EnergyBudget

CERES

Albedo,Aerosols,Vegetation

MISR

SurfaceImaging

MODISASTER

SurfaceImaging

MODISASTER

LowerAtmospheric

Chemistry

MOPITT

Aqua (5/02)EnergyBudget

CERES

SurfaceImaging

MODIS

SurfaceImaging

MODIS

AtmosphericSounders

AMSR-EAIRS/AMSU/HSB

AtmosphericSounders

AMSR-EAIRS/AMSU/HSB

Aura (7/04)TraceGases

TES

AtmosphericDynamics and

Chemistry

HIRDLS,MLS, OMI

Mesosphere

Stratosphere

Troposphere

TRMM(11/97)

Energy Budget

CERES, LIS

TRMM(11/97)

Energy Budget

CERES, LIS

EvaporationH2O

Sea Surface Winds

OceanBiology

LandBiology

Volcanology

Ecosystem Dynamics

O3

precursor gases,

aerosols

Mission & Science 04102007.ppt

O3ClOBrOOH

trace gasesaerosols

Land Ice and Snow Cover

Rain

QuikScat(6/99)

Sea Surface Winds

SeaWinds

QuikScat(6/99)

Sea Surface Winds

SeaWinds

Temperature Moisture

Sea Ice

Fire Occurrence

METEOR 3M(12/01)

Aerosol Trace Gases

SAGE III

METEOR 3M(12/01)

Aerosol Trace Gases

SAGE III

CloudSat(4/06)

Cloud Properties

CPR

CloudSat(4/06)

Cloud Properties

CPR CALIPSO(4/06)


CALIOP

CALIPSO(4/06)


CALIOP


Poseidon/JMR/DORIS


Poseidon/JMR/DORIS

RainRain

ICESat(1/03)


GLAS

ICESat(1/03)


GLAS

EOS 24 Measurements


EOSDIS ContextFlight Operations,Data Capture,Initial Processing,Backup Archive

Data Transportto

DAACS/SIPS

Science Data Processing,Info Mgmt,Data Archive,& Distribution

Distribution,Access,Interoperability,Reuse

EOSSpacecraft

Internet

Value-AddedProviders

InteragencyData

Centers

Int’l Partners& Data Centers

Data Acquisition

White SandsComplex(WSC)

Tracking& Data

Relay Satellite(TDRS)

ResearchUsers

EducationUsers

DistributedActive

ArchiveCenters

InstrumentTeams and

SIPSs

Data Processing

&MissionControl

EOS Polar Ground Stations

MediaPublic

ESIP2/3’s

RESACs

RACs

(Search,order,distribution)

(Distribution)


EOSDIS - Distributed Data Centers

JPLMLS, TES

San DiegoACRIM

NCAR, U of Col.HIRDLS, MOPITT, SORCE

GSFCGLAS, MODIS, OMI, OCDPS

LaRCCERES, SAGE III

GHRCAMSR-E, LIS

SIPS DAAC

GHRC


EOS Clearinghouse (ECHO)

Data Registry

CollectionsGranules Browse Images

• ECHO is the middleware between EOS data and science data users via a service-oriented architecture– Data Partners provide metadata for their EOS data holdings and

other Earth science-related data holdings– Client Partners develop software (“clients”) to give science data

users access to ECHO’s registries using ECHO’s open APIs– Science data users search ECHO's registries and access data and

services using an ECHO client

ECHO

ExtendedServicesRegistry

DataPartner

APIs

ClientPartner

APIs

DAACs

Other DataPartners

Modeling,Applications,

Decision SupportSystems

General-Purpose

GUIs

TailoredGraphical User

Interfaces

Client Partners Data Partners

End User


EOSDIS Evolution

• In 2005, NASA began a formal effort to reinvigorate EOSDIS– Known as EOSDIS Evolution

• The major objectives of Evolution are:– Improve response to science needs– Facilitate a more distributed environment– Manage archive volume growth– Upgrade aging systems and components– Reduce recurring costs of operations and sustaining

engineering


EOSDIS Evolution Benefits

• EOSDIS developed a vision for the 2015 timeframe – Vision description on next slide

• Key features of the EOSDIS Evolution approach– Incorporated ideas from data center experiences– Encouraged data centers to assume leadership of development

and sustaining engineering responsibilities – Reduced dependence on COTS products– Transitioned responsibilities among elements transparently to

users– Introduced efficiencies in services and cost management

• processing on demand• on-line archive storage• commodity platforms

• Implementation began in 2006


EOSDIS – Vision Tenets

Vision Tenet Vision 2015 Goals

Archive Management

NASA will ensure safe stewardship of the data through its lifetime. The EOS archive holdings are regularly peer reviewed for scientific merit.

EOS Data Interoperability

Multiple data and metadata streams can be seamlessly combined. Research and value added communities use EOS data interoperably with other

relevant data and systems. Processing and data are mobile.

FutureData Access and

Processing

Data access latency is no longer an impediment. Physical location of data storage is irrelevant. Finding data is based on common search engines. Services invoked by machine-machine interfaces. Custom processing provides only the data needed, the way needed. Open interfaces and best practice standard protocols universally employed.

Data Pedigree Mechanisms to collect and preserve the pedigree of derived data products are

readily available.

Cost Control Data systems evolve into components that allow a fine-grained control over

cost drivers.

User Community Support

Expert knowledge is readily accessible to enable researchers to understand and use the data.

Community feedback directly to those responsible for a given system element.

IT Currency Access to all EOS data through services at least as rich as any contemporary

science information system.


eGY Objectives/Declarations

Reference: http://www.egy.org/declaration.html

Article 1 Data accessEarth system data and information should be made available electronically with interoperable approaches that facilitate open access

Article 2 Data release

Owners, custodians, and creators of Earth system data should work together to share their digital information with the world community, though in a manner that respects intellectual property rights and security constraints.

Article 3 Data description

Providers and users of Earth system data and information should share descriptions of structure, content, and contexts to facilitate interoperability and the discovery of relationships within and between information resources

Article 4 Data persistenceData and information about the Earth system should be preserved and sustained in forms that are both software and hardware independent so as to be openly accessible today and in the future

Article 5 Data rescueEffort should be made to identify and rescue critical Earth system data and ensure persistent access to them.

Article 6Common standards and cooperation

Standards for interoperability should be identified, created, and implemented through international collaboration.

Article 7 Capability buildingCommunities with advanced information technology and communications capabilities should contribute to developing such capabilities elsewhere to reduce the digital divide.

Article 8Education and public outreach

Students, scientists, decision-makers, and the public should be informed about and be enabled to contribute to our understanding and management of Earth system phenomena that impact human survival


Mapping of EEE vision to eGY objectives

EOSDIS Vision ArticleeGY Vision and

Objectives

Archive Management 4 Data persistence

EOS Data Interoperability1 Data access

3 Data description

Future Data Access and Processing

2 Data release

6Common standards and cooperation

Data Pedigree 5 Data rescue

User Community Support 8Education and public outreach

IT Currency 7 Capability building

Cost Control


Comparison Points

• Note the similarities in objectives; almost a one-to-one relationship

• Consistent with EOSDIS evolving into more of a distributed data system– EOSDIS supports a pre-planned community of

providers, but makes data available to all interested users in the world community

– Recognizes that access to outside data is necessary to develop the data products and models for meeting the science objectives

• Given the common goals, EOSDIS and VOs should understand how to work together


EOSDIS and VxOs – Discussion Questions

• How can EOSDIS and VOs benefit from working together?– Could sharing data lead to more meaningful

scientific products?• Earth science data (from EOSDIS) and

heliospheric sciencedata (from space science VOs)

– Growing importance of space weather impacts on human activities

– Upper atmospheric interactions

– Are there other Earth science disciplines that would benefit from sharing data and ideas?


EOSDIS and VxOs – Discussion Questions

• How would the systems interact?– How would a users interact with two (or more)

systems?• common query approaches• registries of capabilities• product catalogs

– What level of services provided to the data provider, data user?

• EOSDIS has explored these issues in developing ECHO– How do you accomplish data fusion between the

systems?

• What is the science use case for EOSDIS interaction with a virtual observatory?


Summary

• EOSDIS supports a variety of data providers and provides data services to many users through its network of data centers and data access mechanisms– Serves as a distributed data system for NASA Earth

science data– Continuously improving the means to access and

share data• The VO paradigm demonstrates alternative

ways to performing similar functions• Exchange of information between EOSDIS and

VO participants would be beneficial

NASA’s EOSDIS and VOiG Objectives: A Comparison

Documents

Transcript of NASA’s EOSDIS and VOiG Objectives: A Comparison