APA Conference, London, 8-9 November 2011 Mirko Albani (Earth Observation Ground Segment Department,...

APA Conference, London, 8-9 November 2011

Mirko Albani(Earth Observation Ground Segment Department, European Space Agency)

ESA Long Term Data Preservation Activities and SCIDIP-ES project

• ESA Earth Observation Long Term Data Preservation (LTDP) Activities

• SCIDIP-ES Project

• ESA LTDP future programme

Presentation Outline




METEOSAT Second Generation MSG-1, -2, -3

METEOSATM-1, 2, 3, 4, 5, 6, 7

METOP-1, -2, -3

Earth Watch

Earth

Explorers

ERS-1, -2 ENVISAT

GOCE

GMES in cooperation with EC

SMOS

(Gravity and Ocean Circulation Explorer)

Earthnet: Access for European users to non-ESA missions: Landsat, SPOT, CZCS, J-ERS, SeaWiFS, ALOS ...

Sentinel 1Sentinel 2

to better understand the EarthSystem

in cooperationwith EUMETSAT

Meteo

ApplicationsServices

to initiate long term monitoring systems and services

Sentinel 4/5

Science(Gravity and Ocean Circulation Explorer)

(Soil Moisture and Ocean Salinity)

CryoSat2(Polar IceMonitoring)

ADM/Aeolus(Atmospheric Dynamics Mission)

SWARM (Magnetic Mission)

EarthCARE(Clouds, Aerosols & Radiation Mission)

Sentinel 3

MTG

EE 7

Sentinel 5P

1990 2000 2010Since 1977

ESA and Earth Observation missions

EO Archives Data volume expected trend

The plans of new ESA missions indicates 5-10 times more data to be archived (Level 0) in next 10-15 years.

ESA EO LTDP Preliminary Programme 2009-2011

Objectives:•For all ESA Earth Observation and TPM ESA managed missions:

Ensure and secure the preservation of archived data and associated knowledge for an unlimited time span.

Ensure, enhance and facilitate archived data accessibility.

•As part of a coordinated and harmonized collective approach among the data owners in Europe (i.e. European EO LTDP Framework) aimed at preserving all European EO data and associated knowledge, at favouring their exploitation and sustained through cooperative (multi-source) long term funding schemes.

Most urgent activities to prevent data loss and to enhance accessibility implemented in the ESA archives following the “European LTDP Common

Guidelines” and “Data Set Content Standard”

ESA EO LTDP Preparatory Programme 2009-2011 Work Plan

LTDP Workplan 2009-2011

Implementation(ESA archives)

Analysis & Studies

Define data set to be archived beyond telemetry

Cost

Funding options

Technical Content ( activities for period 2012 onwards)

European LTDP Framework

Integrity of archived data

Data access and security

Interoperability and standardization

Archives exploitation

ESA archives

Schedule

ESA general and mandatory budgets

EC relation / interfaces

National Budgets


Coordination

Create a European collaborative technical framework

Complete, maintain & evolve the LTDP Common Guidelines ( involving CEOS /GEO)

Knowledge preservation beyond data archiving

Evaluate impact of latest technologies

Consolidate user requirements

Analyse & coordinate with other international LTDP projects (e.g. funded by EC )

European LTDP ProgrammePreparation

Completed or close to completion

Started

LTDPWorkplan 2009-2011

Implementation(ESA archives)

Analysis & Studies

Define data set to be archived beyond telemetry

Cost

Funding options

Technical Content ( activities for period 2012 onwards)


Integrity of archived data

Data access and security

Interoperability and standardization

Archives exploitation

ESA archives

Schedule

ESA general and mandatory budgets

EC relation / Interfaces

National Budgets


Coordination

Create a European collaborative technical framework

Complete, maintain & evolve the LTDP Common Guidelines ( involving CEOS//GEO )

Knowledge preservation beyond data archiving

Evaluate impact of latest technologies

Consolidate user requirements

Analyse & coordinate with other international LTDP projects (e.g. funded by EC)

LTDP ProgrammePreparation

Analysis and Studies

Implementation activities

Evolution activities

International EO LTDP Context

ESA membership

Participation to several projects

LTDP task

WGISS

Standards (e.g. OAIS)

SCIence Data Infrastructure for Preservation – Earth Science

Project Overview

Contacts:[email protected] (under construction)

Project: SCIence Data Infrastructure for Preservation – Earth Science (SCIDIP-ES)

INFRA-2011-1.2.2 Data infrastructures for e-Science

Introduction and Participants

• Project ID: 283401• Project Type: CP-CSA• Start Date: 01.09.2011• Duration: 36 Months• Website: www.scidip-es.eu

• Total Budget: 7,721,082 €• EC Funding: 6,599,992 €• Total funded effort in person/months: 605• Coordinator: European Space Agency• Contact Person: Mirko Albani (EOP-GS)

Project Consortium (17 partners):

Digital data preservation: the need

“A fundamental characteristic of our age is the raising tide of data – global, diverse, valuable and complex . In the realm of science, this is both an opportunity and a challenge.”

Report of the High-Level Group on Scientific Data, October 2010“Riding the Wave: how Europe can gain from the raising tide of scientific data”

2

SCIDIP-ES Context

2

From

generic to specific

The case The users

Fro

m s

peci

fic t

o ge

neric

3

Main Objectives

• Deliver generic sustained services for long-term preservation and usability as part of the data infrastructure for e-Science.

• Harmonize data preservation policies, approaches and tools in the Earth Science Domain.

• Demonstration through advanced test-beds.

Approach: the HLEG Vision“Researchers and practitioners from any discipline are able to find, access and process the data they need. They can be confident in their ability to use and understand data and they can evaluate the degree to which the data can be trusted”. SCIDIP-ES addresses these points in the following ways:

• By working closely with real users.

• By ensuring the availability of an effective governance and maintenance of the services from the start, and by not trying to impose a top-down system.

• By addressing disciplinary and cross-disciplinary strategies for metadata definition to ensure that data can be re-used.

• By applying the subsidiarity and taking advantage of the growing need for researchers to use data from outside their own discipline.

Action Plan

Combine a top-down, data centric point of view, using a proven design for generic infrastructure services for persistent storage, access and management, with a bottom-up, user-centric view, based on requirements, development, testing and validation,

from the Earth Science community, within the framework of OAIS.

SCIDIP-ES Work packages relation

SCIDIP-ES Services

Projects & Dissemination links

APA Members Organizations

ResearchProjects

ESA LTDP

Earth ScienceCommunity

APAVirtual Center of

Excellence

SCIDIP-ES results

SCIDIP-ES will provide by the end of the project:

• Generic sustained long-term preservation services tested, validated and used in different domains and in particular in the Earth Science one.

• Harmonized Earth Science data preservation policies, approaches and architecture.

SCIDIP - ES is a practical answer to one of the most challenging problems of the current digital era using the sensitive

Earth Science domain as pathfinder.

SCIDIP - ES is a practical answer to one of the most challenging problems of the current digital era using the sensitive

Earth Science domain as pathfinder.




Presentation Outline




ESA LTDP Future Programme

• It covers the period beyond 2013 and will be submitted to ESA delegations in 2012 for approval as part of the ESA mandatory activities.

• Objective to guarantee long term preservation, access and exploitation of data, and associated knowledge, archived at ESA facilities and generated by ESA and ESA-managed Third Party missions in ALL fields of space Science and in particular: Scientific data generated by payloads and instruments onboard space platforms (e.g.

spacecrafts, ISS) today not preserved systematically. Enabling and supporting ESA’s and European Exploitation Programmes and activities

requiring long term data series (e.g. Climate Change Initiative) or the utilization of old data holdings in the long term (e.g. in astronomy for change detection in stars, pre-ISS missions in Life & Physical Sciences) and to support new missions.

In coordination with other space science data owners in Europe aiming at coherently preserve all European space data and associated knowledge.

Preservation and access to spaceborn Science data and associated knowledge is fundamental. The ESA LTDP Programme will significantly

contribute to the future of science (and in particular Earth Science).

Thank you !

Any question ?

Contacts: [email protected]

APA Conference, London, 8-9 November 2011 Mirko Albani (Earth Observation Ground Segment Department,...

Documents

Transcript of APA Conference, London, 8-9 November 2011 Mirko Albani (Earth Observation Ground Segment Department,...