IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will...

17
IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre (vERC) Martin Juckes, BADC

Transcript of IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will...

Page 1: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

IS-ENES [ees-enes]InfraStructure for the European Network for Earth System

Modelling

IS-ENES will develop a virtual Earth System Modelling Resource Centre (vERC)

Martin Juckes, BADC

Page 2: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

• Funded by EU Framework Programme 7 to develop infrastructure for Earth System Modelling, 7.6M€, 4 years.

• 20 partners, led by IPSL.• Objectives include:

education, enhancing model efficiency, model evaluation tools, data management and services for data users.

IS-ENES:key facts

Page 3: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

IS-ENES: data management

• Core funding objective: enhance European capability to deal with large and diverse datasets from Earth System Modelling projects, using distributed data archives.

• Software to support EU contribution to CMIP5/AR5 archive

Page 4: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Key partners in data management activities

PCMDI Program for Climate Model Diagnosis and Intercomparison

USA

IPSL Institute Pierre Simon Laplace

France

BADC British Atmospheric Data Centre

UK

MPI Max-Planck Institute Germany

CMCC Euro-Mediterranean Centre for Climate Change

Italy

BSC Barcelona Supercomputer Centre

Spain

LIU National Computer Centre Sweden

Page 5: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Challenges• Flexibility: an archive distributed between

partners with different funding sources and development priorities.

• Accessibility: diverse and growing user group

o Getting CMIP5/AR5 archive runningo Enhancing user serviceso Preparing for future archives

Page 6: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Background

• CMIP3 [PCMDI], ESG [USA]

• METAFOR: develop common information model [EU]

• NERC Data Grid: discovery service [BADC]

• C3CGrid [DKRZ]

• IPCC Data Distribution Centre [BADC/DKRZ]

• UK Climate Impacts Programme Data Delivery Package [BADC + UK partners]

• GRelC [BSC]

• Grid superscalar [CMCC]

Page 7: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Visualisationwww.ipcc-data.org/maps

Page 8: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Visualisationwww.ipcc-data.org/maps

Page 9: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

A few aims

• A comprehensive data policy • Optimise resource usage in execution of user

services • Enhance the efficiency of metadata transfer

between nodes • OGC, wget and OPeNDAP • Visualisation • Regional model support (OPeNDAP + OASIS)• Slice, regrid, differences and aggregates• Checksums• Post download support {e.g. fileStatusAtProvider:

<url> }

Page 10: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.
Page 11: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

How might a distributed archive

work?Core archive

Data providers

Data transformations

Users

Page 13: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

UKCIP08 Data Delivery Package

X

pdf-maxtemp-bristol

Page 14: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Barcelona Supercomputer Centre

• Founded in 2004 as Spain’s national computer centre

• Run the 95Teraflop MareNostrum supercomputer

• Will provide software for data analysis across a distributed archive

Page 15: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

National Computer Centre, Sweden

(Linköping University)• 59Tflop• www.nsc.liu.se

Page 16: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Euro-Mediterranean Centre for Climate Change

(CMCC)• www.cmcc.it• provides models, simulations, middleware,

application software and high quality personnel training both in the specific field of climate dynamics and computer technolog

Page 17: IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Core archive

Core archive• High value data• High service reliability• Provide