The European Open Science Cloud
-
Upload
helix-nebula-the-science-cloud -
Category
Technology
-
view
45 -
download
0
Transcript of The European Open Science Cloud
Helix Nebula – The Science Cloud with Grant Agreement 687614 is a Pre-Commercial Procurement Action funded by H2020 Framework Programme
The European Open Science Cloud
31 October 2016Bob Jones
CERNIT department
01/05/2023
This work is licensed under the Creative Commons Attribution-ShareAlike 4.0 International License.The content of this presentation is the sole responsibility of the authors and does not necessarily represent the views expressed by the European Commission or its services.
The Helix Nebula Science Cloud public-private partnership
D. Giordano HN GA8 21/09/2016
Series of short procurementsof increasing size and complexity
4
Augmenting CERN’s scientific computing programme with commercial cloud services
D. Giordano WLCG Workshop 9/10/2016
CERN cloud procurements 2015-2016
5
6
The Hybrid Cloud ModelBrings together• research organisations,• data providers,• publicly funded e-
infrastructures,• commercial cloud service
providers
In a hybrid cloud with procurement and governance approaches suitable for the dynamic cloud market In-house
source: rackspace, 2012
How/When to use commercial cloud services
Bob Jones, CERN 7
How/When to use commercial cloud services – example from LHC
Bob Jones, CERN 8
Major challenges
What if I get locked in? Are there relevant
standards I should be looking into?
What happens to my data?
How do I get a good deal?
What happens to my IT staff?
How can I compare contracts & SLAs?
What is PCP?
What are the others
doing?
How can I allocate costs?
What services do
I need?
1. Cloud computing is disrupting the way IT resources are provisioned2. In-house resources, publicly funded e-infrastructure and commercial cloud
services are not integrated to provide a seamless environment3. Current organisational and financial models are not appropriate4. The new way of procuring cloud services is also a matter of skills and education5. Legal impediments exist
Provides a landscape of cloud procurement in the European public research sector Makes pragmatic recommendations for the procurement of cloud services by PROs in Europe Provides a guide to cloud procurement, supported by best practices adopted worldwideProposes actions within the pillar three of the Digital Single Market Strategy which focus on maximising the growth potential of the digital economy
The PICSE Roadmap
4/5/2016 11
www.picse.eu/roadmap
Helix Nebula Science Cloud Joint Pre-Commercial Procurement
Bob Jones, CERN 11
Procurers: CERN, CNRS, DESY, EMBL-EBI, ESRF, IFAE, INFN, KIT, STFC, SURFSaraExperts: Trust-IT & EGI.eu
The group of procurers have committed• Procurement funds• Manpower for testing/evaluation• Use-cases with applications & data• In-house IT resources
Resulting services will be made available to end-users from many research communities
Co-funded via H2020 Grant Agreement 687614
Total procurement budget >5.3M€
What will be procuredA hybrid cloud platform for the European research community
05/01/2023 12
HNSciCloudPCP
Sour
ce: C
loud
Com
putin
g fo
r Gov
ies,
DLT
Solu
tions
,Da
vid
Blan
kenh
orn,
Van
Rist
au a
nd C
aron
Bee
sley
Combining services at the IaaS level to support science workflows
The R&D services to be developed are to be integrated withResources in data centres operated by the buyers groupEuropean-scale publicly funded e-Infrastructures
ChallengesInnovative IaaS level cloud services integrated with procurers in-house resources and public e-infrastructure to support a range of scientific workloads
Compute and Storagesupport a range of virtual machine and container configurations including HPC working with datasets in the petabyte range
Network Connectivity and Federated Identity Managementprovide high-end network capacity via GEANT for the whole platform with common identity and access management
Service Payment Modelsexplore a range of purchasing options to determine those most appropriate for the scientific application workloads to be deployed
Bob Jones, CERN 13
High Level Architecture of the Hybrid Cloud Platform including the R&D challenges
Bob Jones, CERN 14
HNSciCloud project phases
Preparation
• Analysis of requirements, current market offers and relevant standards
• Build stakeholder group• Develop tender material
Implementation
and sharing
Jan’16 Dec’18
Each step is competitive - only contractors that successfully complete the previous step can bid in the next
4/5/2016 15
4 Designs3 Prototypes 2 Pilots
Call-off Feb’17
Call-off Oct’17
Tender Jul’16
Bids submitted - engaging 28 multinationals, SMEs & public research orgs from 12 countries
Bob Jones, CERN16
HNSciCloud project phasesPreparation
• Analysis of requirements, current market offers and relevant standards
• Build stakeholder group• Develop tender material
Implementation
and sharing
Jan’16 Dec’18
Each step is competitive - only contractors that successfully complete the previous step can bid in the next
4/5/2016 17
4 Designs3 Prototypes 2 Pilots
Call-off Feb’17
Call-off Oct’17
Tender Jul’16
Bids submitted - engaging 28 multinationals, SMEs & public research orgs from 12 countries
Bob Jones, CERN 18
Research Infrastructures are facilities, resources or services of a uniquenature identified by European research communities toconduct top-level research activities in all fields
Interested Research Infrastructures:• EPOS, ESA, ESS• clusters: CORBEL,
ASTERICS-OBELICS
Will form an observer group
Launch eventICRI 2016, Cape Town - South
Africa
e-INFRASTRUCTUREResearch Infrastructure as key nodes of e-Infrastructure for Research
• Advanced e-Infrastructure of all Research Infrastructures
• Optimal interfaces between RIs and the external e-Infrastructure (Networks, Cloud, HPC, HTC)
• Data Quality assessment at RIs and setting quality standards for broad use
• Data access to “enabling data” i.e. data completed with adequate metadata, traceable origin, FAIR
• Long Term preservation of “useful data”
• Key role of “public” institutions and interplay with commercial clouds/repositories
Giorgio RossiChair
European Open Science Cloud
05/01/2023 20
https://bit.ly/cloudeu
• Federate existing and emerging horizontal and thematic data infrastructures, effectively bridging todays fragmentation and ad-hoc solutions.
• Provide 1.7m EU researchers an environment with free, open services for data storage, management, analysis and re-use across disciplines.
• Offer a trusted, open virtual environment for storing, sharing and re-using scientific data and results and supporting Open Science practices.
o Key needs: cost-effective, user-driven, privacy and IPR-conscious.
o Added value: scale, data-driven science, inter-disciplinarity.
The European Open Science Cloud will
Jean-Claude Burgelman DG RTD - European Commission
Governance
Life
sci
ence
s
Lead scientific users… …long tail of science
Phys
ics
Eart
h sc
ienc
es
Econ
omic
s
Soci
alsc
ienc
esScal
e of
sci
enti
fic a
ctiv
ity
(da
ta-
driv
en s
cien
ce)
High-performance computing
Data fusion across disciplines
Big data analytics
Data access and re-useData manipulation and exportData discovery and
catalogue
Long-term fundingLeverage of MS investment
Legacy and sustainability
IPR and privacy protection
Federation
Appl
ied
- eng
inee
ring
… …
Humanities Citizen science
Bottom-up governance
European data
infrastructure
Data storageSuper-Computing
High-speed connectivity
Open data and
services
Trust
Jean-Claude BurgelmanDG RTD - European Commission
Widening access (2/2): e-Infras as aggregators of demand
23
EOSC
Scientific Users
Commercial services
e-Infrastructures EU H2020 funding
€
€ ProcurementGrants
Augusto Burgueño Arjona, head of the Unit "eInfrastructure & Science Cloud“, DG CNECT, EC, Sept’16
Widening access (1/2): e-Infrastructures as service providers
24
EOSC
Scientific Users Industry Public Sector
e-Infrastructures
Augusto Burgueño Arjona, head of the Unit "eInfrastructure & Science Cloud“, DG CNECT, EC, Sept’16
Helix Nebula Initiative 2.0:Building value chains with data intensive science
Summary
Bob Jones, CERN 25
Commercial cloud services are expected to play an increasing role in the computing models of research communitiesA hybrid cloud model leverages the investments made in both the public and private sectors while ensuring trust and continuity
Mature technologies exist but integration, policy and governance requires careful attention
Changes to the procurement process in the public research sector are necessary to benefit from a dynamic Digital Single MarketHelix Nebula Science Cloud is the first in a foreseen series of EC co-funded procurement projects which will contribute to the European Open Science Cloud