Post on 27-Dec-2015
http://www.euchinagrid.eu
FP6−2004−Infrastructures−6-SSA-026634
EUChinaGRID Project
Giuseppe AndronicoTechnical Manager EUChinaGRID Project
INFN Sez. CTTaipei 27.03.2007
2 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Outline
The project outline Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
3 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Project Information
EUChinaGRID is a Specific Support Action (SSA) The project started on the 1 January 2006. 24 Months duration. 10 partners (6 from EU and 4 from China). Project budget 1,327,998 €. A total of 495 Person Months (325 Funded).
4 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
ParticipantsPartners Third Parties
INFN (Italy) CoordinatorUNIVERSITÀ DI ROMATRE –Dip. di Fisica – Rome (IT)
CERN – Geneva (CH)ACADEMIA SINICA GRID COMPUTING CENTRE (ASGC) - TAIPEI
Università di Roma Tre - Dip. di Biologia – Rome (IT)
Consortium GARR (IT)
GRNET (GR)
Jagiellonian University - MC - Cracow (PL)
Beihang University - Beijing (CN)
CNIC-CAS – Beijing (CN)
IHEP-CAS - Beijing (CN)
Peking University – Beijing (CN)
5 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
EUChinaGRID at a glance
Set-up and manage a Pilot Infrastructure
Train users and site administrators to use and operate an e-Infrastructure
Disseminate, both
“bottom-up” and “top-
down”, the e-Infrastruc-
ture paradigm for long
term sustainability of
e-Science
Attract new
communities in
learning, testing and
using pilot
infrastructure
6 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
EUChinaGRID Main Objectives
Support the Interconnection and Interoperability of Grids between Europe and China.
Main focus is on two specific infrastructures:• CNGRID in China• EGEE in Europe
Dissemination of advanced knowledge in Grid technology is also an important part of the activity.
Strengthening the collaboration between scientific groups in both regions, supporting existing and new Grid applications.
7 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The “global” network
8 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The “global” grid
9 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The project Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
10 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The project Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
11 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Network planning A deliverable was produced
Status and perspectives of network connectivity to Asia
It describes the state of the art and the perspectives of network connectivity between Europe and Asia.
Partners are using both CERNET, directly connected to TEIN2/ORIENT, and CSTNET, the two main Research Networks in China.
EUChinaGRID is developing synergies with ORIENT/TEIN2 projects to improve the connectivity between China and Europe
12 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
2.5Gbps
TEIN2
and
ORIENT
connectivity
upgrade
13 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The project Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
14 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
IPv6 compliance
Investigated the compliance of gLite and GOS middleware
Implemented a tool to check the code Produced a guideline for developers Developed a useful collaboration with ETICS Gabriella Paolini will report later today on this same
argument in the session Grid Middleware & Interoperability III
15 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The project Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
16 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Euchina Grid Pilot Infrastructure
map
17 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Authorization and security Completed D3.1 and D3.2 We set up the CA infrastructure reaching the goal of
interoperable certificates on the pilot grid• CNIC Grid CA (http://ca.grid.cn/en)• Scientific DataGrid CA (http://ca.sdg.grid.cn/en)
Accredited by Asian-Pacific Grid Policy Management Authority
18 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Infrastructure Services Installed, configured and currently maintained:
Type of nodeType of node WhereWhere FunctionalityFunctionality
RB/BDII/UI Italy (CNAF) Resource Broker and Catalog, User Interface
GridICE collector Italy (CNAF) Grid Monitoring Service
VOMS Italy (CNAF) Virtual Organization Management Service
Sec. VOMS China (CNIC) Virtual Organization Management Service
SAM China (IHEP) Service Availability Monitor
Gstat Taiwan (ASGC) Grid Information System stats
19 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
ROC website Regional Operations Center: http://roc.euchinagrid.org Any kind of information about EUChinaGrid infrastructure Starting point for operations activity
• Links to all useful EUChinaGrid monitoring pages Documentation for users and sites
20 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Monitoring tools
BEIJING - PKU
21 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Ticketing System Address: http://support.euchinagrid.org Powerful and flexible tool Successfully used for operation activity on the EUChinaGrid
pilot infrastructure• Preliminary shifts done to improve grid availability
22 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The project Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
23 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
CNGrid and EGEE interoperability
We have achieved basic batch job submission between GOS (CNGrid) and gLite (EGEE)
Studied and implemented plug-in to extend GOS batch service
Studied the extension to allow CE to forward batch jobs to GOS
Set up pilot testbed for interoperability test• Submission of batch jobs from GOS to GLite works by now
– Simple batch job with “simple” data transfers– Large data transfers foreseen for this year
Resource information of GOS can be published on BDII Extending LCG Job Manager to submit batch job to GOS
feasible
24 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Pipeline-based gatewayPipeline-based gateway
GOS WMProxy
batch jobbatch job
ExtendedLCG-CE
batch job
GOS
batch job
Thread Pool
Scheduler
Thread Pool
Scheduler
Pipeline for GLite to GOS
Pipeline for GOS to GLite
Different colors in pipeline stand for different stages (StageIn, StageOut, … )
Each pipeline has corresponding thread pool and scheduler
Extended LCG-CE forwards batch jobs to gateway
Extended GOS forwards batch job to gateway
Idle thread pool used in scheduler
Scheduler executes stage in pipeline using idle thread from thread pool
25 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Testbed
portal.ct.infn.it
gos.ct.infn.it
glite-gos.ct.infn.it
WMProxy
glite-rb2.ct.infn.it
OpenPBS
GridSAM4GLite
GridSAM4GOS
WMS/RB
edg glite-UIExtended LCG-CE
jakarta-tomcat-5.0.28
Portal or WS-Client
Command Line
CE CE CE
WN WN WN
JSDL
JSDL
JDL RSL
RSL
RSL
JDL
RSLRSL
JSDL
JSDL
26 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The project Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
27 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Applications
EGEEATLAS and CMS
support
ARGO Data mover
MEDEA++
CorsikaNBP Application
Rosetta
Early/Late stage
28 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The project Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
29 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The virtuous cycle of dissemination
Wider dissemination
Raises grid awareness and
attracts new potential users
Dissemination of advanced
knowledge Provides potential
users with grid expertise
Promoting new communitiesNew users can now use and deploy their applications and act as a dissemiation vehicle at a National level
JOININGTRAINING
DISSEMINATING
30 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Some numbers 4 International Meetings, Workshops and Conferences organized
• 210 overall attendees
16 external events with EUChinaGRID presence
Dissemination and training materials produced
• >150 web pages
• 4 leaflets
• 3 press releases
5 tutorial events held
• 231 overall trained people
46 press cuttings collected in 9 different languages (including Chinese, English and Spanish) and 3 continents
48 questionnaires received from new potential users’ communities
31 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
http://www.euchinagrid.eu/
http://www.euchinagrid.cn/
Project’s website
32 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Training events: participants at a glance
Tutorial participants
0,00
40,0080,00
120,00
160,00200,00
240,00
Date
Tota
l Nu
mb
er
SysAdmins
Users
33 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Survey on new communities
To get a picture of new user communities adopting distributed and grid computing, in order to support their collaboration with EUChinaGRID activities.
Published on the website (in English and Chinese):
• http://www.euchinagrid.eu/new_communities_form.php
• http://www.euchinagrid.cn/questionnaire.php
Advertised by partners in their communities.
34 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
2nd EUChinaGRID Conference
Beijing April 24 — 25 Jointly with EchoGRID http://echogrid.ercim.org/content/view/11/18/
Networking EU & Chinese Grid Experiencesfor Innovation
35 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
The project Activities and status
• Network planning• IPv6 compliance• Infrastructure & operations• gLite – GOS interoperability study• Applications• Dissemination
Summary & conclusions
36 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Summary & conclusions
The project just passed the first annual review Very noticeable technical results Great progresses towards developing a human
network collaborating to the creation of a common grid infrastructure for e-Science between Europe and China.
The activities foreseen for this second year will further improve the results obtained so far, both from the technical and human networking point of view.
37 G. Andronico – INFN CT ISGC 2007 Taipei, 29.03.2007
Thank You for Your attention!
Questions