Grid and SCIEnce Semeniouk Igor LLR, Ecole Polytechnique Atelier de projet I3 SCIEnce.
-
Upload
angelina-klein -
Category
Documents
-
view
219 -
download
2
Transcript of Grid and SCIEnce Semeniouk Igor LLR, Ecole Polytechnique Atelier de projet I3 SCIEnce.
Grid and SCIEnce
Semeniouk Igor
LLR, Ecole Polytechnique
Atelier de projet I3 SCIEnce
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
2
Why Grid
Early Grid pioneers found that
• too hard to keep track of authentication data (ID/password) across institutions
• too hard to monitor system and application status across institutions
• too easy to leave "dangling" resources lying around, reducing system robustness
• too many ways to submit jobs• too many ways to store, access, and
ultimately manage distributed data.
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
3
Grid Architecture in a Nutshell
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
4
Middleware and GRIDS
• Middleware– Globus Toolkit, Xgrid, Sun Grid, …– CORBA, Condor, RPC, …– User Identification
• Certificate, password, Kerberos, …
• GRIDs– LCG, EGEE, NorthGrid, …
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
5
Globus Toolkit GT-4• Certificates for User and
Services• Tools for job submission• Web Services• Data moving and data
location• Service discovery• Monitoring• VO Support• Resource Broker• Data replication
UI
CA
CE
IS
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
6
Globus Toolkit
UI
CA
CE
SIwn
wn
wn
SE
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
7
Distributed Programming Frameworks
• NetSolve/GridSolve - NetSolve/GridSolve is an RPC-based library for executing solver code on Grid resources.
• Ninf-G - Ninf-G allows existing programming libraries to be used in a distributed fashion on a Grid using the RPC framework.
• MPICH-G2 - MPICH-G2 is a Grid-enabled implementation of the popular MPI (Message Passing Interface) framework
• Condor-G, DAGman - Condor-G and DAGman can be used to execute complex workflows (consisting of multiple independent or related jobs) using Grid compute resources via GRAM or Condor.
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
8
Globus Evolution
• Globus Toolkits • Web Services• WS-Resources Framework ( Grid via Web )
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
9
LCG and gLite software
UI
wnwnwn
SE
wnwnwn
SE
wnwnwn
SE
UI
RB
BDII
MON
FTS
VOMS
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
10
EGEE Monitoring
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
11
EGEE and LCG componentsVirtual
Organization
VO Support
VO Software Installation
User’s Role
VO Services VO Specific Grid Services
Monitoring
Application Information
LCG & gLite Application Information
Resource Broker
Monitoring
Data replication
VO Support
Globus Toolkit Security,
Job Submission
I/O Handling
Information Services
Monitoring and accounting
WEB Services
Local Farm LSF,PBS,CONDOR
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
12
SCIE GRA1Symbolic Computing on the Grid
• JRA1.1– Access to Symbolic Grid
Services
– Service Discovery
• JRA1.2– Access/Provide Grid Services
– Security polices
• JRA1.3– UI for SymGrid
– Orchestration of Grid Components
• JRA1.4– Adaptive scheduler– Dynamic resources
negotiator
• JRA1.5– Compilation use cases– Templates for common
tasks
• JRA1.6– Symbolic Grid Applications
• JRA1.7 – Evaluation
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
13
SCIE and EGEE
• JRA1.1– Access to Symbolic Grid Services - Web Services– Service Discovery - gLite Services discovery, Information Index
• JRA1.2– Access/Provide Grid Services - WS-Resources Framework– Security polices - Globus Security Framefork
• JRA1.3– UI for SymGrid - WSRF– Orchestration of Grid Components - MPICH-G, CONDOR-G
• JRA1.4– Adaptive scheduler - RB– Dynamic resources negotiator - CONDOR-G
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
14
Infrastructure EGEE / VO
• EGEE (Avril 2004)– Financé par l’UE (32M€) – Deux ans
• EGEE-II (Avril 2006)– Proposé à l’UE (~30M€)– Transition en cours– Deux ans.
JRA: Recherche commune
SA: ServicesSA1: Exploitation, support et management de la grilleSA2: Approvisionnement ressources réseauSA3: Intégration du middleware, Test et Certification
NA: Application RéseauNA1: ManagementNA2: DisséminationNA3: FormationNA4: Applications et supportNA5: Politique et coopération internationale
JRA1: Ingénierie logicielleJRA2: QualitéJRA3: Sécurité JRA4: Développement réseau
Aspect of Organisation in avarege
10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
15
Projet EGEE Perspectives
EGO: European Grid Organization ?