European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT...
-
Upload
shawn-redgate -
Category
Documents
-
view
218 -
download
2
Transcript of European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT...
![Page 1: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/1.jpg)
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Overview of Overview of GCM GCM (Grid Component Model)(Grid Component Model) andand Grid GridCOMPCOMPEU ProjectEU Project
Denis Caromel Denis Caromel
OASIS INRIA-UNSA-CNRS I3SOASIS INRIA-UNSA-CNRS I3S
Melbourne, Jan. 29 2007Melbourne, Jan. 29 2007
1. ProActive context1. ProActive context2. GCM2. GCM
![Page 2: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/2.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
ProActive andProActive and GCM GCM
• StructuringStructuring
of the libraryof the library3 big layersInner bricks
• Component Component
Aspects: notAspects: not
onlyonly
in Cp Box!in Cp Box!
![Page 3: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/3.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
ProActiveProActive• New GUIsNew GUIs
IC2D EclipseTimIt
![Page 4: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/4.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Grid Computing with Grid Computing with ProActiveProActive
Melbourne
Amsterdam
Beijing
Shanghai
Hierarchical
Deployment
Challenges: Programming Model,
Scale, Latency, Heterogeneity,
Versatility (protocols,firewalls...)
![Page 5: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/5.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
A
ProActiveProActive : Active objects : Active objects
Proxy
Java Object
A ag = newActive (“A”, […], VirtualNode)V v1 = ag.foo (param);V v2 = ag.bar (param);...v1.bar(); //Wait-By-Necessity
V
Wait-By-Necessity
is a
Dataflow
Synchronization
JVM
A
JVM
Active Object
Future Object Request
Req. Queue
Thread
v1v2 ag
WBN!
![Page 6: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/6.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
A
Creating AO and GroupsCreating AO and Groups
Typed Group Java or Active Object
A ag = newActiveGroup (“A”, […], VirtualNode)V v = ag.foo(param);...v.bar(); //Wait-by-necessity
V
Group, Type, and Asynchrony
are crucial for Cpt. and GRID
JVM
![Page 7: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/7.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Objects to Distributed ComponentsObjects to Distributed Components
Typed Group Java or Active Object
ComponentIdentity Cpt = newActiveComponent (params);A a = Cpt … .getFcInterface ("interfaceName");V v = a.foo(param);
V
AExample
of a
component
instance
JVM
Truly
Distributed
Components
![Page 8: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/8.jpg)
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GCMGCM + +
Scopes and Objectives:Scopes and Objectives:
Grid Codes that Compose and DeployGrid Codes that Compose and Deploy
No programming, No Scripting, … No PainNo programming, No Scripting, … No Pain
Innovation:Innovation:
Composite Components Composite Components
Multicast and GatherCastMulticast and GatherCast
MultiCastMultiCast GatherCastGatherCast
![Page 9: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/9.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
• GCM: Grid Component ModelGCM: Grid Component ModelGCM Being defined in the NoE CoreGRID
(42 institutions)
Open Source ObjectWeb ProActive implements a preliminary version of GCMService Oriented: NESSI relation exp.
• GridCOMP takes:GridCOMP takes:GCM as a first specification, ProActive as a starting point, and Open Source reference implementation.
The vision: The vision: GCMGCM to be the GRID to be the GRID GSMGSM
![Page 10: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/10.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GridCOMP PartnersGridCOMP Partners
![Page 11: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/11.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GCM ArchitectureGCM Architecture
![Page 12: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/12.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GCM Technical StructureGCM Technical Structure
1. Component Specification as an XML schema or DTD
2. Run-Time API defined in several languages
C, Java
3. Packaging described as an XML schema
4. Information for Deployment
(Virtual Nodes, … Variables, File Transfer, …)
![Page 13: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/13.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Content and ActivitiesContent and Activities
• 1 - Primitive Component Programming1 - Primitive Component Programming
• 2 - Legacy Code Wrapping, Interoperability2 - Legacy Code Wrapping, Interoperability
• 3 - Composition and Composites, Deployment3 - Composition and Composites, Deployment
• 4 – Autonomic features4 – Autonomic features
• 5 – IDE for GCM (Composition GUI, etc.)5 – IDE for GCM (Composition GUI, etc.)
![Page 14: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/14.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Collective InterfacesCollective Interfaces
![Page 15: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/15.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Collective InterfacesCollective Interfaces
• SimplifySimplify the design and configuration of the design and configuration of component systemscomponent systems
• ExposeExpose the collective nature of interfaces the collective nature of interfacesCardinality attributeMulticast, Gathercast, gather-multicast
• The framework handles collective behaviour The framework handles collective behaviour • at the level of the interfaceat the level of the interface
• Based on Fractal API : Based on Fractal API : Dedicated controller Interface typing Verifications
![Page 16: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/16.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Multicast interfacesMulticast interfaces
Transform a single invocation into a list of invocationsTransform a single invocation into a list of invocations
• Multiple invocationsMultiple invocationsParallelismAsynchronismDispatch
• Data redistribution (invocation parameters)Data redistribution (invocation parameters)Parameterisable: Distribution FunctionBroadcast, scatteringDynamic redistribution: Dynamic dispatch
• Result = Result = listlist of results of results
![Page 17: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/17.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
![Page 18: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/18.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Multicast interfacesMulticast interfacesResults as lists of resultsResults as lists of results
Invocation parameters may also be Invocation parameters may also be distributed from listsdistributed from lists
![Page 19: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/19.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Gathercast interfacesGathercast interfaces
Transform: Transform:
a list of invocations a list of invocations
a single invocationa single invocation
• Synchronization of incoming Synchronization of incoming invocationsinvocations~ “join” invocationsTimeout / Drop policyBidirectional Bindings (callers
callee)
• Data gatheringData gathering
Aggregation of parameters into lists
• Result: Result:
Redistribution of resultsRedistribution of results
Redistribution function
![Page 20: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/20.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Status of GCM in ProActiveStatus of GCM in ProActive
• Partial implementation: Partial implementation: ADL schema, API, Multicast, Gathercast, …Component GUI (prototype)
• Distributed components for various applications: Distributed components for various applications: Numerical, Legacy, …
• On-going experiments:On-going experiments:up to 300+ CPUs
![Page 21: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/21.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Current GCM experiments in ProActiveCurrent GCM experiments in ProActive
• JEM3D: 3D JEM3D: 3D electromagnetic electromagnetic application: application:
a single Cp on 300+ a single Cp on 300+ CPUs on GridCPUs on Grid
• Vibro-Acoustic Vibro-Acoustic application with application with EADS (legacy MPI EADS (legacy MPI coupling)coupling)
![Page 22: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/22.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Current GCM experiments in ProActiveCurrent GCM experiments in ProActive
• IBM:IBM:Security Fingerprint System
• ATOS Origin:ATOS Origin:Financial Application Optimization
• GridSystems:GridSystems:Wing SimulationTelecom Application, EDR processing
![Page 23: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/23.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Update on ProActive and GCM (1)Update on ProActive and GCM (1)
• New Version under preparation:New Version under preparation:
Nov. 10: ProActive Version 3.2 Beta
Jan. 26: ProActive Version 3.2(After PlugTests’ Learning, New Web
Site)
New features in 3.2 release:Next slide
![Page 24: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/24.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
New Web Site with 3.2 VersionNew Web Site with 3.2 Version
![Page 25: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/25.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Chinese Web thank to Tsinghua Univ.Chinese Web thank to Tsinghua Univ.
![Page 26: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/26.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Update on ProActive and GCM (2)Update on ProActive and GCM (2)
• New Features in ProActive Version 3.2:New Features in ProActive Version 3.2:New features in 3.2 release:
Conformance tests for Fractal, towards conformance tests for GCM
IC2D Eclipse Plugin
TimIt (Hierarchical, Visual)
Skeleton (improved, with File Transfer, Documentation)
gLite EGEE deployment updated
Support for Java 1.5 Generics:Active Objects can be instantiated from Generic Classes
Some Warnings removed
Improvements in OSGi integration
Prototype TTools for UML modeling of GCM components (TBC)
![Page 27: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/27.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM
• Once upon a time: Once upon a time: GSM: Global System for Mobile communication
• Process: Process: “critical decisions […] the GSM initiative became a success in
Europe […] Initially the strategy and technical specifications were agreed for
Europe and […] incorporating all non-European requirements […] worldwide to participate ”
From: Gsm & Umts: The Creation From: Gsm & Umts: The Creation
of Global Mobile Communicationsof Global Mobile Communications
Standardization of GSM was crucial for Standardization of GSM was crucial for EU advances in Mobile Telephony EU advances in Mobile Telephony
(Science and Business)(Science and Business)
![Page 28: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/28.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM
GRID faces the same challenge: GRID faces the same challenge: Build FlexibilityOpennessInteroperability
Objectives:Objectives:
Build a Word-Wide standard for Build a Word-Wide standard for
Science and Business GRIDs: GCMScience and Business GRIDs: GCM
![Page 29: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/29.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GSM and GCM PicturesGSM and GCM Pictures
• GSM cells:GSM cells:
• Components:Components:
![Page 30: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/30.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GSM and GCM PicturesGSM and GCM Pictures
![Page 31: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/31.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GSM and GCM PicturesGSM and GCM Pictures
![Page 32: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/32.jpg)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Conclusion (1)Conclusion (1) Scientific Issues and DirectionsScientific Issues and Directions
Components in the membrane:Components in the membrane:• Membrane:Membrane:
Meta-Objects Java Objects
• Components:Components:Active Objects
• If Cp in Mb:If Cp in Mb:Active Objects as
Meta-ObjectsNot suited for all
cases. If Dist. AO
If light+local POJOTBD
![Page 33: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/33.jpg)
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Conclusion (2) Conclusion (2) Key technology advancementsKey technology advancements
• Programming the Grid with reusable, composable, components Programming the Grid with reusable, composable, components vs. ad hoc solutions
• Component for Separation of Concerns and AOP:Component for Separation of Concerns and AOP:Gathercast allows to have synchronisation outside functional code
• Deployment on various architectures Deployment on various architectures Super Computer Center, Clusters, data-center, desktop Grids, …
• Interoperability with related Grid software Interoperability with related Grid software
• Integration into Service Oriented Architecture (SOA)Integration into Service Oriented Architecture (SOA)
![Page 34: European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW.](https://reader038.fdocuments.in/reader038/viewer/2022103021/56649c7d5503460f949326f5/html5/thumbnails/34.jpg)
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Conclusion (3) Conclusion (3) Research ChallengesResearch Challenges
• A general enough GCM, still efficientA general enough GCM, still efficient
• Effective composition: Effective composition:
Semantics, Deployment, Portability
• Non-Functional Aspects: Non-Functional Aspects:
Security, Load-Balancing, Fault-tolerance,CP. Specif (Lotos, UML TTools, pNets) and Model Checking Verification