GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project...

12
GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator [email protected] [email protected] Poznań Supercomputing and Networking Center

Transcript of GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project...

Page 1: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

GridLabA Grid Application Toolkit and Testbed

IST-2001-32133

Jarek Nabrzyski

GridLab Project Coordinator

[email protected]

[email protected]

Poznań Supercomputing and Networking Center

Page 2: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

GridLab

EU funded project, involving 11 European and 3 American partners,

January 2002 – December 2004

Main goal: to develop the Grid Application Toolkit (GAT) and set of grid services and tools...

resource management (GRMS), data management,monitoring, adaptive components, mobile user support, security services,portals,

... and test them on a real testbed with real applications

Page 3: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

GridLab Members

PSNC (Poznan) - coordination AEI (Potsdam) ZIB (Berlin) Univ. of Lecce Cardiff University Vrije Univ. (Amsterdam) SZTAKI (Budapest) Masaryk Univ. (Brno) NTUA (Athens)

Sun MicrosystemsCompaq (HP)

ANL (Chicago, I. Foster) ISI (LA, C.Kesselman) UoWisconsin (M. Livny)

collaborating with:Users!

EU Astrophysics Network,

DFN TiKSL/GriKSL

NSF ASC Project

other Grid projectsGlobus, Condor,

GrADS,

PROGRESS,

GriPhyn/iVDGL,

CrossGrid and all the other European Grid Projects (GRIDSTART)

other...

Page 4: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

What our users want...

Two primary applications: Cactus and Trianaother application communities are also being engaged,

Application oriented environment Resources (grid) on demandAdaptive applications – adaptive grid environment

job checkpoint, migration, spawn off a new job when needed,

Open, pervasive, not even restricted to a single Virtual OrganizationThe ability to work in a disconnected environment

start my job on a disconnected laptop; migrate it to grid when it becomes availablefrom laptops to fully deployed Virtual Organisations

Mobile workingSecurity

Page 5: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

What our users want... (cont.)

The infrastructure must provide capabilities to customise choice of service implementation (e.g. using efficiency, reliability, first succeeding, all)Advance reservation of resources,To be able to express their preferences regarding their jobs on one hand and to understand the resource policies on the other hand,Policy information and negotiation mechanisms

what is a policy of usage of the remote resources?

Prediction-based information How long will my job run on a particular resource?What resources do I need to complete the job before deadline?

Page 6: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

The Grid is complex …

Monitoring

Resource Management

InformationSecurity

DataManagement

GLOBUS

ApplicationManager

Logging

NotificationMigration

Profiling

SOAP WSDL Corba OGSA Other

Other GridInfrastructure

Application

“Is there a better resource I could be using?”

Page 7: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

…need to make it easier to use

GAT

Application

“Is there a better resource I could be using?”

GAT_FindResource( )

The Grid (services and other infrastructure)

Page 8: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

The Same Application …

Application

GAT

Application

GAT

Application

GAT

Laptop The GridSuper Computer

No network! Firewall issues!

Page 9: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

GAT: What is It?

GAT: Grid Application ToolkitImplements the GAT-API

Used by applications (different languages)

GAT Adaptors Connect to capabilities/services

GAT EngineProvides the function bindings for the GAT-API

Page 10: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

GAT

More or less …Set of calls GAT_ToolOrService(arguments)

Your chosen tools/services: resource brokers, information servers, application managers, grid monitoring, data managers, notification, etc.

Set of APIs for dealing with the GAT (registration, information, errors, fault tolerance)

Page 11: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

GridLab Architecture

Page 12: GridLab A Grid Application Toolkit and Testbed IST-2001-32133 Jarek Nabrzyski GridLab Project Coordinator naber@man.poznan.pl office@gridlab.org Poznań.

Grids Info Day, 25 March 2003, Brussels

More info / summary

[email protected], [email protected]@gridlab.orgYou’re welcome to join our testbed and test our software, Bring your application and test it with the GAT and our services.We are open for collaborations!

Next GridLab conference and workshop 31 March – 9 April, Eger (Hungary)

http://www.congressteam2000.hu/gridlab/