1www.portal.p-grade.hu

Other features and next stepsOther features and next steps

Gergely Sipos Gergely Sipos sipos@sztaki.husipos@sztaki.hu

MTA SZTAKIMTA SZTAKIHungarian Academy of SciencesHungarian Academy of Sciences

2

• Develop an application specific portlet:–To hide application logic from end users:

Separate grid experts from grid users

Complete P-GRADE Complete P-GRADE development cycledevelopment cycle

• Develop your jobs locally• Compile your jobs for the grid

– Compiler portlet• Compose workflows from your jobs and execute it

– Workflow editor, workflow manager, Information system portlets

• Scale up the workflow to a parameter study– Define input files (or add Input file generator)– Add output file collector

3

P-GRADE and user rolesP-GRADE and user rolesPortal Administrator:

• installs P-GRADE Portal 2.7

Grid Application Developer• develops a grid application with P-GRADE Portal 2.7• sends the application to the grid portal developer

End Users• executes the published application with custom input parameters by creating application instances using the published application as a template

Grid Portal Developer•Creates new classes from the Application Specific Module for P-GRADE by changing the names of the classes•develops a Gridsphere portlet that fits to the application I/O pattern and the end users’ needs• connects the GUI to P-GRADE Portal using the programming API of P-GRADE Application Specific Module• using the Application Specific Module he publishes the grid application and its GUI for end users

4

P-GRADE PORTAL 2.7 server

Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)

DetailedDetailed Scenario Scenario

Publisher Partof Applicationspecificmodule

Portlet to publish applications

Registry of published applications

EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)

Portal Administrator installs the P-GRADE portal 2.7.

Then adjusts the portlet to publish applications

5

P-GRADE PORTAL 2.7 server

Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)

DetailedDetailed Scenario Scenario

Publisher Partof Applicationspecificmodule

Portlet to publish applications

Registry of published applications

Grid Application

EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)

Grid Application Developer creates own Grid Application.

6

P-GRADE PORTAL 2.7 server

Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)

DetailedDetailed Scenario Scenario

Publisher Part of Applicationspecificmodule

Portlet to publish applications

Registry of published applications

Application specific portlet

Grid Application

EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)

Grid Portal Developer develops a Application specific portlet using Java Server Pages and Gridsphere Tag Library Updates the the application specific package: connects Grid application to new portlet

7

P-GRADE PORTAL 2.7 server

Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)

DetailedDetailed Scenario Scenario

Publisher Part of Applicationspecificmodule

Portlet to publish applications

Registry of published applications

Application specific portlet

Grid ApplicationGrid Application

(Template)

EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)

Grid Portal Developer develops a Application specific portlet using Java Server Pages and Gridsphere Tag Library Updates the the application specific package: connects Grid application to new portlet

8

P-GRADE PORTAL 2.7 server

Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)

DetailedDetailed Scenario Scenario

Publisher Part of Applicationspecificmodule

Portlet to publish applications

Registry of published applications

Application specific portlet

Grid ApplicationGrid Application

(Template)Grid Application

EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)

Grid Application

End users can create projects from a Published Grid Application Template.Then they can adjust parameters, and run in Grid via Application specific portlet!

9

IInterface nterface toto publish publish a a P-GRADE ApplicationP-GRADE Application

Grid Application Developer can publish the application by a pre-developed portlet

Button to revoke an already published application

Button to publish the application

Select an application

10

Matrix multiplication on EGEEMatrix multiplication on EGEEend users’ point of viewend users’ point of view

Do you see the grid somewhere?

11

Manage your computationsManage your computationsButton to load a multiplication

project

Button to delete a multiplication project

Button to create new multiplication project

12

Define a new multiplication Define a new multiplication tasktask

Name of the current project

Matrix A (you can define values for Y)Matrix B is

fixed

13

Define values for YDefine values for Y

Parameters can be adjusted as Set, Range and Random.

14

Monitor progressMonitor progress

Click to start computation

Click to get status of computation

Status bar of computation

15

Get resultGet result

Click to Download Results

16

Part IISupport of legacy codes, code

reusability and grid interoperability

17

GEMLCA P-GRADE Portal 2.4.1GEMLCA P-GRADE Portal 2.4.1

• P-GRADE Portal extended with GEMLCA Grid service back-end– To share jobs and legacy codes as application components with others– A step towards collaborative e-Science

• Developed by the University of Westminster (London)• Support for Globus 4 grids (besides GT2 and EGEE)• Available on the UK NGS and OGF GIN Portals• http://www.cpc.wmin.ac.uk/ngsportal/index.php

P-GRADE Portal

GEMLCAGlobus 4 VOs

Globus 2 VOs

LCG / gLite VOs

jobjobjobjob

Legacy code

Legacy codeLegacy code

Legacy codeLegacy code

Legacy code

18

Combine legacy codeswith new codesinside the same workflow!

Code Code invocationinvocation

Code Code invocationinvocation

Job Job submissionsubmission

Job Job submissionsubmission

Combining legacy and Combining legacy and non-legacy (job) componentsnon-legacy (job) components

Publish successfully executed new code as legacy code

19

NGS P-GRADE PortalNGS P-GRADE Portal

• NGS P-GRADE portal is a production service of the UK NGS

• It has several advanced extensions to the original P-GRADE portal:– Integration with the GEMLCA legacy code service– Integration with SRB– Integration with OGSA-DAI

• The next part of the lecture shows these features of the NGS P-GRADE portal

44

Running at OSG

Running at EGEE

Running at NGS

From NGS SRB (both)

From NGS SRB

From NGS GFTP

From local

(both)

From NGS SRB To EGEE

SRM

Running at NGS

Running at NGS

From NGS

GFTP

To NGS SRB

Workflow level Interoperation of local, SRB, Workflow level Interoperation of local, SRB, SRM and GridFTP file systems SRM and GridFTP file systems

• Dynamic port-level integration of Grid data resources:

•Different port types, including local, remote and SRB ports, can be freely mixed as input or output of workflow components. •This solution allows the seamless interoperation of SRB catalogues, GridFTP file systems and EGEE storage elements

45

So here we are!So here we are!GridFTP, SRM, GridFTP, SRM, SRB and OGSA-DAI workflow SRB and OGSA-DAI workflow

level integrationlevel integration

Portalserver

Grid infrastructure

Computing resources

GridFTP servers

REMOTE INPUTFILES

REMOTE OUTPUT

FILES

LOCAL INPUT FILES

LOCAL OUTPUT

FILES

LOCAL INPUT FILES

LOCAL OUTPUT FILES

User levelstorage

EGEE Storage

elements

Control of remote input/output

Workflow level Interoperation of local,

GridFTP, SRM and SRB file catalogues

and databases exposed by OGSA-DAI

SRB servers

OGSA-DAI

services

Data manipulation

Input to workflows

Output from workflows

48

Next stepsNext steps

How to get involved

49

Portal installationsPortal installations

• P-GRADE Portal services:– SEE-GRID infrastructure– Central European VO of EGEE– GILDA: Training VO of EGEE– Many national Grids (UK National Grid

Service, HunGrid, Turkish Grid, etc.)– US Open Science Grid, TeraGrid– OGF Grid Interoperability Now (GIN) VO– …Portal services and account request:http://portal.p-grade.hu/index.php?m=3&s=0 Account request form on portal login page

50

Installing P-GRADE PortalInstalling P-GRADE Portal

– (If you are the administrator of a Grid/VO then) get the installation package from SourceForge

• http://sourceforge.net/projects/pgportal• Server requirements

http://portal.p-grade.hu/index.php?m=13&s=0 • Local user support must be provided by you

– If you are member of an EGEE / Globus VO that does not have P-GRADE Portal yet, then

• Ask SZTAKI to add your VO to the Multi-grid P-GRADE Portal Installation

• Ask the manager of your VO to install P-GRADE Portal

52

Support servicesSupport services

http://portal.p-grade.hu• Training:

– Training events, trainer community: email list: pgrade-training@lpds.sztaki.hu

– Portal to access GILDA resources– Online tutorials

• User forum • Installation and operational support team• Application Development and Porting Support:

www.lpds.sztaki.hu/gasuc

53

Thank you!Thank you!

www.portal.p-grade.hupgportal@lpds.sztaki.hu

Learn once, use everywhereDevelop once, execute anywhere