Workflow on the GRIDs surface

©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture

20081009 1

Workflow on the GRIDs surface

• GRIDs ‘surface’ provides – Computational capabilities of GRID– Information presentation capabilities

of WWW– Information management capabilities

• But not yet environment for workflow


20081009 2

The GRIDs Architecture

Knowledge Layer

Information Layer

Computation / Data LayerDat

a to

Kno

wle

dge

Control


20081009 3

The GRIDs Architecture

Dat

a to

Kno

wle

dge

Control

Par

ticl

e P

hysi

cs A

ppli

cati

on

Gen

omic

s A

ppli

cati

on

Env

iron

men

tal A

ppli

cati

on

E-B

usin

ess

App

lica

tion


20081009 4

A POSSIBLE ARCHITECTURE

U:USER

S:SOURCE R:RESOURCE

Rm:ResourceMetadata

Ra:ResourceAgent

Ua:User Agent

Um:User Metadata

Sm:SourceMetadata

Sa:Source Agent brokers

The GRIDs Environment


20081009 5

A Brief History of GRIDs

• 1G: custom-made architecture machines to user– Pioneering metacomputing

• 2G: proprietary standards and interfaces– I-WAY GLOBUS, UNICORE, CONDOR, LEGION

AVAKI

• 2.5G: added in FTP, SRB, LDAP, AccessGRID• 3G: adopted W3C concepts for open interfaces –

OGSA / OGSI: note especially OGSA/DAI– But built on 2.G foundations

e-ScienceApps

e-ScienceR&D


20081009 6

But…..

• This comes nowhere near the requirements as originally defined for GRIDs

• Too low-level (programmer not end-user level)– Insufficient representativity– Insufficient expressivity– Insufficient resilience– Insufficient dynamic flexibility


20081009 7

Services: Challenges 1

DescriptionLocationRequirements

matchingComposingUtilising

metadata

Functional Program

Code(to deliver the service)

Service description(descriptive metadata)

InputParameterdefinitions

OutputParameterdefinitions

Restrictions on use of service(restrictive metadata)


20081009 8

Services: Challenges 2

Composition End-to-end FR

satisfaction End-to-end NFRs

satisfaction Avoiding emergent

properties Conditions of use of

services Processes wrapped with data wrapped with

processing, storage etc wrapped with real

estate wrapped with staff

MultipleInstancesParallelexecution


20081009 9

e-,i-,k-infrastructure

serverserver server server

detectors

e-

i-

k- Deduction & induction – human or machine

Physical

Information

Systems

server


20081009

10

Middleware – and as SOKUs

e-

i-

k-

Lower middleware(hides physical heterogeneity)

Upper middleware(hides syntactic heterogeneity)

K- upper middleware(resolves semantic heterogeneity)

K- lower middleware(presents declared semantics)


20081009

11

Workflow on the GRIDs Surface

• Nirvana is– GRIDs ‘surface’

• Providing computation, information presentation and information management

– Plus Self* resilience– Plus capabilities to support workflow


20081009

12

Overall : The Way Forward

SCIENTIFIC DATASETS

Data

Information

Knowledge

PUBLICATIONS

Data

Information

Knowledge

CRIS

Management of Research


20081009

13

PUBLICATIONS

Data

Information

Knowledge


Digital Curation Facility

SCIENTIFIC DATASETS

Data

Information

Knowledge

CRIS

Management of ResearchCDR

(CERIF)

Portal with knowledge-assisted user interface


20081009

14



SCIENTIFIC DATASETS

Data

Information

Knowledge

PUBLICATIONS

Data

Information

Knowledge metadata



20081009

15



SCIENTIFIC DATASETS

Data

Information

Knowledge

PUBLICATIONS

Data

Information

Knowledge metadata

publish

validate



20081009

16



SCIENTIFIC DATASETS

Data

Information

Knowledge

PUBLICATIONS

Data

Information

Knowledge metadata

publish

validate

GRIDs


Ambient, Pervasive Access


20081009

17




SCIENTIFIC DATASETS

Data

Information

Knowledge

PUBLICATIONS

Data

Information

Knowledge metadata

publish

validate

GRIDs



20081009

18




SCIENTIFIC DATASETS

Data

Information

Knowledge

PUBLICATIONS

Data

Information

Knowledge metadata

publish

validate

GRIDs



20081009

19




SCIENTIFIC DATASETS

Data

Information

Knowledge

PUBLICATIONS

Data

Information

Knowledge metadata

publish

validate

GRIDs



20081009

20

Three Steps to Nirvana

Complete Process ICT Support

Metadata and Data Exchange Standards

Workflow on the GRIDs Surface

The Perfect CRIS

Workflow on the GRIDs surface

Documents

Transcript of Workflow on the GRIDs surface