A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen...

A PPARC funded project

Astro-Wise meeting

06-07 April 2004OmegaCEN,Kapteyn Institute,Groningen

Tony LindeAstroGrid Project Manager

University of Leicester

06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 2

AstroGrid OverviewApproachArchitectureUsageItn05/06Astro-Wise & VObsFollow-up


Overview of AstroGrid/-2Duration: Sept 2001 – Dec 2007Funding: £7.7M (PPARC)Personnel: ~26 (23.4 FTE)Goal: Develop VObs Infrastructure

Deploy UK VObsScope: Astrophysics, Solar, STP, …

Optical, X-Ray, Radio, …Phase A: Sept 2001 – Dec 2002

Analysis, R&D, ArchitecturePhase B: Jan 2003 – Dec 2004

Build, test & deliverAstroGrid-2: Jan 2005 – Dec 2007Structure tbd


AstroGrid consortiumEdinburghLeicesterCambridgeMSSLJBORALQUB

AstroGrid-2 + Bristol Exeter Leeds Portsmouth


Lead PersonnelProject Lead Andy Lawrence (Edinburgh)

[email protected]

Project Scientist Nic Walton (Cambridge)

[email protected]

Project Manager Tony Linde (Leicester)

[email protected]

Technical Lead Keith Noddle (Leicester)

[email protected]


Links

FP5 AVO, FP6 Euro-VO (UK rep)US-NVOIVOA Standards workgroups

GGF, Globus, OGSA-DAIOther e-Science projects in UK GridPP, myGrid, EGSO, …


Project ApproachAgile: iterative & incremental development

Open project: Wiki

http://wiki.astrogrid.org/bin/view/Astrogrid/WebHome

Forum http://forum.astrogrid.org/index.php

News http://news.astrogrid.org/index.php

Jabber via jabber.astrogrid.org

Open Source code http://www.astrogrid.org/maven/build/index.html


Development ApproachIterative full cycle each iteration 3 month(-ish) iterations

Incremental add functionality each iteration refactor wherever necessary

Use-case driven from ‘key 10’ science cases http://wiki.astrogrid.org/bin/view/Astrogrid/ScienceProblems

Architecture led http://wiki.astrogrid.org/bin/view/Agdoc/ArchVision http://wiki.astrogrid.org/bin/view/Agdoc/ArchOverview http://wiki.astrogrid.org/bin/view/AG2/ArchitectureNotes


Technology choices

design : UML, TogetherSoft ControlCenterdevelopment language : Java

Web services

source control : CVSIDE/build/integrate : Eclipse/Ant/MavenJava libraries: ApachePortal : Apache Cocoon


VObs StructureComponent-based can install any/all components

Decentralised no single product nor centre

Service-based web services


ComponentsPortalRegistrySecurityCommunityWorkflowData AccessMySpaceApplications


AstroGrid-2Aspects Extension

Infrastructure Grid (GT4+) integration Intelligent resource discovery (semantic grid)

Additional components Data exploration Agents: eStar integration Client-based access: VO Workbench

Technical Scope http://wiki.astrogrid.org/bin/view/AG2/TechnicalScope


AstroGrid-2 Layer Diagram


AstroGrid usePortal WorkflowWorkflow is key to AstroGrid


WorkflowSequence Sequential steps

Flow Steps executed in parallel

Step Application/Tool, Data query Configured via XForm specification

To be enhanced later or Query form

Workflow definition Subset of BPEL


Create Workflow


Add tools to steps


Configure step: data query


Configure step: tool


Submit workflow, Check status


Data query step

Insert valid ADQL (v0.7.?)Assisted query builder this iteration


MySpace: virtual storage

Operations: Copy, Delete, Move Upload from file, URL

End-point Multiple servers per manager Usually hidden from user


eg Copy file, Upload file


Registry: Query


Registry detailsConforms to IVOA stdExtended: ApplicationDefinitio

n

AstroGrid CEA


Registry harvest

Admin function, so usually invisible


Itn05: Complex workflow: AVO Demo

Canned imagesACE

AstroGrid wrapping of SExtractor

VOTMerge AstroGrid VOTable

‘federation’

HyperZ AstroGrid wrapping

of HyperZ

CEA


Itn06: Jan 2005 AVO DemoBuild on the Itn05 tool

Image access (SIAP) Add in extra redshift

applications Bpz ANNz

Access wider data resources

WFS GOODS plus IR

Deploy on 'real' machines

Disk Compute


Itn06: Solar science case: CMEs


Astro-Wise & VObsKey points Make data available Publish metadata

Rapid dissemination (push harvesting) Versioning / describing / retiring of products

Other Pipeline services available

Custom UIs Re-process data

User-derived products Agent interfaces


Astro-Wise linksData model IVOA DM group (Jonathan McDowell) AstroGrid Interop group (Anita Richards)

Beta testing AstroGrid software AstroGrid deployment AVO demos


Follow-upBeta testing

Contact Nic Walton

Component Deployment Data Centre MySpace Local Registry Community

Contact Nic Walton

Software cooperation MySpace Workflow Data Centre Registry metadata updating

Contact Tony Linde, Keith Noddle

A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen...

Documents

Transcript of A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen...