Uk Research Infrastructure Workshop E-infrastructure Juan Bicarregui

How to build a successful EU project some personal reflections of

a project coordinator

Juan Bicarregui Scientific Computing Department

STFC

UKRO Conference 21 September 2015 1

Overview

1.  Build on just one good idea

2. Find the right partners

3. Have clear responsibilities

4. Build in sustainability of output

5. Set the right budget

6. Actively monitor progress

Build on one good idea

•  Make a clear message

–  It must be simple

•  Don’t allow sidelines

– Not a free research agenda

•  Aim for 15/15

– Need ≥4.5/5 in all three areas

•  Don’t compromise

– Good proposals can fail on a fixable weakness 3

What is STFC?

250m

ESRF & ILL, Grenoble Daresbury Laboratory

Square Kilometre ArrayLarge Hadron Collider

Programmes include: • ParBcle Physics • Astronomy • Nuclear Physics

NaBonal Laboratories include: • Neutron and Muon Source • Synchrotron RadiaBon Source • High Power Lasers • ScienBfic CompuBng/Hartree Centre • Space Science • Electronics, Cryogenics

InternaBonal include:

•  CERN •  ESO •  SKA •  ESS •  ESRF •  ILL

What happens at the Facilities?

FiOng experimental data to model

Bioactive glass for bone growth

Structure of cholesterol in crude oil

Hydrogen storage for zero emission vehicles

Magnetic moments in electronic storage

•  Over 30,000 user visitors each year: –  physics, chemistry, biology,

medicine,

–  energy, environmental, materials, culture

–  pharmaceuticals, petrochemicals, microelectronics

Longitudinal strain in aircraft wing

DiffracBon paSern from sample

Visit facility on research campus

Place sample in beam

•  Over 5.000 high impact publications per year –  But so far no integrated data

repositories

–  Lacking sustainability & traceability

PaNdata

Neutron diffraction X-ray diffraction} NMR

High-qualitystructure refinement

}

Photon and Neutron Data Infrastructure

PaN-Data Infrastructure for Photon and Neutron Sources

PaNdata Data Sharing Vision Single Infrastructure à Single User Experience

Capacity Storage

PublicaBons Repositories

Data Repositories

SoVware Repositories

Raw Data Data Analysis

Analysed Data

PublicaBon Data

PublicaBons

Facility1


Analysed Data

PublicaBon Data

PublicaBons

Facility 2


Analysed Data

PublicaBon Data

PublicaBons

Facility 3

Different Infrastructures à Different User Experiences Raw Data Catalogue

Data Analysis

Analysed Data Catalogue

PublicaBon Data Catalogue

PublicaBons Catalogue

Overview







8

Find the right partners

•  PaNdata was not typical: –  11 similar facilities

–  All Infrastructure providers

9

•  More typically have variety of roles:

–  Users, Technologists, Providers –  Large and small enterprises

•  Need to deliver the Project •  Need to make an Impact

Overview







10

2.1 D ata Pol ic y

2.2S oftw are Pol ic y

2. 3U s erP olicy

2.4I ntegrat ed Po lic y

4.1U s er

Propo sal

4.2U se r

W orks hop

4.3U ser

Rev is ion

5.1D ata

Propo sa l

5.2D ata

W orks hop

5.3D ata

Rev is ion

6 .1S oftw areRev iew

6. 2So ftw are Wo rk sh op

6.3Soft wa rePropo sal

6.4Softw are Revisio n

7.1Inte gration R eport

7 .2Integ ra tio n P ro pos al

7.3In tegration Revisio n

3.4

Final

Workshop

P ro je ct M anagem ent, K nowledge Exchan ge and D issem ina tion Ac tiv ities

Dep ende ncies betw e en the m ajor project tas ks

Dependencies

ERA Open Access Sharing Initiatives (examples, etc)

ERA Infrastructure Platform Initiatives (EGI, etc)

PaNdata Support Action

Policies and Standards

PaNdata ODI JRAs

Users

Data

Software

Integration Provenance Preservation

Scalability

PaNdata ODI

Services

Users

Data PaNdata

ODI

Virtual Labs

Policies Powder Diff

SAXS & SANS

Tomography

Overview







13

Build in Sustainability

•  Sustainability is a starting point

–  Have users in the consortium

–  Have providers in the consortium

•  Build sustainability during project

–  Deploy the output during the project

–  Set up ongoing governance during the project

14

Metadata Catalogue

Proposal

Approval

Scheduling Experiment

Data cleansing

Record Publication

Scientist submits

application for beamtime

Facility committee approves

application

Facility registers, trains, and schedules

scientist’s visit

Scientists visits, facility run’s experiment

Subsequent publication

registered with facility

Raw data filtered and cleansed

Data analysis

Tools for processing made

available

ICATproject.org

16

�  Open Source project

–  5 partners active

�  OSS in itself

is not sustainability

�  Need real commitment from organisations

�  Need a project structure

Overview







17

Set the Right Budget

•  All partners are equal

–  But some are more equal than others

•  Beware of small fractions of people

–  Review by other partners

•  Don’t underestimate travel costs –  Balance face to face and teleconferencing

•  Be clear about any subcontracting

•  Watch out for exchange rate fluctuations

18

Staff Effort Table

•  Each WP has a lead partner (red) •  Most WPs have 1 or 2 supporBng partners (blue) •  6 Partners have WP leading roles •  All Partners have something in Service Deployments WPs •  Just 3 Partners have development roles in each Research AcBvity

Overview







20

Actively Monitor Progress

•  Monitor delivery

–  Deliverables

–  Dependencies

–  Milestones

–  Spend by partner

–  Spend by workpackage

•  Be willing to change the plan

21

22

Workpackage (abbreviated title) Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct NovMilestones M1 M2 W1 M3 M4 W2

WP1 Management D D D D WP1 Management

WP2 Common data policy framework D D D D WP2 Common data policy framework

WP3 Knowledge exchange/dissemination D D D D WP3 Knowledge exchange/dissemination

WP4 Common user information exchange D D D WP4 Common user information exchange

WP5 Scientific data D D D WP5 Scientific data

WP6 Data analysis software infrastructure D D D D WP6 Data analysis software infrastructure

WP7 Integration and cross-linking D D D WP7 Integration and cross-linking

KeyD - Deliverable

M -‐ MilestoneW -‐ Workshop

Workpackage (abbreviated title)Workshops

Data PolicyDevelopm

ent and deliveryof the com

mon data policy

User and Data Standards

Delivery of draft standards for data and user inform

ation

Baseline for integrationDelivery of policy on user inform

ation, first report onpublications and integration

Integration proposalDelivery of policy and

first proposal on integration and on analysis softw

are

Final Workshop

Final reports on standards

M1

M2

M3

M4

Monitor Technical Delivery

PaNdata ODI Joint Research Activities

PaNdata ODI Service Activities

PaNdata ODI Service Releases Standards

from PaNdata Support Action

uCat

dCat

vLabs

Prov

Pres

Scale

Rel 1 Rel 2 Rel 3 Rel 4

users

data

s/w

Integ

Jun 2014Jun 2013 Dec 2013Dec 2012

Monitor Technical Delivery

Eg. Service Verifications 6

24

•  4 software releases were replaced by 9 service verifications

Be willing to change plan

Monitor Financial Usage

25

Budget use by WP Budget use by Partner

•  Partners need to control their own spend•  WP leaders need to deliver to plan•  Reallocating of budget across WPs is easy•  Reallocation of budget across Partners is harder

Overview







26

How to build a successful EU project some personal experiences of

a project coordinator

Juan Bicarregui Scientific Computing Department

STFC

UKRO Conference 21 September 2015 27

Uk Research Infrastructure Workshop E-infrastructure Juan Bicarregui

Government & Nonprofit

Transcript of Uk Research Infrastructure Workshop E-infrastructure Juan Bicarregui