Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel...

28
irtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit van Amsterdam National Institute for Nuclear and High Energy Physics Institute for Atomic and Molecular Physics
  • date post

    22-Dec-2015
  • Category

    Documents

  • view

    219
  • download

    2

Transcript of Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel...

Page 1: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

VLAM-G Project

VLAM-G developers team

Computer Architecture and Parallel Systems GroupDepartment of Computer Science

Universiteit van Amsterdam

National Institute for Nuclear and High Energy Physics

Institute for Atomic and Molecular Physics

Page 2: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

Outline

Introduction Objectives VLAM-G Principles VLAM-G Architecture VLAM-G & DASII VLAM-G Application Examples Conclusions

Page 3: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

VLAM-GVirtual Laboratory AMsterdam

A collaborative analysis environment

for applied experimental science

Grid and VLAM is about sharing resources:

physical equipment (remote experimentation)Data & Information repositories

Page 4: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

Virtual Lab.

Application Layer

Grid Layer

Page 5: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

Objectives & realization Methods

• Enable VLAM-G users to define, execute, and monitor their experiments• Provide to VLAM-G users:

location independent experimentation,familiar experimentation environmentassistance during their experimentsEasy way to bring/port new/existing applications to the Grid

•Developing application prototypes to check ideas and to learn

Page 6: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

• Application layer

Case studies

Provides VLAM-G modules

• Middle layer (Top)

Hides the details of the Grid

Offers an information management system

Objectives & realization Methods

Page 7: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

Page 8: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mVLAM-G Architecture

VLAM-G Client

collaboration

Assistant

VIMCO

Grid/Globus Services

PFT DBRTS DB

Resource A Resource B

M1

M2

Mn

RTS

Module Repository

SessionManager

Page 9: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mVLAM-G Run Time System on

DAS-2

DAS-2

NIKHEF

VU

RTSM

VL module 5

VL module 4

VL module 2

VL module 3

VL module 1VLAM-G GUI

RTSM

VL module 1

- VLAM-G Run Time System Manager

- VLAM-G experiment module

VLAM-G GUI - VLAM-G Graphical User Interface

Page 10: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

Node 0

Job management on DAS-2

Node N

Node 2

Node 3

Node 1...

SM

PBSover

Globus

Subcluster (e.g. at NIKHEF)

node

node

node

node

node

node

node

node

node

Other subclusters:

...

RTSM

VL module 1

VL module 5

GUI

PBSover

Globus

Subcluster (e.g. at NIKHEF)

Other subclusters:

VL module 2

VL module 4

VL module 3

VIMCO

App. DBRTS DB

Page 11: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mProcess Flow Template

(PFT)• Used as a blueprint for a specific type of

experiments

• PFT is designed offline by the experts in each scientific domain

• It is the main interface used by the VLAM-G users to perform a specific experimentation in the VLAM-G environment.

• It Guides the user while performing the experiment.

Page 12: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

The PFT (cont.)

PFT (GUI)

VIMCO RTS

Expressive MACS EFC

Application databasesResource A

Compose the experiment(GUI)

Define the context f the experiment(GUI)

Experiment Editor

Page 13: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mProcess Flow Template

Owner

Empty

Literature

Extraction

Conversion

Q. Ctrl

DC Analys.

Sample

Treatment

Treated sample

Surface Scan Raw Data

Data CubeInterpretation

Photograph

Settings

Apparatus

Data Cube

Cerf. Tool

Ana Tool

Page 14: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mStatus of the VLAM-G

Prototype The first Beta-release is almost ready This release will contain:

A tool to load modules in the VLAM-G database

A list of modules that can selected and used C/C++ API to write VLAM-G modules Support for the MACS and DNA array

experiments It should be conform to the Globus security It is going to be running on DAS-2

Page 15: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

The histogram demo

This demo. is about running jobs on different Grid enabled machines using the VLAM-G environment.

Two modules: Slider Visualization

Page 16: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m Histogram demo

Page 17: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

Floating ball experiment

This experiment is about controlling remote external devices using the VLAM-G environment.

Two modules: controller Visualization

Page 18: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mFloating ball experiment

Page 19: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

The MRI scan experiment

This experiment is about running jobs on different Grid enabled machines using the VLAM-G environment.

Four modules: MRI scanner Converter to NetCDF Visualization Modules: 2D and 3D

Page 20: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mRMI Scan experiment

Page 21: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mMACS (Material Analysis

of Complex Surfaces)

• Remote experimentation (-beam)

• Data storage

• Meta-data analysis (combine data from different sources)

Page 22: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mMACS lab Devices

--beam beam

FTMSFTMSTOF-SIMSTOF-SIMS

FTIR FTIR scoopscoop

Page 23: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

What is needed?

• High speed network

• Huge computing power

• Analytical Instruments / Data

• Micro-beam, FTIR, TOF-SIMS, …

• Capable database, generic data format

• Software (“The glue”) The Virtual Laboratory env. “ VLAM-G”

Page 24: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

VL databaseVL databaseSamplSamplee

Meta-data analysis

Page 25: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mExperiment Process Flow

Template

ObjectObject Photo_ImagPhoto_Imagee

LiteratureLiterature

OwnerOwner

SampleSample

Sample_ExtractionSample_Extraction

Treated_SampleTreated_Sample

Sample_TreatmentSample_Treatment

Material_AnalysisMaterial_AnalysisPhysics_DevicePhysics_Device

File_ConversionFile_ConversionConversion_ToolConversion_Tool

Data CubeData Cube Data CubeData CubeDC_AnalysisDC_Analysis

Analysis_ToolAnalysis_Tool

Results_ObservationsResults_Observations

Page 26: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mDemo3: MACSLab Exp

Page 27: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

mConclusions

VLAM-G: a science portal for exp. analysis Workflow support for

Bio-informatics, Materials Scienceand Biomedical Simulation & Visualisation

Seamless access to distributed resources

Resource Management: based on Globus Content Management: VLAM-G middleware Current status: preparing the beta-release of

the VLAM-G toolkit.

Page 28: Virtual Lab AMsterdam VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems Group Department of Computer Science Universiteit.

Virt

ual L

ab A

Mst

erda

m

Where to find about the VLAM-G projects

VLAM-G home page http://www.dutchgrid.nl/VLAM-G