1

www.d4science.eu

Tutorial Outline

Creating a VRE

Pedro AndradeCERN European Organization for Nuclear Research

RCDL 2008

10 October 2007Dubna (Russia)

www.d4science.eu

3

www.d4science.eu

Session Outline

Introduction

Technology gCube, gCore, gHN, gLite

Setting Up VREs Interfaces & Roles Infrastructure, VO, and VRE set-up Effort & How to Start

Conclusions

Creating a VRE10 October 2008, Dubna (Russia)

4

www.d4science.eu

Introduction

Creating a VRE10 October 2008, Dubna (Russia)

5

www.d4science.eu

Introduction

Creating a VRE10 October 2008, Dubna (Russia)

6

www.d4science.eu

Introduction

One VRE is a time-defined distributed environment to satisfy concrete collaboration needs of distributed user communities

VRE users are organized in Virtual Organizations

VRE resources are organized in Infrastructures

Creating a VRE10 October 2008, Dubna (Russia)

7

www.d4science.eu

Infrastructure

Creating a VRE10 October 2008, Dubna (Russia)

A D4Science infrastructure is composed by:

8

www.d4science.eu

Infrastructure

Creating a VRE10 October 2008, Dubna (Russia)

Site A

Site B

Site C

9

www.d4science.eu

Infrastructure

Creating a VRE10 October 2008, Dubna (Russia)

Infrastructure

VRE

VO

10

www.d4science.eu

Technology

Creating a VRE10 October 2008, Dubna (Russia)

11

www.d4science.eu

gCube

gCube is the system developed by D4Science to create and maintain Virtual Research Environments.

gCube is composed by: Infrastructure Enabling Services Information Retrieval Services Information Organization Services Presentation Services

gCube components can be: Services, Libraries, and Portlets

Creating a VRE10 October 2008, Dubna (Russia)

12

www.d4science.eu

gCore

gCore is a framework developed by D4Science to reduce the complexity of designing and implementing gCube services.

gCore is composed by: Framework: An application framework to consolidate and

develop existing/new gCube services Container: A self-contained software container distributed

to facilitate the deployment of gCube services. Based on Java WS-Core (GT4).

Creating a VRE10 October 2008, Dubna (Russia)

13

www.d4science.eu

gHN

The minimum environment for any gCube node of the infrastructure is the gCube Hosting Node (gHN)

The gHN is composed by: gCore Container gCore Framework gCube Infrastructure Enabling Services (partial)

Creating a VRE10 October 2008, Dubna (Russia)

14

www.d4science.eu

gHN

The gCube Hosting Node main functionality is:

Is the runtime container of gCube services Provides access to local hardware resources,

Storage systems, instruments, CPU cycles Grants lifetime management Mediates service2service interactions

route requests to target service enforce security and scope policies

Creating a VRE10 October 2008, Dubna (Russia)

15

www.d4science.eu

gLite

Computational intensive tasks are executed in EGEE nodes running the gLite middleware.

EGEE is one the largest grid infrastructure worldwide. It is composed by more than 260 sites (85k CPUs)

Several gCube services were designed to interface with the gLite middleware. These interfaces give access to the EGEE infrastructure and consequently increase significantly the computing capabilities of any gCube-based infrastructure.

Creating a VRE10 October 2008, Dubna (Russia)

16

www.d4science.eu

Example

Creating a VRE10 October 2008, Dubna (Russia)

Infrastructure

gHN

gHN

gLite

gLitegHN

17

www.d4science.eu

Setting Up VREs

Creating a VRE10 October 2008, Dubna (Russia)

18

www.d4science.eu

Overview

Creating a VRE10 October 2008, Dubna (Russia)

19

www.d4science.eu

Interfaces

From the “system administrator” perspective the creation of one gCube-based infrastructure, VO, VRE is done exploiting two main types of interfaces

Command Line Interface (CLI) Used for the installation of gHNs

Portal gCube portal is based on portlets technology (JSR168) gCube portal runs on GridSphere Used for the creation and management of VOs and VREs

Creating a VRE10 October 2008, Dubna (Russia)

20

www.d4science.eu

Roles

VO Admin

Resource Owner

VRE Designer

Infrastructure Admin

VREAdmin

Creating a VRE10 October 2008, Dubna (Russia)

21

www.d4science.eu

Infrastructure Set-up

Install gHN nodes Deploy Enabling Services

Information System Software Repository

Populate the SR Install Portal

Creating a VRE10 October 2008, Dubna (Russia)

Portal gHNIS/SR gHN

Infrastructure Admin

22

www.d4science.eu

VO Set-up

Creating a VRE10 October 2008, Dubna (Russia)

gHN

gHNgHN

DataA

DataBgLite Install gHN nodes

Install gLite nodes Prepare Collections Prepare Applications

Register Resources

ResourceOwner

gHN

Portal IS/SR

MGVI

23

www.d4science.eu

VO Set-up

Creating a VRE10 October 2008, Dubna (Russia)

gHN

gHNgHN

DataBgLite Approves resources

gHNs Data Collections

Manages users

VOAdmin

DataA

gHN

Portal IS/SR

MGVI

24

www.d4science.eu

VRE Set-up

Creating a VRE10 October 2008, Dubna (Russia)

gHN

gHNgHN

DataA

DataBgLite Defines a new VRE

Name Time Period Functionalities Data Collections Metadata Schema

VREDesigner

gHN

Portal IS/SR

MGVI

25

www.d4science.eu

Approves VRE VRE Created Services Deployed

Applies modifications New Running Instances New Layouts

VRE Set-up

Creating a VRE10 October 2008, Dubna (Russia)

MGVI

gHN

gHN

gHNgHN

DataBgLite

Search

VREAdmin

DataA

Portal IS/SR

26

www.d4science.eu

Effort

SCOPE ACTION TOOL TIME

Infrastructuredeploy enabling services CLI < 1 day

install portal CLI < 1 day

VO

install 1 gHN CLI < 10 min

register resources (gHN, data) Portal < 1 min

approve resource (gHN, data) Portal < 1 min

data import (metadata, indexes) Portal hours

manage users Portal < 10 min

VRE

define VRE Portal < 10 min

approve VRE Portal < 1 min

deploy VRE Portal < 2 hour

modify VRE Portal < 1 hour

Creating a VRE10 October 2008, Dubna (Russia)

27

www.d4science.eu

How to Start

How can a new user community have it’s own VO/VREs ?

1. By creating a new infrastructure Different communities can run their own infrastructure The new community provides all resources

2. By joining an existing infrastructure D4Science runs a production infrastructure for its two user

communities (Earth Monitoring and Fisheries Management) The new community provides part of the resources

Creating a VRE10 October 2008, Dubna (Russia)

28

www.d4science.eu

How to Start

Infrastructure VO VREInfrastructure

AdminResource

Owner VO Admin VRE Designer

VRE Admin

New Infrastructure yes yes yes yes yes

Existing Infrastructure no depends yes yes yes

Creating a VRE10 October 2008, Dubna (Russia)

29

www.d4science.eu

How to Start

gCube software is available from http://software.d4science.research-infrastructures.eu/

gCube administrator guide: https://technical.wiki.d4science.research-infrastructures.eu/

documentation/index.php/Administrator%27s_Guide

gCube user guide: https://technical.wiki.d4science.research-infrastructures.eu/

documentation/index.php/User%27s_Guide

Creating a VRE10 October 2008, Dubna (Russia)

30

www.d4science.eu

Conclusions

A VRE brings together different types of resources through a well defined cost-effective process

The creation of a VRE is a simple and easy: A new VO can join one infrastructure in less then 1 day A new VRE can be deployed in less then 2 hours Many automatic deployment & configuration operations

managed via the gCube Portal

Creating a VRE10 October 2008, Dubna (Russia)

31

www.d4science.euCreating a VRE10 October 2008, Dubna (Russia)