David Abramson & Hoang Anh Nguyen Monash University.

27
David Abramson & Hoang Anh Nguyen Monash University

Transcript of David Abramson & Hoang Anh Nguyen Monash University.

Page 1: David Abramson & Hoang Anh Nguyen Monash University.

David Abramson &Hoang Anh Nguyen

Monash University

Page 2: David Abramson & Hoang Anh Nguyen Monash University.

Background◦ Scientific Workflow◦ Tiled Display Wall◦ Why do we need a SWF-TDW link ?

Design and Implementation Case Study Conclusions & Future works

Page 3: David Abramson & Hoang Anh Nguyen Monash University.

In-silico science (e-Science)◦ Complex process◦ Multiple steps in different computing environment

Scientific workflows◦ Help automate, manage and execute steps◦ Provide a high level, robust, repeatable research

environment.

Page 4: David Abramson & Hoang Anh Nguyen Monash University.

SWF technology◦ Application of workflow technology to solve

scientific problems [1]◦ Different from Business Workflow

SWF Management System (SWFMS)◦ Specification, modification, run, re-run, and

monitoring of workflows Number of SWFMSs: Kepler, Taverna,

Triana, Vistrails, etc. Kepler was chosen to implement our

prototype

Page 5: David Abramson & Hoang Anh Nguyen Monash University.

Built on top of Ptolemy II◦ Actor-oriented modelling◦ Vergil user-interface

Actor-oriented◦ Actors with input/output ports◦ Director

Powerful SWFMS◦ Web and grid-services support ◦ Provenance information

Page 6: David Abramson & Hoang Anh Nguyen Monash University.

Figure 1: Sample Workflow in Kepler (source: [2])

Page 7: David Abramson & Hoang Anh Nguyen Monash University.

What is a TDW ?◦ Visualization cluster◦ Multiple displays controlled by a powerful

computer/cluster◦ Acts like one or many virtual displays

TDW could be◦ Projectors◦ LCDs

Page 8: David Abramson & Hoang Anh Nguyen Monash University.

Figure 2: Scalable Display Wall view from the back (Source [3])

Page 9: David Abramson & Hoang Anh Nguyen Monash University.

Figure 3: An Optiportal at Monash Clayton ( Source [4] )

Page 10: David Abramson & Hoang Anh Nguyen Monash University.

Built on top of Rocks Using SAGE, CGLX, COVISE as rendering

middleware SAGE: Scalable Adaptive Graphics

Environment◦ Open source◦ Distributed architecture: decouple graphic

rendering and graphic display

Page 11: David Abramson & Hoang Anh Nguyen Monash University.

Figure 4: SAGE architecture

SAIL: Sage Application Interface Library

Sagereceiv

er

Sagereceiv

er

Sagereceiv

er

Sagereceiv

er

Sagereceiv

er

Sagereceiv

er

FreeSpace

Manager

FreeSpace

Manager

UI Client

UI Client

UI Client

UI Client

SAILSAIL

App 1App 1

SAILSAIL

App 2App 2 App 3App 3

SAILSAIL

SAGE messages

Pixel stream

Page 12: David Abramson & Hoang Anh Nguyen Monash University.

Natural marriage◦ Computation and visualization

To date, no easy method connecting SWF to TDW.◦ Manual process◦ Did not receive a lot of attention from workflow

community

Page 13: David Abramson & Hoang Anh Nguyen Monash University.

Goals:◦ Provide seamless link between SWFs and TDW◦ Middleware independence◦ Future user interactions

Design Alternatives◦ SSH actor◦ SAGE actor◦ Distributed architecture: dedicated server

Page 14: David Abramson & Hoang Anh Nguyen Monash University.

SSH

pro

toco

lSSH

pro

toco

l Simple Inflexible

Simple Inflexible

SSH ActorSSH Actor

Figure 5: Solution using SSH actor

Page 15: David Abramson & Hoang Anh Nguyen Monash University.

messages

Pixel stream

Sagereceive

r

Sagereceive

r

Sagereceive

r

Sagereceive

r

Sagereceiver

Sagereceiver

FreeSpaceManag

er

FreeSpaceManag

er

UI Client

UI Client

App App

SAILSAIL

SAGE actor

UI Client

UI Client

JNIJNIKepler code (Java)

Kepler code (Java)

SAILSAIL SAILSAIL

Figure 6: SAGE actor block diagram

compact possible feeding user feedbacks to workflow intensive computation on machine running Kepler middleware dependent

compact possible feeding user feedbacks to workflow intensive computation on machine running Kepler middleware dependent

Page 16: David Abramson & Hoang Anh Nguyen Monash University.

Figure 7: Distributed Architecture

Server Interface

Server Interface

OptIPortalMiddlewar

e

OptIPortalMiddlewar

eServer

Interface

Server Interface

Server Interface

Server Interface

OptiServerOptiServer

OptIPortal

Kepler

OptIPortal Actor

OptIPortal Actor

OptIPortalMiddlewar

e

OptIPortalMiddlewar

e

OptIPortalMiddlewar

e

OptIPortalMiddlewar

e

middleware-independent highly distributed small communication overhead

middleware-independent highly distributed small communication overhead

Page 17: David Abramson & Hoang Anh Nguyen Monash University.

Figure 8: Implementation

messages

Pixel stream

Sagereceiver

Sagereceiver

Sagereceiver

Sagereceiver

Sagereceiver

Sagereceiver

FreeSpaceManag

er

FreeSpaceManag

er

SAILSAIL

App 1

App 1

SAILSAIL

App 2

App 2

App 3

App 3

SAILSAIL

OptiUI Client

OptiUI Client

OptiServerOptiServer

Kepler OptIPortal Actor

OptIPortal Actor

Page 18: David Abramson & Hoang Anh Nguyen Monash University.

Illustrate the ease of use with OptiportalActor

Use OptiportalActor in a set of optical microscopy workflows ◦ To visualize images of antibody cancer therapies*

Part of a larger project◦ Virtual microscopy◦ Demonstrating the utility of workflows for

microscopy

Page 19: David Abramson & Hoang Anh Nguyen Monash University.

Developed in the Faculty of Medicine, Monash University

Fluorescent labeled antibodies, together with various reagents, are used to mark three distinct tissue types: ◦ tumour nuclei ◦ “stroma” or connective tissue◦ blood vessels that feed the tumour

These therapies work by denaturing the blood vessels to the tumor

Page 20: David Abramson & Hoang Anh Nguyen Monash University.

Figure 9: Cancer Nuclei, Blood vessels, Stroma in confocal microscopy

Nuclei

Stroma

Blood vessels

Merged image

Page 21: David Abramson & Hoang Anh Nguyen Monash University.

Figure 10: Confocal scanning workflow

Page 22: David Abramson & Hoang Anh Nguyen Monash University.

Figure 11: Cancer image stack on Optiportal

Page 23: David Abramson & Hoang Anh Nguyen Monash University.

Figure 12: Therapy effectiveness measurement workflow

Page 24: David Abramson & Hoang Anh Nguyen Monash University.

Figure 13: Therapy effectiveness calculation on Optiportal

Page 25: David Abramson & Hoang Anh Nguyen Monash University.

SWF-TDW linkage Demonstration the system with a case

study in optical microscopy To-dos

◦ Support more data-types (currently images and movies)

◦ Support other middleware◦ Support more interactive modes of operation:

computational steering environment.

Page 26: David Abramson & Hoang Anh Nguyen Monash University.
Page 27: David Abramson & Hoang Anh Nguyen Monash University.

[1] Lin, C., Lu, S., Lai, Z., Chebotko, A., Fei, X., Hua, J. and Farsha, F. “Service-oriented architecture for view: A visual scientific workflow management system.”, In SCC ’08: Proceedings of the 2008 IEEE International Conference on Services Computing, pages 335–342, Washington, DC, USA, 2008. IEEE Computer Society.

[2] https://kepler-project.org/users/copy_of_LotkaWorkflow.png/image_large [3] http://systems.cs.princeton.edu/omnimedia/images/back24.jpg [4] http://messagelab.monash.edu.au/Infrastructure/OptiPortal [5] http://www.sagecommons.org/images/stories/SAGEcomponents.jpg