The Telescience Project - ATOMIC ( A pplications t o M iddleware I nteraction C omponents)

Post on 04-Jan-2016

35 views 8 download

Tags:

description

The Telescience Project - ATOMIC ( A pplications t o M iddleware I nteraction C omponents) https://telescience.ucsd.edu Transparent Grid Access for Scientific Communities Jason Novotny jnovotny@ncmir.ucsd.edu Abel W. Lin awlin@ncmir.ucsd.edu - PowerPoint PPT Presentation

Transcript of The Telescience Project - ATOMIC ( A pplications t o M iddleware I nteraction C omponents)

The Telescience Project - ATOMIC (Applications to Middleware Interaction Components)

https://telescience.ucsd.edu

Transparent Grid Access for Scientific Communities

Jason Novotnyjnovotny@ncmir.ucsd.edu

Abel W. Linawlin@ncmir.ucsd.edu

National Center for Microscopy and Imaging Research

University of California San Diego

Scales of NS data from Maryann MartoneScales of NS data from Maryann Martone

Mission:

Develop and implement technologies to determine and

reveal supramolecular details in their cellular and tissue contexts.

NCMIR forges innovations in CI and IT to enable solutions

for grand challenges in biomedical imaging research

NCMIR is an Accessible Resource Center for

Advanced Biomedical Research Fielding High-throughput Imaging Instruments, Computational

Analysis Tools and Databases

The Telescience Core Methodology

Partnership

RemoteInstrumentation

Databases &Digital Libraries

Computation

VisualizationNetwork

Connectivity

Training and Dissemination

Integrate resources, technologies and applications using standardized Grid middleware technologies and advanced

networking to provide an end-to-end solution for challenges like multi-scale biomedical imaging.

Interacting with the Grid

Portal and Applications

NMI

Compute Resources

Interaction with Middleware appears to be unified ...

MyProxy

Portals and Applications

CoG GridPort

Globus

GridFTP GRAM MDSSRB NWS

Physical Resources

CAS

Grid Security Infrastructure

CACL

Pegasus

LDAP

DataCutter

Condor(-G)

but is actually very fragmented

For example, some or all, of these components are necessary for end-to-end computation

Portal and Applications

Physical Resources: Data Storage, Compute Resources, etc.

Telescience ATOMIC bridges the Gap betweenmiddleware and applications

Local (Services): GSI, Globus, Condor, RLS, SRB, NWS, etc.

Collective Services : MyProxy, Pegasus, DataCutter, GridFTP, etc.

ATOMIC

Telescience Portal and Applications

ATOMIC provides tools for users and developers

Provides an intuitive GUI for end-users to launch jobs and manage data

ATOMIC: TeleAuth/GAMA, TeleWrap, TeleRun, etc.

Provides a programming interface and other tools for developers (Telescience Portal and others) to access to

Telescience Grid (compatible with other Scientific Grids).

Telescience is reducing the threshold to the use of Grid technologies

Gridsphere Portals framework serves as a rich GUI for end-users (bench scientists)

ATOMIC services scientific applications developers (mathematicians, physicists, etc…)

ATOMIC supports legacy applications and native grid applications with equal intensity.  

Motivation for ATOMIC: The Grid should be brought to bear for scientific processes...scientific processes should not necessarily have to conform to the Grid

Telescience spurs development, integration, and interoperability along all levels of CI

Telescience is realized in the context of microscopy but extendsdirectly to analogous applications that are data and compute intensive

and require parity between computers and instruments

This model is for all data generator devices: microscopes (EM/LM), shaker tables, particle accelerators, oceanic observers, ecological

sensor networks

Telescience Infrastructure

Richly integrated user environment

ATOMIC: applications (portal) enabler

NMI

Data Devices: generate, compute, store

ATOMIC Bundles Available

GAMA/TeleAuth: End-to-End GSI Security

TeleWrap: Transparent Data Grid I/O for applications

TeleRun: Information Gathering for Globus/MPI based applications

GAMA/TeleAuth

GAMA is complete GSI credential management and integration solution tailored for use in emerging cyberinfrastructure through web portals or web

service-based clients.

GAMA makes grid security as easy to use as any commercial web site while maintaining the security and delegation capabilities of GSI.

Interactive Applications: TeleWrap

ATOMIC also motivated by Data Generation and Computation Resources and Requirements

Heterogeneity places increase burden on application developers

Telescience CA recently

accepted by TeraGrid (1st

non-CS organization)

Utrecht Univ./ SARAOsaka Univ.KBSI/KISTI

NCHC

Portals

“The portal ecosystem and portal fabric will become the dominant models of application delivery by 2005."

- Gartner Research Group

Telescience Portal is built on the JSR168 GridSphere Project:

• extends the suite of richly integrated, grid enabled tools for the end user

• provides a new level of flexibility, customization, and seamless (administration free) harnessing of the power of global grids

• accomplishes this while also reducing the complexity of its own creation and management.

• amplifies the extensibility of its underpinnings to other scientific domains with analogous needs.

Portals: Single Sign-On

Portals: Launching Heterogeneous GridApplications

No CS information, onlybiologically relevant parameters

Portals: Data Grid Acces

ATOMIC is built out of Applied Experience, not only leading CS concepts…

ATOMIC is more than just a packaging of technologies, it is the bundling of nearly a decade of interdisciplinary experience in bringing these

technologies to bear for scientific applications.

Especially critical at this juncture, given the growing sophistication of GUI interface components

Future activities

• ATOMIC Web/Grid Services

• Extension of GTS (Generalized Telemicroscopy System) as ATOMIC-based services

• Telescience ATOMIC "Rocks Rolls"

For more information:https://telescience.ucsd.eduhttp://ncmir.ucsd.edu

Acknowledgments

Expressing and Executing Workflows

Laboratory Process

Application Pipelines

Recruit Subject Scan Visit Subject Analysis Group Analysis

Pre-Processing

Analysis

Post-Processing

Localizer

Structural

Functional