Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and...

29
Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported by the NSF NMI Program under Award #04-38312 http://www.GridChem.org April 24, 2005

Transcript of Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and...

Page 1: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Cluster Computingthrough an

Application-orientedComputational Chemistry Grid

Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani

Supported by the NSF NMI Program under Award #04-

38312http://www.GridChem.org

April 24, 2005

Page 2: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Outline

• Computational Chemistry Grid Overview

• HPC Application Computing through a Client Interface

• Architecture for the GridChem Client

• Supporting the Virtual Organization

Page 3: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

The Big Picture

Page 4: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Computation Chemistry Grid (CCG)“GridChem”

• A collection of “grid-enabled” resources to routinely run chemical physics applications

• Integrates a desktop environment into an infrastructure for a specific community of users– comp. chemists with large/small scale needs– experimental chemists who occasionally need

simulation capabilities to verify experimental results

• Establishes a distributed infrastructure for open scientific research– a virtual organization

Page 5: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

The Components

• Applications

• Resources

• Desktop Environmentthe GridChem Client

Compute Intensive 0.1-100 hrs runs

High Speed Infrastructure Not Needed

4 – 16 CPUS/job

Batch Support

Secure Access (grid-enabled)

Multi-platform support (XP, OS X, Linux)

Responsive

Client Interface to the Grid

Cluster Systems

Ψ=ΗΨ EAtoms, Small Molecules, Clusters

Electronic Structure

Page 6: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Applications• GridChem supports some apps already

– Gaussian 98/03, GAMESS, MolPro

• Schedule of integration of additional software– NWChem– ACES-2– Crystal– Q-Chem– NBO– Wein2K– MCCCS Towhee

• homegrown computational chemistry codes developed at LSU

Page 7: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Computational Chemistry Resource Providers

TACCCCT

NCSA

CCS OSC

Page 8: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Resources

Over 400 processors and 3,525,000 CPU hours available annually

System (Site) Procs Avail Total CPU Hours/Year

HP Intel Cluster (OSC) 12 100,000

Intel Cluster (OSC) 36 315,000

Intel Cluster (UKy) 96 840,000

HP Integrity Superdome 33 290,000

Intel Cluster (NCSA) 64 560,000

SGI Origin2000 (NCSA) 128 1,000,000

Intel Cluster (LSU) 32 280,000

IBM Power4 (TACC) 16 140,000

Page 9: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Desktop

Use your workstation!

Data Storage

Graphics

Computing Resource

596 MB for Internet Files

Intel: GMA 900 Graphics,…Mac: ATI Radeon 9200 with 32MB DDR

Gigaflop Processors

GigaBytes for Storage

Page 10: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Desktop -- GridChem• Java Based Client

– “Same” Look and Feel on “every” machine.– Consistent Environment

• No Globus Installation

• Designed for “Application Services” through a Server; but

• Can be used as Stand-Alone Client for job submission

Page 11: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

3-tier Architecture

GridChem Client GC Middleware Server HPC Resources

Authentication

KerberosMyProxySSHmodules

Resource specs. into Local Batch SpecsBatch Script Queue Submission

Application Execution +Output & File Transfers

inputs, resource specs. & temp. cert. transfer

Kerb. & MyProxyServers

Input PreparationMolecular Editor

Application OptionsSite Info (stat./dyn.)

J2EE

MySQL

Site Monitors

Site PreferenceJob Submission Resource

Management

File Management

RemoteStorage

MolecularEditor +Visualization

User See Two-Tier Architecture

Page 12: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Infrastructure (now)• Server, GridChem Client*

– MyProxy (X-500 Certs), Kerberos (Security)– CGI Scripts GSI

( for Data Movement & Job Launch)

• Job Monitoring– Perl filters, MySQL

• Support– PCS, Portable Consulting Service

• EOT– OSU

*

Page 13: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Infrastructure (future)• Server

– Condor + ? (Job Launch)– GSI ( Data Transfer, uberftp)– Information Repository (IGRID, GPIR,…?)

• Support– GridPort 3.0 Monitoring,

Consulting (PCS), Accounting…

Page 14: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Infrastructure (future)• GridClient

– 3-rd party file transfers (Trebuchet)– More intelligence in input construction– Increase Application Space– Web Start– Indirect DB access for preferences– Advanced visualization support (Molden,…)

• Resource Sites– Condor– Globus Utils

Page 15: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

GridChem Client

Page 16: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

GridChem Client

Page 17: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

GridChem Nanocad Molecular Editor

Page 18: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Lexical Analysis And Parsing

• Follows the progress of the calculation while it is still running or has completed.

• Plots the energy, gradient, etc versus iteration number.

Page 19: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Monitoring

User

Storage

HTTPHTML,PHP,…

Service

Login

DB

Batchcron

Filter

Page 20: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Job-Status-Monitor = JSM

Page 21: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.
Page 22: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Consulting

Database

Report Problem

User Interface

Consultant Interface

Email Notification

Further Interaction

ConsultantMonitorPage

Front-line triage

TicketTransfer &ResponsePage

Ticket Owner& CCs

Problem Form

PersonalizedMonitorPage

Email Notification

Notifications

Page 23: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

User Submission

Page 24: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Consultant ViewConsultant’s View

Page 25: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Post Processing2d and 3d Orbital isosurfaces

Using NCSAChem/Slice/Molden/Cartona/Free Software

Molecule Viewers

Page 26: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Electron Structure: Orbitals or electron densities,…

5-dehydro-m-xylylene triradical

Page 27: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Transcription Regulator(molecular modeling)

Page 28: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Summary

• GridChem Client

• Resources

• Community

“Better Living Through Chemistry”

Page 29: Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

References

• www.gridchem.org

• www.grids-center.org

• www.gridlab.org/