EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure...

20
-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Program www.euindiagrid.eu GARUDA - The National Grid Computing Initiative of India Subrata Chattopadhyay C-DAC, Bangalore, India [email protected]

Transcript of EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure...

Page 1: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

GARUDA - The National Grid Computing Initiative of India

Subrata ChattopadhyayC-DAC, Bangalore, India

[email protected]

Page 2: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Outline

•GARUDA Overview•Communication Fabric •Resources •Partners •Applications & User Groups•Q & A

Page 3: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Motivation for GARUDA• Sharing of high-end computational resources

with the larger scientific and engineering community across the country

• Emerging High Performance Computing (HPC) applications require integration of geographically distributed resources

• Collaborative Framework for solving applications which are interdisciplinary requiring experts from multiple domains and distributed locations

• Universal (location-independence, ubiquitous) access to resources

Computational Grids effectively address the above application requirements

Page 4: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Project Overview• Precursor to the National Grid Computing Initiative

– Test Bed for grid technology/concepts and applications leading to the plan for the main grid initiative

• Project initiated by the Dept. of IT in November 2004 • Major Deliverables

– Technologies, Architectures, Standards & Research Initiatives

– Nation-wide high-speed communication fabric– Aggregation of Grid Resources– Deployment of Select applications of National

Importance– Grid Strategic User Group

• High-speed Networking Component in collaboration with ERNET

Page 5: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Garuda Component Architecture

Resources

• Compute, Data, Storage,

• Scientific Instruments,

• Softwares,..

Access Methods

• Access Portal

• Problem Solving Environments

Data Management

• Storage Resource Broker

Development Environment

• DIViA for Grid

Management & Monitoring

• Paryaveekshanam

Collaborative Environment

• Video Conferencing over IP

• Access Grid

Resource Mgmt & Scheduling

• Moab from Cluster Resources

• Load Leveler, Torque

• Globus 2.x

Application (PoC)

• Disaster Management

• Bioinformatics

Page 6: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

GARUDA Component Deployment Scenario`

CC -- D A C , D A C , B a n g a l o r eB a n g a l o r eL A N

L o c a l U s e r

H e a dN o d e

C o m p u t e N o d e s

I n t e r n e tA c c e s sG e n e r i c

U s e r

L o c a l U s e r

H e a dN o d e

C o m p u t e N o d e s

L A N

CC -- D A C , P u n eD A C , P u n e

P a r t n e r P a r t n e r w i t h o u t r e s o u r c e sw i t h o u t r e s o u r c e s

A c c e s s T e r m i n a l s

P a r t n e rP a r t n e rw i t h r e s o u r c e sw i t h r e s o u r c e s

U s e rH e a dN o d e

T e l e s c o p e

L A N

S t o r a g e

H e a dN o d e

C o m p u t e N o d e s

L A N

A c c e s s T e r m i n a l

G a t e w a y

S u b m i t N o d e

S u b m i t N o d e

G a t e w a y

A c c e s sT e r m i n a l

A c c e s s T e r m i n a l

A c c e s s T e r m i n a l

M P L S M P L S

A c c e s sA c c e s s

G a t e w a y

G a t e w a y

CC -- D A C , D A C , B a n g a l o r eB a n g a l o r eL A N

L o c a l U s e r

H e a dN o d e

C o m p u t e N o d e s

H e a dN o d e

C o m p u t e N o d e s

I n t e r n e tA c c e s s

I n t e r n e tA c c e s sG e n e r i c

U s e r

L o c a l U s e r

H e a dN o d e

C o m p u t e N o d e s

H e a dN o d e

C o m p u t e N o d e s

L A N

CC -- D A C , P u n eD A C , P u n e

P a r t n e r P a r t n e r w i t h o u t r e s o u r c e sw i t h o u t r e s o u r c e s

A c c e s s T e r m i n a l s

P a r t n e rP a r t n e rw i t h r e s o u r c e sw i t h r e s o u r c e s

U s e rH e a dN o d e

T e l e s c o p e

L A N

S t o r a g e

H e a dN o d e

C o m p u t e N o d e s

L A N

A c c e s s T e r m i n a l

G a t e w a yG a t e w a y

S u b m i t N o d e

S u b m i t N o d e

S u b m i t N o d e

S u b m i t N o d e

G a t e w a yG a t e w a y

A c c e s sT e r m i n a l

A c c e s s T e r m i n a l

A c c e s s T e r m i n a l

M P L S M P L S

A c c e s sA c c e s s

G a t e w a yG a t e w a y

G a t e w a yG a t e w a y

Page 7: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Cyber Infrastructure – Network Fabric

• The Proof of Concept network has been established in collaboration with ERNET

• The MPLS Virtual Private Network (VPN) connects 22 institutions at 100 Mbps and 23 institutions at 10 Mbps across 17 Indian cities with SLA agreements

• Collaborative environment enabled through Video Conferencing over IP at the following centres of C-DAC : Bangalore, Pune, Chennai, Hyderabad, Mumbai and Trivandrum

Page 8: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Cyber Infrastructure – Resources

• In addition to PARAM Padma, Linux Clusters have been setup at Pune, Hyderabad & Chennai

• Grid Labs have been setup at Bangalore, Pune & Hyderabad

• Fourteen of the partner institutions are contributing resources including satellite terminals (compute aggregating to more than 300 CPUs)

Page 9: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Resource Details• HPC Clusters from C-DAC

Bangalore : AIX Cluster

Pune, Chennai, Hyderabad : Linux Clusters

• Linux Clusters from

• IISc & RRI, Bangalore

• IMSc & MIT, Chennai

• IIT, Guwahati

• IIT, Kharagpur• AIX SMP from University of

Hyderabad • SAC, Ahmedabad is contributing

GSAT3 terminals (GSAT4 when launched) and Satellite bandwidth

Page 10: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Resources at C-DAC centres

AIXCluster

Shared User SpaceShared Data Space

Linux Cluster

Bangalore

Solaris Cluster

LinuxCluster

Shared User SpaceShared Data Space

Pune

Chennai HyderabadResource

Manager for Grids

Linux Cluster

ResourceManager for Grids

Garuda Access Portal

Other UsersPune Users

End Users access the grid through the Garuda Access Portal

HighAvailability

HighAvailability

Resource Manager for Grids

HighAvailability

HighAvailability

Resource Manager for Grids

Bangalore Users

Page 11: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Grid Management & Monitoring Centre

• An integrated Resource Management & Monitoring Framework

• Network Traffic Analysis and Congestion Management

• Help desk for Grid Users

Page 12: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

GARUDA Partners• Motivation– To Collaborate on

Research and Engineering of Technologies, Architectures, Standards and Applications in Grid Computing

– To Contribute to the aggregation of resources in the Grid

• Current Participation– 36 research & academic

institutions in the 17 cities

– ERNET-HQ in Delhi– 8 centres of C-DAC– Total of 45 institutions

Page 13: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

GARUDA Partners (contd..)C-DAC Centres (8):• Pune (2)• Bangalore(2)• Hyderabad• Mumbai• Chennai• Thiruvananthapuram

Academia• Motilal Nehru National Institute of Technology, Allahabad• Indian Institute of Science, Bangalore• Punjab Engineering College, Chandigarh• Madras Institute of Technology, Chennai• Jawaharlal Nehru University, Delhi• Guwahati University, Guwahati• University of Hyderabad, Hyderabad• Indian Institute of Technology at :

• Chennai• Delhi• Guwahati• Kanpur• Kharagpur • Mumbai• Roorkee

• University of Pune, Pune• Institute of Technology, Banaras Hindu University, Varanasi

Government Collaborators• ERNET India

Page 14: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

GARUDA Partners (contd..)Research Labs & Institutions• Institute for Plasma Research, Ahmedabad• Physical Research Laboratory, Ahmedabad• Space Application Centre, Ahmedabad• Harish Chandra Research Institute, Allahabad• Indian Institute of Astrophysics, Bangalore• National Centre for Biological Sciences, Bangalore • Raman Research Institute, Bangalore• Institute of Mathematical Sciences, Chennai• Institute of Microbial Technology, Chandigarh• Institute of Genomics and Integrative Biology, Delhi• Centre for DNA fingerprinting and Diagnostics, Hyderabad• Saha Institute of Nuclear Physics, Kolkatta• Sanjay Gandhi Post Graduate Institute of Medical Sciences,

Lucknow• Bhabha Atomic Research Centre, Mumbai• Tata Institute of Fundamental Research, Mumbai• Inter-University Centre for Astronomy and Astrophysics, Pune• National Chemical Laboratory, Pune• National Centre for Radio Astrophysics, Pune• Regional Cancer Centre, Thiruvananthapuram• Vikram Sarabhai Space Centre, Thiruvananthapuram

Page 15: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Illustrative Applications

Page 16: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Objectives and Deliverables• Objectives

– Enable applications of national importance requiring aggregation of geographically distributed resources

• Deliverables– Grid enablement of

illustrative applications and some demonstrations such as • Bioinformatics• Disaster

Management

Page 17: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Bioinformatics• Bioinformatics Resources

& Applications Facility (BRAF) on PARAM Padma

• Supports highly optimized Bioinformatics codes on the PARAM Padma

• Web computing portal providing all computational facility to solve related problems

Page 18: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Disaster Management

PARAM Padma

at Bangalore

Flight data transmission from

nearby Airport

Grid Partner Resource

at Pune

User Agencies

GRID Communication

Fabric

High Speed Communicati

on

UserAgenci

es

Page 19: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Virtual User Community

• Astrophysics• High Energy Physics & Astronomy• Grid Technology• Disaster Management• Earth Science• Bioinformatics (Genome)• Network Technology

Page 20: EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme  GARUDA - The National Grid.

EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programmewww.euindiagrid.eu

Thank you! www.garudaindia.in