Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · –...

37
NATIONAL GRID NATIONAL GRID SINGAPORE SINGAPORE Jon Lau Assistant Head

Transcript of Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · –...

Page 1: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

NATIONAL GRIDNATIONAL GRIDSINGAPORESINGAPORE

Jon LauAssistant Head

Page 2: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

ContentContent

• Development in Grid Activities in Singapore

• Singapore’s National Grid• Pilot Platform• Virtualization of Technical Computing

Resource• Promotional Activities• International Interactions

Page 3: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Development in Grid Development in Grid Activities in Singapore Activities in Singapore

Page 4: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Overview of Grid ActivitiesOverview of Grid Activities

– Nanyang Technological University (NTU)– National University of Singapore (NUS)– Institute of High Performance Computing

(IHPC)– Genome Institute of Singapore (GIS)– Bioinformatics Institute (BII)

Page 5: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

• Maximize academic/research computing resources utilization.• Enable sharing of specialized and scarce hardware & software

resources.• Enable sharing of data in BioInformatics & other research works.• Facilitate collaboration.

• Linux clusters at NUS, NTU & IHPC connected to form a Grid testbed

• Globus Toolkit installed on all clusters• Packages: Condor, PBS, Sun Grid Engine

Earlier Grid Earlier Grid TestbedsTestbeds

[Courtesy of Tan Chee Chiang, NUS]

Page 6: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

NanyangNanyang Technological UniversityTechnological University

• Research Focus– Middleware development (with IHPC)– Application development

• Projects– MEG Data Visualisation (CyberMedia Center, Osaka Univ.)– Integration of SIBBS into Globus– Meta-scheduling, inter-operability, ...

• Collaborators– IHPC, BioMedGrid, ApGrid

• HPC Resources– PC Cluster with Cluster software– 0.5 teraflops HP (Compaq) Cluster– AP Science & Technology Centre (with Sun Microsystems)

[Courtesy of A/P Francis Lee, NTU]

Page 7: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

National University of SingaporeNational University of Singapore

• Research Focus– Middleware & Grid Programming

• Projects– ALICE (a Java-based Lightweight Grid)

• Collaborators– Centre for Remote Imaging, Sensing & Processing (CRISP),

Bioinformatics Institute, Nanyang Polytechnic (School of Life Sciences)

• Start-up: Atsuma Technology (www.atsuma.com)• HPC Resources:

– HP Alpha servers (GS320 and ES40), SGI server (Origin2000), Linux cluster, & SGI/HP/Sun workstations

[Courtesy of A/P Teo Yong Meng, NUS]

Page 8: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Institute of Institute of High Performance ComputingHigh Performance Computing

• Research Focus– Middleware development (with NTU)

• Directory service, execution management services

• Projects– Infrastructure implementation (KISTI (Korea))– Grid Enabled Computational Electro Magnetics (British

Aerospace, Cardiff University, Swansea University & HP)– Environment to support simulations (such as CFD, CME, CEE,

MEMS)

• HPC Resources– IBM p690 Regatta, 17 & 13 CPU PIII Beowulf clusters

[Courtesy of Dr. Kurichi Kumar, IHPC]

Page 9: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Genome Institute of SingaporeGenome Institute of SingaporeGrid ProjectsGrid Projects

• SNPs– Building an integrated SNPs database which takes information

from several SNPs databases & then aligns the information to a common genome sequence. The resulting information helps to identify SNPs which overlap & could be more significant for using as markers & building of primers.

• Protein-Protein Interactions Database (PPDB)– Building a system to help predict protein-protein interactions by

integrating many tools & data from several sources. We use information from domain fusion, text-mining, experimental databases, & phylogenetic profiling to construct putative protein-protein interaction networks.

[Courtesy of Heidi Dowst, GIS]

Page 10: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Bioinformatics InstituteBioinformatics Institute• Research Focus

– Bioinformatics, grid software

• Projects– High Throughput Blast with National Cancer Centre– Analysis Pipeline of Zebrafish Genome with GIS– Annotation of Fugu Genome with IMCB & Sanger Center (UK)– Analysis of Arrhythmia– High Throughput Mass Spec Analysis with GIS– Bacterial Comparative Genomics with DMRI– Grid version of Clustlw– Cellware

• HPC Resources– Itanium cluster, Alpha, 64-CPU Pentium 3

[Courtesy of Larry Ang]

Page 11: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

SingaporeSingapore’’ssNational GridNational Grid

Page 12: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

National GridNational Grid

The NG is a national effort to:• Develop a Cyberinfrastructure for

science and engineering research and education; and

• Promote the use of Grid Computing for research, academia, commerce and industry

Page 13: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

NG NG OrganisationOrganisation ChartChartMTI

(A*STAR, EDB, JTC, RICs)

MTI(A*STAR, EDB,

JTC, RICs)

MINDEF(DSTA, DSO,

defence contractors)

MINDEF(DSTA, DSO,

defence contractors)

MITA(IDA, MDA)

MITA(IDA, MDA)

MOH(Hospitals)

MOH(Hospitals)

MOE(Schools)MOE

(Schools)IHLs

(NUS, NTU & Polys)

IHLs(NUS, NTU &

Polys)

National Grid Steering Committee (NGSC)Chairman: Mr Peter Ho, PS (Defence)

National Grid Steering Committee (NGSC)Chairman: Mr Peter Ho, PS (Defence)

Network WG

Security WG

Middleware WG

Applications WG

Governance/Policy WG

Physical Sciences

VGC

National Grid Operations Centre

(NGOC)

National GridOffice(NGO)

National GridOffice(NGO)Facilitates &

coordinates activities

National Grid Competency

Centre (NGCC)Life Sciences

VGC….

Page 14: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

NG OfficeNG Office

• Started:– Jan 2003 with 2½ persons

• Functions:– Secretariat to NG Steering Committee– Facilitate & co-ordinate activities of Working

Groups & Virtual Grid Communities– Develop NG Master Plan

– Act as a catalyst to achieve the NG goal

Page 15: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

National GridNational GridPilot PlatformPilot Platform

(NGPP)(NGPP)

Page 16: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Pilot Platform for Grid ComputingPilot Platform for Grid Computing

“Conservative” approach to demonstrate the feasibility of grid computing:

• Use existing facilities as much as possible• Co-funding by stakeholders• Performance indicators for review• Dovetails with a strategic research program on

collaborative large-scale computing

Page 17: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

NG Pilot PlatformNG Pilot Platform

Itanium 2LinuxSMA

Sun FireIntel Pentium 4

SolarisLinux

NTU

Intel Xeon ClusterLinuxNUS

Intel Xeon ClusterItanium

Sun

LinuxItaniumSolaris

One-North(BII & GIS)

IBM RegattaAIXIHPC

PlatformOSEntity

Page 18: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

NG Pilot PlatformNG Pilot Platform

• Connecting up– Institute for Higher Performance Computing

(IHPC)– One-North which has Bioinformatics Institute

(BII) and Genome Institute – National University of Singapore (NUS)– Nanyang Technological University (NTU)– Singapore-MIT Alliance (SMA)

Page 19: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

NG Pilot PlatformNG Pilot Platform

• Co-funding from stakeholders – Agency for Science, Technology and

Research (A*STAR)– Defense Science Technology Authority

(DSTA)– Economic Development Board (EDB)– Infocomm Development Authority (IDA)– National University of Singapore (NUS)– Nanyang Technological University (NTU)– Singapore-MIT Alliance (SMA)

Page 20: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

NG Pilot PlatformNG Pilot Platform

• Support from Vendors– CISCO– DELL– Hewlett Packard– IBM– Intel– Singapore Computer Systems– StarHub– Sun Microsystems

Page 21: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Thematic Strategic Research Thematic Strategic Research Programme (TSRP) onProgramme (TSRP) on

““GRID GRID Computing Computing -- Network, Platform, Network, Platform, Middleware and ApplicationsMiddleware and Applications

• A thematic approach for funding of Strategic Research Programmes by the Science & Engineering Research Council under A*STAR

• Fund Grid R&D projects which include research on Grid Enabling technologies (i.e. network, security, middleware, & tools).

Page 22: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Virtualization/Sharing/Aggregation Virtualization/Sharing/Aggregation ofof

Technical Computing Resource Technical Computing Resource on theon the

National Grid Pilot PlatformNational Grid Pilot Platform

Page 23: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Survey onSurvey onScientific Computing Hardware ExpenditureScientific Computing Hardware Expenditure

Survey:• Survey among IHLs and RICs for the past 5 years

(1998 – 2002).• Survey of hardware bought. It does not include

cost of maintenance, manpower costs and software costs.

Assumptions:• Based on 40% savings when utilization is

increased by virtualizing resources.

Page 24: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Survey onSurvey onScientific Computing Hardware ExpenditureScientific Computing Hardware Expenditure

S$40m

1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008

Year

Cos

t

Projected Expenditure on HPCWithout Grid Infrastructure

Projected Expenditure on HPCWith Grid Infrastructure

Page 25: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Survey onSurvey onScientific Computing Hardware ExpenditureScientific Computing Hardware Expenditure

Findings:• Hardware replacements occurs in a 4 year cycle.• Savings of between 20% - 30% over next 5 years.• The amounts indicated are probably less than actual expenditure

as it is impossible to capture every items purchased.More savings expected:• Bandwidth costs goes down.• Additional savings from software aggregation and savings in

manpower and maintenance costs.Other benefits:• Better results via collaboration.• Ability to handle massively computational jobs.• Attract investments in Life Sciences.

Page 26: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Promotional ActivitiesPromotional Activities

Page 27: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Organized by :

Supported by :

Sponsored by :

Page 28: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Physical Sciences VGC SymposiumPhysical Sciences VGC Symposium

• Co-organised by NUS, NTU, IHPC and NG Office

• 10 papers submitted

• More than 100 participants

Page 29: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Grid Competition for IHL studentsGrid Competition for IHL students

Page 30: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

International InteractionsInternational Interactions

Page 31: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

International InteractionsInternational InteractionsKorea/JapanKorea/Japan

• A*STAR led delegation visited Korea and Japan from 12 – 15 May 2003– Korea: KISTI, Seoul University, Yonsei University,

Ministry of Information & Communication (MIC) and IBM & HP.

– Japan: IBM Tokyo Research Lab, GTRC-AIST, NTT Data Corp, METI.

Page 32: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

International InteractionsInternational InteractionsUK eUK e--ScienceScience

• A*STAR and National Grid visited UK e-Science Centresin July 2003.

• Singapore Tissue Network collaboration with Oxford University.

• NTU collaboration with University of Southhampton and other e-Science centres.

• IHPC collaboration with BEA, Cardiff University, HP Lab Bristol, University of Wales, Swansea, Welsh e-Science Centre (GECEM).

• IHPC collaboration with Rolls Royce.• A delegation from Singapore will be attending “all-

hands” meeting at Nottingham, UK in September 2003.

Page 33: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

International InteractionsInternational InteractionsUSA USA TeraGridTeraGrid

• An NGSC delegation will be visiting USA TeraGrid sites in September 2003– Argonne National Laboratory (ANL)– National Center for Supercomputing

Applications (NCSA)– National Science Foundation (NSF)– San Diego Supercomputing Centre (SDSC)

Page 34: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

Modest beginning

Milestones of NGMilestones of NG

Sep 02

Visit to Japan and Korea

Jan 03

NG Office(2-1/2 staff)Formed

NG O submitted proposal on TSRP

for Grid Computing

NG O organized 1st

Physical Sciences VGC Symposium

Jul 03

NG SCFormed

PP business Plan approved

Aug 03 Sep 03 Oct 03June 03

To award PP contracts

UK e-ScienceTrip

Workshop on TSRP for Grid

ComputingTo

Launch PP

Apr 03 May 03

Consulting, buy-ins, promotion

Accelerating developments

UK e-Science‘all-hands’

Visit to USATeraGrid

Page 35: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

The Way AheadThe Way Ahead

• International Collaborations/MOUs• Strengthening of NG Pilot Platform• Improve middleware, and the provision

of Grid operation/support services• Encourage Virtual Grid Communities

Page 36: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

AcknowledgementsAcknowledgements• A/P Francis Lee ([email protected]), School of Computer

Engineering, NTU• A/P Teo Yong Meng ([email protected]), Computer

Science Department, NUS• A/P Tan Tin Wee ([email protected]), Bioinformatics Centre,

Dept. of Biochemistry, NUS• Tan Chee Chiang ([email protected]), Computer Centre, NUS• Dr. Kurichi Kumar ([email protected]), Institute of High

Performance Computing• Heidi Dowst ([email protected]), Genome Institute of Singapore• Larry Ang ([email protected]), Bioinformatics Institute

Page 37: Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · – Cellware • HPC Resources – Itanium cluster, Alpha, 64-CPU Pentium 3 [Courtesy of

The EndThe End

For more information, contact:

National Grid Office21 Heng Mui Keng Terrace

Singapore 119613

http://www.ngp.org.sg