Grid Activity in China Sun Gongxing, IHEP, Beijing.

44
Grid Activity in China Sun Gongxing, IHEP, Beiji ng
  • date post

    20-Jan-2016
  • Category

    Documents

  • view

    213
  • download

    0

Transcript of Grid Activity in China Sun Gongxing, IHEP, Beijing.

Page 1: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Grid Activity in China

Sun Gongxing, IHEP, Beijing

Page 2: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Grid Projects in China • Vega Grid Project ( ICT, MOST) • National High Performance Computing Environment funded by 863 program (Many participants, MOST) • Scientific Data Grid. (CAS, MOST) • HEP data grid.(IHEP) • Grid infrastructure building (MOE)

Page 3: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Overview of China’s Grid Project

Build a superserver for major grid sites. Build a few of HPC centers. Develop system software for the Grid s

ystem. Develop demo applications on the Grid. Build 2Gbps interconnection among 10

0 university.

Page 4: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Vega Project

1. Design goals:• Design and implement Grid-level software.• Build a national-scale infrastructure suppor

ting HPC.• Develop application running on testbed.2. Grid-oriented superservers—Dawning 4000,

5000,etc.3. Service Grid

Page 5: Grid Activity in China Sun Gongxing, IHEP, Beijing.
Page 6: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Stress Distribution of 3800TEU

Page 7: Grid Activity in China Sun Gongxing, IHEP, Beijing.

500hPa Contours in Weather Forecasting

Page 8: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Vega Grid Topology

It is Router-centered structure:

Page 9: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Vega Grid Computing Protocol

Page 10: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Vega OS

Vega OS overview1, A user-level middleware running on client mac

hine

• Vega GOS constructed by 2 components: GOS and gnetd

- GOS is a daemon running on client machine. - gnetd is a daemon on grid server response to client commands.

Page 11: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Grid process and Grid thread - Grid process is a unit for managing the

whole resource of the Grid. - Grid thread is a unit for executing

computation on the Grid.

Page 12: Grid Activity in China Sun Gongxing, IHEP, Beijing.

2, Vega APIs introduction Vega GOS APIs - GOS APIs for application developers grid(): constructs a Grid process on client

machine. gridcon(): grid process connects to Grid sy

stem. gridclose(): close a connected grid. ……

Page 13: Grid Activity in China Sun Gongxing, IHEP, Beijing.

• gnetd APIs for service developer on Grid servers

- grid_register(): register a service to Grid. - grid_unregister(): unregister a service. …….

Page 14: Grid Activity in China Sun Gongxing, IHEP, Beijing.

- A GOS-based application. - No central control - shell commands: > gsub > gstat > gkill, ……

The Vega Grid Batch System

Page 15: Grid Activity in China Sun Gongxing, IHEP, Beijing.

- All kinds of resources registered in Grid. > Computational resources: cycles, mem, disk, networks…… > software: DB, CAD…… > services: ftp, http, mail……

Page 16: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Global Batch System in Vega Grid

Page 17: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Travel-An Online Transaction system

An online transaction system----travel in China- GOS-based application- 4 different basic services registered in the Grid. * Wheather forecasting * airline ticket booking * sight spot ticket booking * charging- Putting these 4 services into an application

Page 18: Grid Activity in China Sun Gongxing, IHEP, Beijing.
Page 19: Grid Activity in China Sun Gongxing, IHEP, Beijing.
Page 20: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The National HPC Project Overview - Set up 9 HPC sites across China - Interconnected these 9 sites with available networks ( Cernet & NSTTet) - equipped each site with Dawning 2000/3000, Galaxy 3(20Gflops), Sunway 1(460Gflops), PC-cluster(8Gflops)

Page 21: Grid Activity in China Sun Gongxing, IHEP, Beijing.
Page 22: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Overview of the Grid System Software

A function layer on top of node OSs. Management of resources, users and t

asks. Authentication and authorization. Hardware-enhanced encryption. Web –based user interface.

Page 23: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Grid System Software

Page 24: Grid Activity in China Sun Gongxing, IHEP, Beijing.

User Management

Page 25: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Job Management(submit)

Page 26: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Resource Management(Find a User)

Page 27: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Grid System Monitoring

Page 28: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Grid Utilities

Page 29: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Grid Applications Weather forecasting. Petroleum reservoir simulation. Bio-information database and applications. Numerical wind tunnel simulation. Automobile collision simulation. Ship structure analysis. National scientific databases and

applications. Digital library.

Page 30: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Audio

Notebook HPC

BP, Mobile phone

Video Camera

Tel. Game

TV

DVD

PC

Internet

Gigabit IP Network

Node Node Node Node

DBInfo lib.

Instr.

NHPCE

Page 31: Grid Activity in China Sun Gongxing, IHEP, Beijing.

International Cooperation Joint research supported by

European and China. Source sharing - Computing power - Database - Software tools - Application software

Page 32: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Scientific Data Grid Project Build on the top of scientific

databases. Belong to CAS, but open to the

world. Plan to provide service in 2004-

2005.

Page 33: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Scientific Database(SDB)

SDB funded by CAS since 1986. SDB is a collection of multiple disciplinary

databases, including chemistry, biology, geography, astronomy, ecology, etc.

By 2005, there are - 400+ member institutions across China. - 300+ databases which is distributed and heterogeneous. - 10TB+ data volume size.

Page 34: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Why do SDG? Resource level—sharing and

development. - make data more accessible.

- data integration - and more easy to do: data->information->knowledge.

Application level—emerging applications - can do what we can not do before. - cross multiple databases/multiple disciplines. - require more resources ( cycles, bandwidth, instrument, etc.)

Page 35: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Tasks

Build testbed - one data center - and three sub data center. Middleware - information service - security - user interface Applications - Chemistry/Geo-science/astronomy/biolog

y…

Page 36: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Bio CenterCluster 8 nodes1-2TBBeijing

Data Center (CNIC)Cluster 16 nodes15TB

Geo CenterCluster 8 nodes1-2TBBeijing

1000M

Chemistry CenterCluster 8 nodes1-2TBShanghai

SDG Resources: 20 TB 4 PC Clusters CSTNET

155M

1000M

Page 37: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Mass Storage Database Application Server

MDS Server

CA Server

PortalServer

SDG Data Center

Supercomputers at CNIC ~2 TFLOPS

Page 38: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Grid MiddlewareApplication

GAPI

DRB

UAI

Local DBMS

databases

local data management system, could be DBMS or file system

universal access interface to single data resource

coordinated access to multiple data resources

app-oriented, unified program interface

applications

GSI

xMDS

Page 39: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Projects CAS The tenth five-year program (2001

—2005) (37MRMB). 863 program (MOST) A special program (proposed).

Page 40: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Collaboration PRAGMA APGrid SDSC KISTI ASCC Texas A&M Univ.

Page 41: Grid Activity in China Sun Gongxing, IHEP, Beijing.

HEP Data Grid Currently funded by IHEP, CAS. Build a BES VO in IHEP campus networ

k environment for BES experiment. Probably Add to CMS and Atlas Vos in t

he future for CMS and Atlas collaborations.

ARGO-YBJ VO for ARGO-YBJ experiment.

Page 42: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The HEP Grid Testbed Topology

GIIS

GRIS GRIS

Condor PBS

Two 6 CPUs PC-FARM

Page 43: Grid Activity in China Sun Gongxing, IHEP, Beijing.

Current Main Tasks Large Scale Linux Configuration and mainte

nance—LCFG. Authentication/authority—GSI. Resource Information Management—MDS. Grid Resource Allocation Management—GR

AM. Data Replication Management—GDMP. HEP analysis software gridifying—Appln.

Page 44: Grid Activity in China Sun Gongxing, IHEP, Beijing.

The Future Work

Build IHEP campus Grid computing environment sharing about ten PC-Farms.

Promote collaboration with National Grid Projects and international Grid communities

Make effort to propose Regional Center 2 project in China.