Status of CNGrid and Interests on International Testbed
Depei QianSino-German Joint Software Institute (JSI)
Beihang University
SC12 BoF on Computing Research Testbeds as a Service Salt Lake City, USA
Nov. 13, 2012
863 key projects on HPC and Grid: 2006-2010
“High productivity Computer and Grid Service Environment” Period: 2006-2010 (extended to now) 940 million Yuan from the MOST and
more than 1B Yuan matching money from other sources
CNGird is one of the major outcomes of the project
CNGrid environment 14 sites
SCCAS (Beijing, major site) SSC (Shanghai, major site ) NSCTJ (Tianjin) NSCSZ (Shenzhen) NSCJN (Jinan) Tsinghua University (Beijing) IAPCM (Beijing) USTC (Hefei) XJTU (Xi’an) SIAT (Shenzhen) HKU (Hong Kong) SDU (Jinan) HUST (Wuhan) GSCC (Lanzhou)
The CNGrid Operation Center (based on SCCAS)
CNGrid sitesCPU/GPU
Storage
SCCAS 157TF/300TF
1.4PB
SSC 200TF 600TB
NSCTJ 1PF/3.7PF 2PB
NSCSZ 716TF/1.3PF
9.2PB
NSCJN 1.1PF 2PB
THU 104TF/64TF 1PB
IAPCM 40TF 80TB
USTC 10TF 50TB
XJTU 5TF 50TB
SIAT 30TF/200TF 1PB
HKU 23TF/7.7TF 130TB
SDU 10TF 50TB
HUST 3TF 22TB
GSCC 13TF/28TF 40TB
THUTHUIAPCMIAPCM NSCTJNSCTJ
NSCJNNSCJN
SSCSSC
USTCUSTC
NSCSZNSCSZ
HKUHKUSIATSIAT
HUSTHUST
SCCASSCCAS
GSCCGSCC
XJTUXJTU
SDUSDU
CNGrid Resources
14 sites >3PF
aggregated computing power
>15PB storage
CNGrid GOS Architecture
Tomcat(Apache)+Axis, GT4, gLite, OMII
Dynamic DeployService
CA Service
System Mgmt Portal
Hosting Environment
Core
System
Tool/App
Message Service
Agora
User Mgmt Res MgmtAgora Mgmt
Naming
HPCG App & Mgmt Portal
GSML Browser
ServiceControllerOther
RController
BatchJob mgmt
MetaScheduleAccount mgmt
File mgmt
metainfo mgmt
HPCG Backend
Resource Space
GOS System Call (Resource mgmt,Agora mgmt, User mgmt, Grip mgmt, etc)GOS Library (Batch, Message, File, etc)
Other Domain Specific Applications
Grip Runtime
Grip Instance MgmtSecurity
Res AC & Sharing
Other 3rd software &
tools
Java J2SE
GridWorkflowDataGrid
IDE Compiler
GSML Composer
GSML Workshop.
Debugger
Grip
Gsh & cmd tools
VegaSSH
Cmd Line Tools
DB ServiceWork Flow
Engine
Grid Portal, Gsh+CLI, GSML Workshop and Grid Apps
OS (Linux/Unix/Windows)
PC Server (Grid Server)
J2SE(1.4.2_07, 1.5.0_07)
Tomcat(5.0.28) +Axis(1.2 rc2)
Axis Handlers for Message Level Security
Core, System and App Level Services
Domain application Grid
Introducing Cloud Computing concept into CNGrid CNGrid—as IaaS and partially PaaS Domain application Grids—as SaaS and partially PaaS
Taking advantages of aggregating distributed heterogeneous resources by Gird and of applying the business model of cloud computing
Prototype domain application Grids Simulation and optimization
automobile industry aircraft design steel industry
Scientific computing Bio-information application computational chemistry
Domain application Grid (cont’d) Using CNGrid as virtual
resources which can be dynamically requested and allocated
End users obtain resources and services via domain application grids
Business model defined between CNGrid and domain application grids
Accounting Billing policies
Promote usage of CNGrid
Exploring sustainable development of CNGrid
业务逻辑层
文件管理 应用社区管理 作业管理 用户管理
流程管理资源管理 交易管理 问题管理
GOS层作业批处理
认证服务
元信息服务
社区管理数据传输 记帐服务
消息服务 元调度服务
用户映射
资源层 CNGrid资源
上海超算
社会资源数据资源
魔方(曙光5000A)
…
西安交大
数据资源…
…...
数据资源…
用户访问层工业社区
社区支撑环境
监控服务
工业社区portal
Domain applications (Grid)
Drug Discovery Weather forecasting Scientific data Grid and its application in research Water resource Information system Grid-enabled railway freight Information system Grid for Chinese medicine database applications HPC and Grid for Aerospace Industry (AviGrid) National forestry project planning, monitoring and
evaluation
Status of e-Infrastructure
Still far behind in many aspects Especially weak in applications Need multi-disciplinary research Shortage in cross-disciplinary talents
Sustainable development is crucial Lack of regular budget for e-Infrastructure Always competing funding with other
disciplines
The 12th 5-year plan
China’s high-tech program has identified priority topics in both HPC and cloud computing
A key project on cloud computing has been launched “Key technologies and systems of cloud
computing (1st phase) Network operating systems Network search engines Network based language translation
Cloud system management Prototype cloud systems
The 12th 5-year plan (cont’d)
A new key project on “high productivity computer and application service environment” launched (2011-2015)
Emphasis on balanced development on high productivity computers, application environment, and HPC applications
Cooperation with EU and US
EU FP6/FP7 EUChinaGRID EchoGRID Bridge Chain EPIKH Chain-Read
US Cooperation with the Condor team China-US cooperation on software (to be initiated)
Extreme scale software Emerging software architechtures Trustworthy software
Interests on international testbed
Experiments and evaluation on new technologies
Coordinating research efforts and exchanging R&D experiences
Joint development on some topics with common interests
Issues to be addressed
Interoperability of existing software and development of new software for testbed
Cost/Funding Network bandwidth
Thank you!
Top Related