Post on 14-Jan-2016
description
Grid Status and Perspective iGrid Status and Perspective in Chinan China
Sun GongxingIHEP, Beijing
Main Grid Projects in ChinaMain Grid Projects in China
NHPCE—the National High Performance Computing Environment (MOST, 863 programme)
VEGA—Grid Project around Dawning SuperServer (ICT,CAS).
SDG—the Scientific Data Grid Project (CNIC, CAS)
ChinaGrid—the MOE Project. HEP Data Grid (currently IHEP).
Network Infrastructure Network Infrastructure Overview in ChinaOverview in China
Overview of International Overview of International Network Links of ChinaNetwork Links of China
CN-HK CERNET/HARNET 2Mbps CN-HK C&SNET 45Mpbs CN-JP CERNET 10Mpb
s CN-US CERNET 10Mpbs CN-US CERNET 200Mpbs CN-UK CERNET 2Mpbs CN-US CSNET 55Mpbs CN IEEAF 10.6Gbps
1 Network Infrastructures for 1 Network Infrastructures for Science and Technology in ChinaScience and Technology in China
The CSTNET— the China Science and Technology Network
- One of the earliest networks in China and the first full-functional interconnection with U.S - 55Mbps international link (upgrade to 100Mbps soon). - Topology as Fig. 1
2 NSFCNET—Natural Science Fo2 NSFCNET—Natural Science Foundation of China Networkundation of China Network
Sponsor: National Science Foundation of China (NSFC)
- A test bed for advanced high speed network research, native multicast enabled
- 6 main nodes (all in Beijing) CNIC of CAS, THU, PKU, BUAA, BUPT,
NSFC - Topology is as Fig. 2.
3 The Internet2 Testbed3 The Internet2 Testbed
• Support scientific research, development and test of next generation network.
- High-speed connection with VBNS and Abiene (connected to STARTAP in Sep,2000) .
- 2.5/10Gbps DWDM Backbone ( dual rings). - Will inter-connect 200 nodes, including 10
0 universities and 100 institutes.
- Networking infrastructure is a part of the effort, the more important is development of applications, particularly grid-enabled applications.
- Funding 400 million Yuan (~40M US$).
4 CAINONET—China 4 CAINONET—China Advanced Info. Optic NetAdvanced Info. Optic Net
A 863-300 key projectself-owned technologies and products for
next-generation inter-networksIP/DWDM , 2.5G. Topology as Fig. 3
Overview of Grid Projects Overview of Grid Projects in China in China
1 The VEGA Project1 The VEGA ProjectDesign and implement Grid level system
software.Grid oriented super-server—the Dawning
4000.Service Grid—Providing various services to
users, for instances, computation, messaging, knowledge services.
Architecture, Grid Operating system, application development, etc.
ClientGrid browserGrid://……
Vega Grid Architecture
Resource router
Grid server
Grid server
Grid server
Vega ApplicationsVega Applications
Case 1Global Grid batch system.Applications based on the GOS APIs.No center control.Shell commands: gsub, gstat, gkill, etc.All registered resources are available for us
ers, CPU, disk spaces, networks, data, software, sercices…..
Global Batch System in VegaGlobal Batch System in Vega
On-line Transaction SystemOn-line Transaction System
Case 2:4 different basic services registered to Grid.
- Whether forcasting.
- Airline ticket booking.
- Sigh spot ticket booking.
- Charging. Put these services into a special application.
AN Online TransactionAN Online Transaction
2 The China National Grid2 The China National GridThe National High Performance Computing En
vironment—the NHPCE.A key 863 programme (MOST).Including 9 sites for HPC in the Grid. - Interconnected them with available networks ( Cernet & NSTnet) - equipped each site with Dawning 2000/3000, Galaxy 3(20Gflops), Sunway 1(460Gflops), PC-cluster(8Gflops).
NHPCE Grid Portal (User Mgt)NHPCE Grid Portal (User Mgt)
NHPCE Grid Portal (Job Submit)NHPCE Grid Portal (Job Submit)
NHPCE Grid Portal(Resource Mgt)NHPCE Grid Portal(Resource Mgt)
NHPCE Grid Portal(System Monitoring)NHPCE Grid Portal(System Monitoring)
NHPCE Grid Portal (utilities)NHPCE Grid Portal (utilities)
NHPCE ApplicationsNHPCE Applications
Weather forecasting. Petroleum reservoir simulation. Bio-information database and applications. Numerical wind tunnel simulation. Automobile collision simulation. Ship structure analysis. National scientific databases and applications. Digital library.
Audio
Notebook HPC
BP, Mobile phone
Video Camera
Tel. Game
TV
DVD
PC
Internet
Gigabit IP Network
Node Node Node Node
DBInfo lib.
Instr.
NHPCE
3 The SDG Project3 The SDG ProjectBy Dec. 2002
– 31 member institutions– 217 databases– 3.2 TB
Classification– numerical: 46%– text: 18%– spatial: 22%– multimedia: 14%
SDG Universal Metadata TooSDG Universal Metadata Too• many disciplines in SDG many disciplines in SDG similarly many or more similarly many or more metadata standards. it’s not good for us to develop a tool fmetadata standards. it’s not good for us to develop a tool for every metadata schema individually.or every metadata schema individually.
•input metadata for existing databases is more bothersome,input metadata for existing databases is more bothersome, so a ease-to-use tool might be in practice. so a ease-to-use tool might be in practice.
•input: a metadata schema (xml DTD).input: a metadata schema (xml DTD).
•output: Web-based, customizable UI.output: Web-based, customizable UI.
•LDAP-based Storage.LDAP-based Storage.
•Management functions (add, delete, modify and query) , Management functions (add, delete, modify and query) , back-end is MDIS.back-end is MDIS.
SDG Universal Metadata ToolSDG Universal Metadata Tool
MDIS(LDAP)
interim XML
MD schema
Userpage
Process(Java bean)
XML engine
install & configure
universal, extensible
customizable
-metadata is tree-like and more flexible than fix-column tables, difficult to deal with on web UIuse xml files to store interim results-use xml files to store interim results
ApplicationsApplications
Virtual Observatory– Astronomical data is huge & well documented– Most is online & sharable– So, Internet is becoming the world’s best
telescope– Data integration and federation
(by many different instruments from many different places and many different times)
– Ease-to-use for astronomers– LAMOST (aperture: 4m, by 2004)– Collaboration between
NAO and CNIC
4 The China Grid4 The China Grid
it is being proposed now, and will be founded by MOE ( the Ministry of Education), It’s bandwidth is 2.5Gbps, connect 100 universities across China.
And to be inter-connected to NFSCNET.Discussion is under way, When? How?
5 HEP DataGrid in China5 HEP DataGrid in China
(1) BES experiment: the tau-charm physics International collaboration with 18 domestic universities and 4 foreign universities.
The major upgrade program BEPCII has been approved by Chinese Government.
Increasing Luminosity by a factor of 100 produce about 3 PB data in 3-5 years.
(2) YangBaJing Cosmic-ray Lab. At Tibet China-Japan collaboration: air-shower arra
y detector since 1990 China-Italy collaboration: RPC carpet detec
tor of 10000 m2 , under construction. several domestic and foreign universities pa
rticipate in both experiments Data Volume: about several hundreds of TB
data.
(3)Experiments of LHC: CMS and Atlas
- China physicists are participating in MC simulations, and will participate in physics analysis.
- build Tier-2 Regional Center at least.
- NSFC delegation visited CERN to discuss the collaboration in April this year.
(4) Belle and Babar(5) Alpha Magnetic Spectrometer (AMS)
The IHEP Campus Grid The IHEP Campus Grid Building a Campus Grid Computing Environment a
t IHEP). Making full use of 7 PC Farms built at IHEP, which r
un separately for various experiments which leads to inefficient utilization of these PC Farms.
Topology as Fig. IhepGrid monitoring system. Rebuilding higher bandwidth connection among th
ese PC Farms.
Topological map of IHEP Computing Topological map of IHEP Computing EnvironmentEnvironment
The PC Farms Hardware ConfiguratioThe PC Farms Hardware Configuration at Computing Centern at Computing Center
PC Farm OS No. CPUs Batch System
Storage
hepfarm Linux RH7.2
23×Intel PIII
OpenPBS 2. 4
4TB SCSI
YBJfarm Linux RH7.2
32×AMD MP
OpenPBS 2.4
1.92TB IDE
LHCfarm Linux RH7.2
32×AMD MP
OpenPBS 2.4
1.28TB IDE
HP Farm HP-UX 12 ×HP-PA
NQS
The CMS and Atlas PC FARMThe CMS and Atlas PC FARM
RAID
monitor
The IhepGrid Monitoring SystemThe IhepGrid Monitoring System
China HEP Top CA China HEP Top CA
The Connection of PC Farms at IHEP The Connection of PC Farms at IHEP Computing CenterComputing Center
Components of Campus Grid ComputiComponents of Campus Grid Computing Environment at IHEPng Environment at IHEP
National HEP DataGrid TestbedNational HEP DataGrid Testbed
NFSC gives support for HEP application testbed.
there are 2 or 4 universities and IHEP to join the project, including PKU, SDU, THU, USTC .
Fund about 1.5million CNY (near 20USD).Hopefully, it is able to enhance the internati
onal collaboration of China.
The On-going and Future WorkThe On-going and Future Work
– Develop the Web-based portal of HEP and Web services in China.
– And Develop various HEP Grid-enabled applications.
– Make proposal for building HEP DataGrid across China and join Lambda ring or the like as a node.
– And Regional Center Tier-2 for collaboration CMS and ATLAS of LHC in China.
– ……
China HEP DataGrid in the FutureChina HEP DataGrid in the Future
BES On line system
Offline processor farmYBJ
CERN CMS & ATLAS
IHEP Computer Center
USTCTHUSDUpku
CASTOR
Physics data cache
Tier 0
Tier 2
Tier 3
All data from experiments
Goes to IHEP Computing Center
This diagram onlyShows HEPDataGrid in China
China HEP DataGrid ArchitectureChina HEP DataGrid Architecture
Info discovery
Job Mgt
Authentication
User Profilemgt
GRAM GSIFTPGRIS
Data Service
Networkservice
NWSComputeService
GIIS/GRISWeb
browser
USER
Grid
Portal Grid
The Grid Prospect in China The Grid Prospect in China
NFSC organized the relevant officials and scientists to visit CERN, and seek the roadmap of grid development in China.
And recently computer scientists and physicists …. sit down together to discuss how to move the China grid projects forwards(organized by NFSC).
Conclusion is China should concentrate on Grid-based applications at first, and a few of nationwide testbeds need to be built, the first is HEP DataGrid one.