Plans for new crystals for H8 and SPS (IHEP) V. Maisheev for IHEP group.
IHEP Site Status Report
description
Transcript of IHEP Site Status Report
IHEP Site Status ReportIHEP Site Status Report
IHEPCCC MeetingIHEPCCC Meeting
Gang ChenGang Chen
June 28, 2007 June 28, 2007
Gang Chen/CC/IHEP 23/4/21 - 2
Requirements at Requirements at IHEPIHEP
• LHC: Tier-2LHC: Tier-2 • to support ATLAS and CMS. to support ATLAS and CMS.
• BEPC: BES-IIIBEPC: BES-III • Start to take data in the end of 2007Start to take data in the end of 2007• 5 PB totally in next 5 years5 PB totally in next 5 years• 2000 kSpecInt2K2000 kSpecInt2K
• YBJ-ARGO Cosmic Ray ObservatoriesYBJ-ARGO Cosmic Ray Observatories• 240 TB/year240 TB/year• 400 kSpecInt2k400 kSpecInt2k• 155 Mbps dedicated link from Tibet to Beijing155 Mbps dedicated link from Tibet to Beijing
• DayaBay Neutrino ExperimentDayaBay Neutrino Experiment• 20 TB disk, 150-600 TB tape20 TB disk, 150-600 TB tape• 100 kSpecInt2k up to 2009100 kSpecInt2k up to 2009• 155 Mbps dedicated link 155 Mbps dedicated link
• Synchrotron Radiation ApplicationsSynchrotron Radiation Applications• ……..
Gang Chen/CC/IHEP 23/4/21 - 3
CPU and DiskCPU and Disk• ~500 ~500 CPU/cores installed. CPU/cores installed.
• 1U rack mounted and IBM blades1U rack mounted and IBM blades• Shared by experimentsShared by experiments• Heavily loadedHeavily loaded
• ~100 TB disk space~100 TB disk space• Most are SATAMost are SATA• Directly attached to serversDirectly attached to servers
• New resources will be purchased in the New resources will be purchased in the yearyear
Gang Chen/CC/IHEP 23/4/21 - 4
Mass StorageMass Storage• IBM TS3584 tape library IBM TS3584 tape library
• one base frame + one exp. Frame initially one base frame + one exp. Frame initially • 4 LTO drives4 LTO drives• To be expanded to full configuration next To be expanded to full configuration next
year or lateryear or later
• CASTOR 1.7 deployed on a test CASTOR 1.7 deployed on a test bed, with a ADIC tape librarybed, with a ADIC tape library
•Moving to CASTOR 2 for the Moving to CASTOR 2 for the production systemproduction system
Gang Chen/CC/IHEP 23/4/21 - 5
ImplementationImplementation
• Operating System: SLC 3.08 currentlyOperating System: SLC 3.08 currently• Going to SLC 4Going to SLC 4
• Computing resource managementComputing resource management• Batch system: Torque/LSF, Batch system: Torque/LSF, • Monitoring: GangliaMonitoring: Ganglia• login service: load-balanced interactive login service: load-balanced interactive
farmfarm
• Automated installation: QuattorAutomated installation: Quattor• Storage managementStorage management
• Home dir.: AFSHome dir.: AFS• Data dir.: NFS/RFIOData dir.: NFS/RFIO• Mass storage system: CASTORMass storage system: CASTOR
Gang Chen/CC/IHEP 23/4/21 - 6
Networking (1)Networking (1)•Gloriad: China-US-EuropeGloriad: China-US-Europe• Too Big RTT: 350 msToo Big RTT: 350 ms•~5MB/s, multi-stream transfer ~5MB/s, multi-stream transfer
between CC-IN2P3 and IHEPbetween CC-IN2P3 and IHEP
Gang Chen/CC/IHEP 23/4/21 - 7
Networking (2)Networking (2)• ORIENT/TEIN2: China-EuropeORIENT/TEIN2: China-Europe• Better RTT: 170 msBetter RTT: 170 ms• 16-26MB/s, multi-stream 16-26MB/s, multi-stream
transfer between CC-IN2P transfer between CC-IN2P and IHEPand IHEP
• Switched to TEIN2 last week!Switched to TEIN2 last week!
• Network is being improved, Network is being improved, better performance is better performance is neededneeded
2.5Gbps
Gang Chen/CC/IHEP 23/4/21 - 8
Infrastructure (1)Infrastructure (1)• 450 450 mm22 computing room computing room
refurbished in 2006refurbished in 2006•New Cooling New Cooling •New Power Supply: 0.5 MWNew Power Supply: 0.5 MW•New UPSNew UPS
Gang Chen/CC/IHEP 23/4/21 - 9
Infrastructure (2)Infrastructure (2)• Computing RoomComputing Room
Gang Chen/CC/IHEP 23/4/21 - 10
Infrastructure (3)Infrastructure (3)• Part of power supply and UPSPart of power supply and UPS
Gang Chen/CC/IHEP 23/4/21 - 11
Tier-2 Tier-2 • A site to support ATLAS and CMSA site to support ATLAS and CMS
• CE: Computing ElementCE: Computing Element• SE: Storage ElementSE: Storage Element• FTS: File Transfer ServiceFTS: File Transfer Service• LFC : LCG File CatalogLFC : LCG File Catalog• VOMS: VO Membership ServiceVOMS: VO Membership Service
• Resources Very LimitedResources Very Limited• funding not yet fully securedfunding not yet fully secured• Discussing with MoST and NSFC, Discussing with MoST and NSFC,
Gang Chen/CC/IHEP 23/4/21 - 12
Planned ResourcesPlanned Resources
20062006 20072007 20082008 20092009 20102010
CPU CPU kSI2KkSI2K
300300 1500?1500? 35003500 40004000 40004000
Disk TBDisk TB 8080 350?350? 500500 800800 10001000
Tape TBTape TB 2020 800800 28002800 38003800 48004800
For LHC, BES, etc.For LHC, BES, etc.
Gang Chen/CC/IHEP 23/4/21 - 13
SummarySummary• A lot of things to be done for A lot of things to be done for
funding funding • Have to work with MoST and NSFCHave to work with MoST and NSFC
• Better global network is needed. Better global network is needed.
• Voice from international Voice from international community, like IHEPCCC, could community, like IHEPCCC, could help to push things forward.help to push things forward.