TeraGrid Arch MeetingRP Update: ORNL/NSTG
1 ORNL_RP_Update_080801
TeraGrid Arch MeetingRP Update: ORNL/NSTG
August 1, 2008
John W. Cobb
Outline
2 ORNL_RP_Update_080801
• NSTG Purpose• SNS Background and Status• Neutron Science Portal• Progress Report on Neutron Science Portal• TeraGrid integration with Neutron Science Portal• NSTG Cluster Operations update
NSTG Purpose
3 ORNL_RP_Update_080801
• NSTG = Neutron Science TeraGrid Gateway• Goals. Seek to build/improve
• Bridging: between SNS and TeraGrid• Facility integration (especially large science facilities)• Neutron scattering science focus area
• Instruments/ExperimentsInst/Exp was left out of new IPP, missing WBS areaswere remapped to primarily {HPC-ops, SGW, EOT} areas.
• Close association with Spallation Neutron Source (SNS)• Other interests:
• Other neutron sources (LENS, IPNS, NCNR, ISIS, J-SNS, ANSTO/OPAL, …• Other large experimental user facilities (Diamond, APS, …• Discipline based SW efforts (DANSE, …)• CI software efforts (CIMA, …
SNS Background and Status
4 ORNL_RP_Update_080801
•SNS – Spallation Neutron Source (http://neutrons.ornl.gov)• Located in Oak Ridge• Pulsed neutron source: 1.4 MW, 1.4 GeV proton beam onto a mercury target. Up to 24 beam lines. • Construction 1999-2006• Current Operations
• 6 instruments in SNS user program http://neutrons.ornl.gov/instrument_systems/sns_instruments.shtml
• Power ramping up• User days increasing http://neutrons.ornl.gov/proj_status/sns_long_schedule.shtml
• High Flux Isotope Reactor now also part of org. http://neutrons.ornl.gov/hfir/hfir_facilities.shtml
Neutron Science Portal
5 ORNL_RP_Update_080801
• Location: http://neutronsr.us/portal• Developed by SNS Software Group (ASG)• SNS-ASG is collaboration contact point for NSTG• SNS ASG highly leverages NSTG effort• NS Portal uses wide mix of back-end CI, including TG
• Instrument local computers• ASG centralized servers and storage• OIC (ORNL’s version of campus clusters)• TG via NSTG• User’s desktops and home machines (portal thick client under development via SBIR with TechX Corp, Buffalo office)
6 Cobb_TeraGrid_SC07
SNS data access via portal(Reduction, analysis, and simulation as well)
Turnkey solutions are being requestedby users and user groups
Problem SNS approach
Providing advanced tools in an easy fashion while retaining customizability
Neutron Science User Portal Totally in Java
Acknowledgement: S. Miller and SNS ASG;J. Kohl, S. Vazhkudai and ORNL/CSM division)
Function deployment order First: Data acquisition
and storage/stewardship
Then: Reduction, analysis, simulation, proposalsfor one-stop access
NS Portal architecture: (stylized)“flows from requirements”
7 Cobb_TeraGrid_SC07
NS Portal Identity Management
8 Cobb_TeraGrid_SC07
• Identity created and maintained by SNS facility• XCAMS – an external implementation of ORNL internal Unified accounts management system• “X” for External
(inadvertent, unfortunate Google search space collisions)• X - lower identity proofing, suitable for user facilities (NIST level 1)• NS portal maps identity (as needed) to access other CI resources using the “Application Manager” subsystem for execution orchestration.• For TeraGrid integration, NS portal invokes “Jimmy Neutron” Community access• Ack: Lynch, Vazhkudai, Kohl, Trater, Miller
NS Portal and TG Community Accounts
9 Cobb_TeraGrid_SC07
• TeraGrid jobs executed in community account• NS Portal application manager archives in DB community user “reach back” according to {SGW,SEC} WG policy• TG Community account use from NS portal
• Installed for:• McStas instrument simulation• Generic (NL2SOL) fitting service
• Future possible installation for:• Distributed data reduction• Others
• Current TG use • Increasing• Still dominated by development experimental use• SU use low, job count higher
• Ack: Lynch, Ren, Kohl, Miller
Progress Report on Neutron Science Portal Use
10 ORNL_RP_Update_080801
Ack: S. Miller & SNS ASG
Number of Portal Visits - 2008
300
400
500
600
700
800
900
1000
Jan Feb Mar Apr May Jun Jul
Number of Visits -2008
Total Number of Compute Jobs - 2008
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
Jan Feb Mar Apr May Jun Jul
Nu
mb
er o
f Jo
bs
Total Number ofCompute Jobs - 2008
Total Number of Users - 2008
100
120
140
160
180
200
220
240
260
280
DecJa
nFebM
ar AprM
ay Jun Ju
l
Months - 2008
Nu
mb
er o
f U
sers
Total Number of Users
SNS Facility Data Storage
End User Network Quality of Service (Not TG network)
Within ORNL
At LENS
From Home
From Hotel in Bloomington
Informs decision on portal versus Thick client access
Neutron Science Discipline Science Areas
13 ORNL_RP_Update_080801
• Full instrument/experiment simulation studies conducted by E. Farhi (ILL)• Emerging interest by neutron imaging instrument design team (particularly data intensive). CI requirements being solicited• Collaboration on diffused scattering data analysis project to improve software tools
Other NSTG areas
14 ORNL_RP_Update_080801
• ESG (with NCAR) working to facilitate ESG data transfer over TG network between ORNL and NCAR (2 important ESG sites)• OSG.
• NSTG cluster available as both TG and OSG resource to demonstrate feasibility.• Motivated by “Should I use TG or OSG” question from a Neutron Scattering software project. A: Either, we support both.• NSTG Status now “green” after a period of red following sys-admin transition
NSTG Cluster Operations Update
15 ORNL_RP_Update_080801
• Usage update:• Breckenridge meeting noted that NSTG cluster usage was increasing. Suspected cause was overflow from TG oversubscription.• Recent usage trends by non neutron science related users down• Suspected explanation: TeraGrid resources much larger
• Operations status : still good ( but – we lost /users due to NFS problem 2 weeks ago)• Some system Admin changeover issues still linger - thanks• Ack : Giles
Top Related