SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.
-
Upload
martina-nash -
Category
Documents
-
view
212 -
download
0
Transcript of SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.
![Page 1: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/1.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Inca TeraGrid Status
Kate EricsonNovember 2, 2006
![Page 2: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/2.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Outline
• Inca 2 overview
• CTSSv3 Inca deployment
• Current views of data
• Future work
![Page 3: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/3.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Inca
Inca is a framework for the automated testing, benchmarking and monitoring of Grid resources
Inca:• schedules execution of information gathering scripts (reporters)
• collects, archives, publishes data
![Page 4: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/4.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Motivation for Inca 2
• Inca 1 was a prototype
• Experiences using Inca:• Testing is an iterative refinement process
• Testing is a trade-off between freshness of data and impact on resource
• Needed more scalable and flexible data storage
![Page 5: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/5.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Inca 2 Feature: Improved installation and configuration
control• GUI tool for centralized administration
• Reporter sharing via repositories• Proxy management via MyProxy
Incat screenshot
![Page 6: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/6.jpg)
Inca 2 feature: Full Report Archiving
Inca report - completed Inca report - error
Inca 1 archivingInca 2 archiving
… <body>
<benchmark> <ID>download</ID>
<statistic>
<ID>bandwidth</ID>
<value>105.26</value>
<units>kb/sec</units> </statistic>
</benchmark></body><exitStatus>
<completed>1</completed></exitStatus>…
… <body></body><exitStatus> <completed>0</completed> <errorMessage>wget
command failed: --15:29:23-- http://www.nosite/
=> `/dev/null'Resolving www.nosite...
failed: Host not found. </errorMessage> </exitStatus>…
![Page 7: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/7.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Inca 2: Additional features
• Flexible querying interface - relational db backend (postgres for TG)
• Profile reporter system usage
• Inca components communicate using SSL
![Page 8: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/8.jpg)
Resource 2Resource 1 Resource N
…reportermanager
reportermanager reporter
manager
reporterrepository
agent1. The user creates a suite
using incat and submits it to the agent
suite
depot2. The agent
- fetches reporters from the reporter repository - creates a reporter manager on each resource- sends the suite and reporters to each reporter manager.
R
RR
R
3. Each reporter manager executes reporters according to its schedule and sends results (reports) to the depot
4. Data consumers display collected data (reports) by querying the depot
data consumersincat
suite suitesuite
suite
RR
Inca 2 Architecture
![Page 9: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/9.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Outline
• Inca 2 overview
• CTSSv3 Inca deployment
• Current views of data
• Future work
![Page 10: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/10.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Inca 2 TeraGrid Deployment: CTSSv3
32 packages: Globus, SRB, Condor-G, MPICH, Softenv, etc.
123 possible Inca tests:45 unit or functionality tests
• Services: BLAS, uberftp, etc.
29 compatible version tests • Version: HDF, Condor-g, etc.
49 cross-site functionality tests• Cross-site: Globus GRAM, GridFTP, gsissh
![Page 11: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/11.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
List of Running Tests
![Page 12: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/12.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
List of Running Tests (cont)
![Page 13: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/13.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Outline
• Inca 2 overview
• CTSSv3 Inca deployment
• Current views of data
• Future work
![Page 14: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/14.jpg)
Current Pages Linked from Repo
![Page 15: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/15.jpg)
SWpackages
Resources
Software Stack Detail View
![Page 16: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/16.jpg)
Software Stack Summary View
![Page 17: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/17.jpg)
Single Result View
![Page 18: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/18.jpg)
Single Result View (cont.)
![Page 19: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/19.jpg)
Cross-site Tests
![Page 20: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/20.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Security Status Page
![Page 21: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/21.jpg)
Grid Jobs Status Page (Users)
![Page 22: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/22.jpg)
Grid Jobs Status Page (CA)
![Page 23: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/23.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Outline
• Inca 2 overview
• CTSSv3 Inca deployment
• Current views of data
• Future work
![Page 24: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/24.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Softenv
Softenvkeys
Resources
![Page 25: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/25.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Default Environment
Environvariable
s
Resources
![Page 26: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/26.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Historical Graphs
![Page 27: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/27.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Historical Graphs
![Page 28: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/28.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
Error tracking over time
![Page 29: SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f315503460f94c4cb49/html5/thumbnails/29.jpg)
SAN DIEGO SUPERCOMPUTER CENTER
More information
• Inca Web Page:http://inca.sdsc.edu
• TeraGrid Inca Status Pageshttp://repo.teragrid.org
• Email• [email protected]