Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research...
-
Upload
dale-hodges -
Category
Documents
-
view
214 -
download
1
Transcript of Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research...
![Page 1: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/1.jpg)
Report on CSU HPC (High-Performance Computing)
Study
Ricky Yu–Kwong KwokCo-Chair, Research Advisory Committee
August 18, 2008Presented to CSU CRAD
![Page 2: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/2.jpg)
2
Outline
1. Motivation for the Study2. Interpretations of Findings3. Summary of Findings4. Representative HPC Activities5. CoGrid Job Submission System6. HPC Forum (9/3/2008)
![Page 3: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/3.jpg)
3
Motivation for the Study
HPC is a 3rd way of conducting research and discovery
To assess current activities and future opportunities
To look at current systems at CSU
To make CSU more competitive in the research arena
Study Motivation
![Page 4: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/4.jpg)
4
Interpretations of Findings
37 responses 26 departments, 31 research areas
HPC is “hot” at CSU!
1/3 of users have no immediate access to HPC resources rely on other departments within CSU OR other organizations outside CSU may be subject to strict resource restrictions
Interpretations of Findings
![Page 5: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/5.jpg)
5
Interpretations of Findings
Scattered resources
Majority of users pessimistic about their HPC needs being met in future
Advanced visualization needs require enhancement
Need to “advertise” GRAD 510/511 courses
Space limitations for HPC hardware???
Consultancy?
Affinity groups?Interpretations of Findings
![Page 6: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/6.jpg)
6
Summary of Findings
37 responses 26 departments, 31 research areasBesides CoGrid node, Bioinformatics cluster and HP Half Dome system, 8 additional HPC resources, e.g., (see Table 2 in the Report) CIRA – 32-processor cluster Chemical and Biological Engineering – 32-node
Linux cluster Mathematics – 42-node cluster Some more new resources to come (e.g., new
HP donations)Summary of Findings
![Page 7: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/7.jpg)
7
Usage of HPC
Summary of Findings
![Page 8: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/8.jpg)
8
Nature of Usage
Summary of Findings
![Page 9: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/9.jpg)
9
Algorithms Used
Summary of Findings
![Page 10: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/10.jpg)
10
HPC Resource Used
Summary of Findings
![Page 11: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/11.jpg)
11
HPC Needs Met?
Current Future
Summary of Findings
![Page 12: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/12.jpg)
12
Visualization Needs Met?
Current Future
Summary of Findings
![Page 13: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/13.jpg)
13
Compiler Used
Summary of Findings
![Page 14: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/14.jpg)
14
Language Used
Summary of Findings
![Page 15: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/15.jpg)
15
Be Involved in Future HPC Activities?
Summary of Findings
![Page 16: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/16.jpg)
16
Aware of GRAD 510/511?
Summary of Findings
![Page 17: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/17.jpg)
17
Required Follow-Up?
Summary of Findings
![Page 18: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/18.jpg)
18
Presentation Outline
1. Motivation of the Study2. Interpretations of Findings3. Summary of Findings4. Representative HPC Activities5. CoGrid Job Submission System6. HPC Forum
![Page 19: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/19.jpg)
19
Small-angle X-ray Scattering (SAXS)
To understand biological systems
Determine 3-D structure
Monte Carlo simulations for data modeling
Computationally intensive HPC
Representative HPC Activities
![Page 20: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/20.jpg)
20
Genomic Analysis
Study the evolution of functional DNA sequences
Comparative phylogenomic analysis
Highly computationally intensive cluster of Linux machines with 8 – 32 nodes
Representative HPC Activities
![Page 21: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/21.jpg)
21
Proteomics
Large-scale study of proteins
Searching methods to analyze mass spectrometry data
Sequence matching
Access to large databases
Representative HPC Activities
![Page 22: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/22.jpg)
22
Pattern Analysis
Investigate unexplained phenomena from high-dimensional, massive data sets
Mathematical theory efficient algorithms exploring, understanding, modeling massive data sets
PAL lab (Pattern Analysis Laboratory)
42-node cluster with 156 GB total memory, over 5 TB disk storage
Representative HPC Activities
![Page 23: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/23.jpg)
23
CoGrid Job Submission System
Sharing of geographically distributed computational resources
Batch processing of jobs Job description Resource requirements Execution Monitoring
CoGrid
![Page 24: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/24.jpg)
24
HPC Forum (9/3/2008)
1. Introduction and ISTeC Overview: HJ
2. Background on CSU’s HPC History and Activities: Pat Burns
3. Findings from ISTeC’s HPC Survey: Ricky
4. Advanced Networking Capabilities at CSU: Scott Baily, Director of ACNS
5. Educational Activities in HPC: Sanjay Rajopadhye and Wim Bohm (Computer Science)
6. Plan for an ISTeC Visualization Facility: HJ
7. NERSC and the INCITE Program as a Viable Alternative: Josh Ladd (Mathematics)
8. Open Discussion – Faculty Needs and Directions
![Page 25: Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18,](https://reader036.fdocuments.in/reader036/viewer/2022062719/56649ec05503460f94bcac89/html5/thumbnails/25.jpg)
25
Summary
Motivation: To look at current systems in CSU and future HPC needs
Presented interpretations and findings of the survey
Discussed representative HPC activities
Introduced CoGrid job submission system, as a possible campus-wide resource management model
HPC Forum for further discussions