June 21, 2019 NERSC Data Ecosystem Overview Data ...
Transcript of June 21, 2019 NERSC Data Ecosystem Overview Data ...
![Page 1: June 21, 2019 NERSC Data Ecosystem Overview Data ...](https://reader030.fdocuments.in/reader030/viewer/2022020620/61e4836735347c6b093fe140/html5/thumbnails/1.jpg)
PrabhatData & Analytics Services Group
June 21, 2019
NERSC Data Ecosystem Overview
![Page 2: June 21, 2019 NERSC Data Ecosystem Overview Data ...](https://reader030.fdocuments.in/reader030/viewer/2022020620/61e4836735347c6b093fe140/html5/thumbnails/2.jpg)
Afternoon Schedule1:40 pm Data Transfer Shreyas Cholia
2:10 pm File Systems Jialin Liu
2:30 pm I/O Best Practices Quincey Koziol
2:50 pm Break
3:10 pm Python and Jupyter Rollin Thomas
3:30 pm Shifter Rollin Thomas
3:50 pm Deep Learning Prabhat
4:10 pm End
![Page 3: June 21, 2019 NERSC Data Ecosystem Overview Data ...](https://reader030.fdocuments.in/reader030/viewer/2022020620/61e4836735347c6b093fe140/html5/thumbnails/3.jpg)
![Page 4: June 21, 2019 NERSC Data Ecosystem Overview Data ...](https://reader030.fdocuments.in/reader030/viewer/2022020620/61e4836735347c6b093fe140/html5/thumbnails/4.jpg)
Phase I: 2388 x 32-core Intel Xeon “Haswell” 128 GB DDR4Phase II: 9688 x 68-core Intel Xeon Phi “KNL” 96 GB DDR4 + 16 GB MCDRAM
Gerty Cori: Biochemist and first American woman to win a Nobel Prize in science
Cori Brings HPC & Data Together
![Page 5: June 21, 2019 NERSC Data Ecosystem Overview Data ...](https://reader030.fdocuments.in/reader030/viewer/2022020620/61e4836735347c6b093fe140/html5/thumbnails/5.jpg)
Production Data StackCapabilities Technologies
Data Transfer + Access
Workflows
Data Management
Data Analytics
Data Visualization
TaskFarmer
![Page 6: June 21, 2019 NERSC Data Ecosystem Overview Data ...](https://reader030.fdocuments.in/reader030/viewer/2022020620/61e4836735347c6b093fe140/html5/thumbnails/6.jpg)
Cori’s Data-Friendly Features
Cray DataWarp:Burst Buffer forI/O acceleration
12 32-core Haswell500 GB Login Nodes
768 GB “bigmem”Haswell Nodes
Pipeline/WorkflowManagement Nodes
JupyterNotebook
Node
Serial QueueShared-node Queue
Transfer Queue
Real-Time Queues for Co-Scheduling
w/Experiments
Interactive Queue:64 Nodes x 4 Hours
ContainerizedEnvironments
External Network Access to/fromCompute Nodes
Streaming Data to Compute Nodes
![Page 7: June 21, 2019 NERSC Data Ecosystem Overview Data ...](https://reader030.fdocuments.in/reader030/viewer/2022020620/61e4836735347c6b093fe140/html5/thumbnails/7.jpg)
Asks
● Please engage with NERSC staff members○ Provide feedback, critique○ Tell us about interesting science problems!
![Page 8: June 21, 2019 NERSC Data Ecosystem Overview Data ...](https://reader030.fdocuments.in/reader030/viewer/2022020620/61e4836735347c6b093fe140/html5/thumbnails/8.jpg)
Questions? Comments?