Post on 25-May-2020
1
Jaime E. Combariza, PhDDirector
Maryland
Advanced
Research
Computing
Center
HHPC@JHU
IDIES Annual SymposiumOctober 17 ,2014
Data Lifecycle
2
IDIES Annual SymposiumOctober 17 ,2014
Storage
Preservation
Processing
Reuse
Publication
Analysis
Sharing
H
P
C
REPOSITORY
Generation
IDIES Annual SymposiumOctober 17 ,2014
Collecting Big Data
3
IDIES Annual SymposiumOctober 17 ,2014
High Res. telescopes
Satellites
Social Networks
FinancialMarkets
Brain Science
PredictiveComputational Science
Smart Networks
Virtual Libraries
HumanGenomics
Large Scale Experiments
IDIES Annual SymposiumOctober 17 ,2014
Data-Rich Environment (Effects)
4
IDIES Annual SymposiumOctober 17 ,2014
Eco-Informatics Biomedical Informatics
Astro-Informatics Data Driven Applications
Digital Humanities
IDIES Annual SymposiumOctober 17 ,2014
Opportunities
5
IDIES Annual SymposiumOctober 17 ,2014
Innovation, Competition and Productivity
IDIES Annual SymposiumOctober 17 ,2014
What’s being done
6
IDIES Annual SymposiumOctober 17 ,2014
• WH 2012 200M R&D for big data
• NSF & NIH (many programs)
• Gordon and Betty Moore Foundation
• Many schools VIDA, DI2,
• States, e.g.: Mass
• Xsede (9/2/14)
IDIES Annual SymposiumOctober 17 ,2014
HPC Ecosystem that supports computationally-intensive and data centric computing
What’s Maryland doing?
7
IDIES Annual SymposiumOctober 17 ,2014
Investment
IDIES Annual SymposiumOctober 17 ,2014
Data center and data-rich environment
9
IDIES Annual SymposiumOctober 17 ,2014
Infrastructure Network
Compute Engine
Storage
Cyberinfrastructure
IDIES Annual SymposiumOctober 17 ,2014
CIDR
Science DMZ @ JHU
11
IDIES Annual SymposiumOctober 17 ,2014
CIDR
40Gb/sLatrobe
MaloneCRB
PH
Clark
HoRNET
PHA
100Gb/s
IDIES Annual SymposiumOctober 17 ,2014 HPC Resources & Model
13
IDIES Annual SymposiumOctober 17 ,2014
• Approx 18,000 cores and 20 Petabytes storage
KSAS:10.5M Quarter
WSE: 10.5M/Q
SOM: 6.2M/Q
PH: 5.8M/Q
UMCP: 5.8M/Q
IDIES Annual SymposiumOctober 17 ,2014
Hardware
15
IDIES Annual SymposiumOctober 17 ,2014
Count Description
648 Regular compute nodes, 128 GB RAM, Haswell 2.5GHz, 24 cores
50 Large memory nodes, 1 Tbyte RAM, ivy Bridge 3.0GHz, 48 cores
24 GPU nodes, 48 Nvidia K40 GPUs, 24 cores per node
2 PB High Performance File System (CIFS)
14 PB zFS File System
FDR-14 Infiniband Connectivity 2:1 blocking
Rpeak= 771 TFLOPs, RMax=617 TFLOPs, (61st place on Top500)
IDIES Annual SymposiumOctober 17 ,2014
Governance
17
IDIES Annual SymposiumOctober 17 ,2014
• Facility Governing Board (3 members JHU, 3 members UMCP)
• Scientific Management Committee (4 faculty members from JHU and UMCP).– Policies
– Allocation models
– Utilization
IDIES Annual SymposiumOctober 17 ,2014
Timeline
18
IDIES Annual SymposiumOctober 17 ,2014
• Data center: End of November
• Network install “mid December”
• Hardware deployment Dec 1 - Jan 2015
• Production system:
IDIES Annual SymposiumOctober 17 ,2014
Co-Location
19
IDIES Annual SymposiumOctober 17 ,2014
• Priority
• Early Spring we will have better guidelines and policies
• Cluster/server hosting and management
• Cluster/server hosting
• Virtual servers
IDIES Annual SymposiumOctober 17 ,2014
Next . . .
20
IDIES Annual SymposiumOctober 17 ,2014
• Website• FAQs
• Instruction on how to connect
• Request accounts
• Queueing system and queues
• Software & Application support
• Add Condos
• Documentation
IDIES Annual SymposiumOctober 17 ,2014
Summary
21
IDIES Annual SymposiumOctober 17 ,2014
• Create state of the art HPC facility (current and future needs)
• Develop an HPC ecosystem:• To foster collaboration and advance research agendas
• Develop or improve tools for more effective data analysis
• Resource to attract and retain top researchers
• Facility to properly house HPC resources with different requirements (Co-location)
• Researchers concentrate on science not on IT
IDIES Annual SymposiumOctober 17 ,2014
Information
22
IDIES Annual SymposiumOctober 17 ,2014
• combariza@jhu.edu
• Web site (soon) marcc.jhu.edu
IDIES Annual SymposiumOctober 17 ,2014
23
IDIES Annual SymposiumOctober 17 ,2014
IDIES Annual SymposiumOctober 17 ,2014
IDIES Annual SymposiumOctober 17 ,2014
IDIES Annual SymposiumOctober 17 ,2014
IDIES Annual SymposiumOctober 17 ,2014