Welcome To The 42 st HPC User Forum Meeting September 2011

Welcome To The 42st HPC User Forum

MeetingSeptember 2011



Important Dates For Your Calendar Important Dates For Your Calendar

FUTURE HPC USER FORUM MEETINGS:

International Meetings: 2011 CEA in France, October 3 & 4 2011 HLRS/University of Stuttgart, October 6 & 7 2012 Imperial College, UK June 5 & 6

2012 US Meetings: 2012 April 16 to 17, Richmond, Virginia 2012 September 17 to 19, Dearborn, Michigan

Thank You To Our Sponsors! Thank You To Our Sponsors!

Gold Intel HP

Silver Altair AMD Appro International Platform Computing

Bronze Adaptive Computing Bright Computing General Atomics Mellanox Panasas Qlogic

DinnerThanks to:

General Atomics & Qlogic

DinnerThanks to:


Tuesday Dinner Vendor Updates: 10 MinutesTuesday Dinner Vendor Updates: 10 Minutes

• Qlogic• Panasas• Mellanox• General Atomics• DDN• Bright Computing• Appro• AMD• Altair• Adaptive Computing

DinnerThanks to:


BreakfastThanks to:

AMD

DinnerThanks to:


BreakfastThanks to:

AMD


Gold Intel HP



Introduction: LogisticsIntroduction: Logistics

Ask Mary if you need a receipt We have a very tight agenda (as usual)

Please help us keep on time!

Review handouts Note: We will post most of the

presentations on the web site Please complete the evaluation form

www.hpcuserforum.comwww.hpcuserforum.com

New HPC Innovation Award Program:www.hpcuserforum.com/innovationaward/New HPC Innovation Award Program:www.hpcuserforum.com/innovationaward/

Welcome

Steve FinnHPC User Forum

Chairman

Welcome

Steve FinnHPC User Forum

Chairman



International Meetings: 2011 CEA in France, October 3 & 4 2011 HLRS/University of Stuttgart, October 6 & 7 2012 Imperial College, UK July 5 & 6


HPC User Forum MissionHPC User Forum Mission

To Improve The Health Of The

High Performance Computing Industry

Through Open Discussions, Information-sharing And Initiatives Involving

HPC Users In Industry, Government And Academia

Along With HPC Vendors

And Other Interested Parties

Steering Committee MembersSteering Committee Members

• Steve Finn, Cherokee Information Services, Chairman• Sharan Kalwani , KAUST, Vice Chairman • Earl Joseph, IDC, Executive Director• Vijay Agarwala, Penn State University• Alex Akkerman, Ford Motor Company • Doug Ball, The Boeing Company• Rupak Biswas, NASA Ames• Paul Buerger, Avetec• Steve Conway, IDC Research Vice President• Jack Collins, National Cancer Institute• Jeff Broughton. NERSC/Lawrence Berkeley National Lab • Merle Giles, NSCA/University of Illinois• Chris Catherasoo, Caltech• James Kasdorf, Pittsburgh Supercomputing Center• Doug Kothe, Oak Ridge National Laboratory• Paul Muzio, City University of New York• Michael Resch , HLRS, University of Stuttgart• Vince Scarafino, Industry Expert • Allan Snavely, San Diego Supercomputer Center

IDC HPC

Market Update

IDC HPC

Market Update

Top Trends in HPCTop Trends in HPC

The global economy in HPC is growing again 2010 grew by 10%, to reach $9.5 billion We are forecasting ~7% growth over the next 5 years

Major challenges for datacenters Power, cooling, real estate, system management Storage and data management continue to grow in importance

Software hurdles will rise to the top for most users

SSDs will gain momentum and could redefine storage

GPUs are seeing real tractions in certain verticals

The worldwide Race on Petascale is in full speed

18

1. The Worldwide Economic Recovery Will Restore HPC Growth

2. The Battle for HPC Leadership Will Become Increasingly Global and Strategic

3. More Real-World Applications Will Be Run at Trans-Petaflop Speeds

4. There May Be More Emphasis on Software…Finally5. The Alternative Processor Wars Will Keep Heating Up6. The HPC Staffing Shortage Will Grow More Acute7. Cloud Computing Will Ramp Up Slowly in HPC, But Will

Find a Number of Strong Niches 8. The HPC Storage Market Will Continue to Grow Faster

than the HPC Server Market9. InfiniBand Will Continue To Take Market Share from

Proprietary Interconnects While Ethernet Remains the Leader

10. Power and Cooling Will Become an Even Greater Concern

IDC Top 10 HPC Predictions for 2011IDC Top 10 HPC Predictions for 2011

HPC WW Market ResultsHPC WW Market Results

HPC Vendor Revenue Shares, 2010HPC Vendor Revenue Shares, 2010

HP32%

IBM30%

Dell15%

Cray3%

SGI3%

Sun2%

Fu-jitsu1%

NEC1%

Appro1%

Hi-tachi1%

Dawn-ing1%

Bull1%

Other10%

2010 HPC WW Market Results2010 HPC WW Market Results

Q110 Q210 Q310 Q410 Full Year

Supercomputer 669,521 780,655 847,960 1,183,441 3,481,577 36.6%

Divisional 273,752 299,286 316,688 379,009 1,268,735 13.3%

Departmental 688,785 791,416 842,511 956,507 3,279,219 34.5%

Workgroup 372,914 333,110 348,131 420,638 1,474,792 15.5%

Total 2,004,973 2,204,466 2,355,289 2,939,595 9,504,323 100.0%

Source: IDC HPC Qview 2012

Revenue Share by VendorSupercomputer SegmentRevenue Share by VendorSupercomputer Segment

IBM53.0%

HP25.3%

Cray7.8%

Dell4.6%

Bull2.7%

SGI2.4%

Appro1.2%

Sun0.6%

NEC0.5%

Dawning0.1%

Other1.8%

Revenue Share by VendorDivisional Segment Revenue Share by VendorDivisional Segment

IBM16.4%

HP38.8%

Dell8.2%

SGI8.0%

NEC5.2%

Appro4.3%

Sun3.9%

Fujitsu3.9%

Dawning1.7%

Other9.5%

Revenue Share by Vendor Departmental SegmentRevenue Share by Vendor Departmental Segment

HP32.2%

Dell31.9%

IBM12.7%

Sun2.3%

Fujitsu1.9%

Hitachi1.5%

Dawning0.8%

SGI0.2%

Appro0.2%

Bull0.1%

Other16.2%

Revenue Share by VendorWorkgroup SegmentRevenue Share by VendorWorkgroup Segment

HP39.8%

IBM24.2%

Dell10.3%

SGI4.4%

Sun2.3%

NEC1.4%

Fujitsu1.4%

Dawn-ing

0.7%

Appro0.5%

Other15.2%

Industry/Application Segments Industry/Application Segments

HPC Server Revenue by Application/Industry 2009 2010 GrowthBio-Sciences 1,171 1,294 10.4%CAE 913 1,060 16.1%Chemical Eng 187 203 8.6%DCC & Distribution 478 549 15.0%Economics/Fin 205 266 30.1%EDA/IT/ISV 559 629 12.5%Geosciences 564 605 7.2%Mechanical Design 75 80 6.5%Defense 894 951 6.3%Government Lab 1,418 1,520 7.2%University 1,721 1,832 6.4%Weather 371 412 11.0%Other 80 104 29.2%Total Revenue 8,637 9,504 10.0%Source: IDC 2011

By Region 1Q201By Region 1Q201

ROW1.2%

Japan6.8%

N.A. 47.0%

Asia/Pac13%

EMEA31.8%

By Operating System 1Q201By Operating System 1Q201

Linux 83.3%

UNIX9.5%

Windows 7.2%

The HPC Market

Beyond

The Servers

The HPC Market

Beyond

The Servers

The Broader HPC MarketThe Broader HPC Market

2009 2010

Servers 8,637,114 9,504,323

Storage 3,022,990 3,328,312

Middleware 1,062,365 1,103,797

Applications 2,971,167 3,164,293

Service 1,658,326 1,727,976

Total 17,351,963 18,828,701

HPC BuyerDriving factors

HPC BuyerDriving factors

2011 Buyer Driving Factors 2011 Buyer Driving Factors

Top Reasons for Acquiring HPC Systems Average rankings, 10 -- most important, 1 -- least importantAttribute: RankingAbility to do new/ better science 8.18Ability to run larger problems 7.69Performance on OUR applications 7.38Throughput 7.17Price/ Performance 6.99To improve our competitiveness 6.06 TCO 6.03Capacity mgmt 5.29Regulations/ certification 3.08Source: IDC, 2011

2011 Buyer Driving Factors 2011 Buyer Driving Factors

Barriers for Cluster Sites to Expanding HPC AdoptionWith 1 = Least prohibitive, 10 = Most proibitiveBarriers: Average RatingFinancial barriers 8.463rd party applications costs barrier 6.64Space limitations, facility issues, power, cooling 6.22Difficulties with scaling 4.93Technical limitations in processor, memory, interconnect 4.88Lack of parallel application development tools 4.58Lack of knowledge, or skilled computing staff 4.35Lack of application availability on parallel servers 4.13Lack of system management software 3.92Lack of data storage mechanisms 3.85Availability, turn-around, reliability issues 3.32Lack of support by management 3.18Source: IDC, 2011

HPC Market Forecasts

HPC Market Forecasts

HPC Server Revenue ($M) ForecastHPC Server Revenue ($M) Forecast

2010 2011 2012 2013 2014 2015 CAGR

HPC Revenues

9,504

10,034

10,564

11,397

12,371

13,449 7.2%

System Units

119,845

133,044

146,243

165,391

172,306

179,515 8.4%

Source: IDC 2011

HPC Server Revenue ($M) Forecasts Compared To Last YearHPC Server Revenue ($M) Forecasts Compared To Last Year

Comparison of Old and New HPC Revenue Forecasts 2009 2010 2011 2012 2013 2014 2015New Forecast 8,637 9,504 10,034 10,564 11,397 12,371 13,449 Previous Forecast 8,637 9,240 9,842 10,444 11,047 11,706 - Source: IDC 2011

2009 2010 2011 2012 2013 2014 2015 -

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

New Forecast

Previous Forecast

ConclusionsConclusions

2010 was a year of return to healthy growth in the worldwide HPC market

IDC predicts the HPC market will continue growth in 2011 and grow by 7% to 9% in 2011 And then will rebuild to reach $13.5 billion by 2015

The recovery will benefit HPC segments unevenly: With hard-hit verticals such as automotive recovering

more slowly than oil and gas, or government and academia

The Supercomputer segment growth will remain turbo-charged by government spending aimed at HPC leadership and “petaflop club” membership And could exceed our current forecasts

38

But There are Still Major Customer Pain PointsBut There are Still Major Customer Pain Points

Software is still the #1 roadblock Better management software is needed

– HPC clusters are still hard to setup and operate – New buyers – require “ease-of-everything”

Parallel software is lacking for most users– Many applications will need a major redesign – Multi-core will cause many issues to “hit-the-wall”

Clusters are still hard to use and manage System management & growing cluster complexity Power, cooling and floor space are major issues Third party software costs Weak interconnect performance at all levels RAS is a growing issue Storage and data management are becoming new bottle necks Lack of support for heterogeneous environment and accelerators

Please email:[email protected]

Or check out:www.hpcuserforum.com

Questions?Questions?

mailto:[email protected]

http://www.hpcuserforum.com/

Agenda: Day One MorningAgenda: Day One Morning

Wednesday, September 7, 20117:15am Networking Breakfast 8:00am Welcome, Steve Finn, Sharan Kalwani and Earl Joseph Morning Session Chair: Steve Finn8:15am HPC Market Update, Earl Joseph and Steve Conway8:30am HPC in Materials Science

• Tim Germann, LANL • Bobby Sumpter, Oak Ridge National Laboratory• 9:30am - 10:00am Break• Duane Johnson, Ames Laboratory• Charles Robert Welch, US Army Corps of Engineers, Engineers

Research & Development Center (ERDC)11:00am The 1000 Genomes Project, Skip Garner,

Virginia Tech11:30am Invited Vendor Technology Updates: Intel and

HP12:00pm Networking Lunch

AM Break Thanks to: Mellanox

Lunch Thanks to: Platform

Please Return Promptly at 1:00pm

AM Break Thanks to: Mellanox

Lunch Thanks to: Platform


Thank You To: Platform Computing

For Lunch

Thank You To: Platform Computing

For Lunch

Agenda: Day One AfternoonAgenda: Day One Afternoon

Afternoon Session Chair: Rupak Biswas1:00pm Modeling and Simulation of Large Scale Reactive Systems in Extreme

Conditions, Andres Jaramillo-Botero, Caltech1:30pm HPC in Materials Science: Best Practices in Managing HPC & Simulation

Resources for Improving TTM, Eric Morales, Ping Golf2:00pm Successful HPC Cloud Examples: Teri Dewalt, IBM2:15pm Microsoft "Azure" Cloud Update, Ryan Waite 2:30pm Data-intensive Computing at SDSC, Allan Snavely, SDSC3:00pm Break3:30pm Update on Lustre and OpenSFS, Norm Morse 4:00pm Panel: The Future of Lustre, Moderator: Paul Buerger

• Norm Morse, OpenSFS• Peter Bojanic, Xyratex • Bob Ciotti, NASA Ames • John Josephakis, DDN • Tommy Minyard, TACC • Brent Gorda, Whamcloud • Stephen Simms, Indiana University

5:00pm Networking Break and Time for 1-on-1 Meetings 6:30pm Special Reception and Dinner Event

Thank You To:Adaptive Computing

For The Break

Thank You To:Adaptive Computing

For The Break

Dinner LogisticsDinner Logistics

Special Dinner Event Sponsored by Intel and HP

WelcomeTo Day 2 Of TheHPC User Forum

Meeting

WelcomeTo Day 2 Of TheHPC User Forum

Meeting

DinnerThanks to:

Intel and HP

BreakfastThanks to:

Appro

DinnerThanks to:

Intel and HP

BreakfastThanks to:

Appro


Gold Intel HP



Agenda: Day Two MorningAgenda: Day Two Morning

8:10am Welcome, Earl Joseph and Steve Finn Morning Session Chair: Vince Scarafino 8:15am IDC Update on New EU HPC Parallel Software Programs and Initiatives 8:30am Exascale & Heterogeneous Programs and Addressing the Software Issues:

• Exascale Opportunities and Challenges, and HECToR update, Andy Jones, NAG

• Heterogeneous Systems, Sriram Swaminarayan, Los Alamos National Laboratory

• The Real Future of HPC Cloud Computing, Jeff Broughton, NERSC• 10:00am - 10:30am Break• The AFRL Heterogeneous Condor Cluster, Mark Barnell, Air Force

Research Laboratory (AFRL) 11:00am Panel on Power & Cooling in HPC

• Moderator: Tim Carroll, Dell• Janus: A Co-Designed Facility and Supercomputer, Henry M. Tufo,

Ph.D. , University of Colorado at Boulder• Power & Cooling Techniques at the Texas Advanced Computing Center,

Tommy Minyard, Ph.D. , University of Texas• DIY HPC Clusters: Deploying a high performance compute cluster at

Stanford, Steve Jones, Stanford University 12:00pm Networking Lunch

Am Break Thanks to: Panasas

Lunch Thanks to: Altair


Am Break Thanks to: Panasas

Lunch Thanks to: Altair


Thank You Altair Engineering

For Lunch

Thank You Altair Engineering

For Lunch

Agenda: Day Two Afternoon Agenda: Day Two Afternoon

Afternoon Session Chair: Sharan Kalwani1:00pm HPC as an Ecosystem, Michael Resch, University of Stuttgart,

High Performance Computing Center1:30pm Vendor Technology Update: Platform Computing1:45pm HPC Applications in Materials Science, George Fitzgerald,

Accelrys2:15pm International Exascale Software Project (IESP), Peter Beckman,

Argonne National Laboratory 2:45pm Break3:15pm Overview Of NITRD Activities Related To High Performance

Computing, Bryan Biegel 3:45pm IDC Update on Large HPC Systems in Japan and China4:15pm Exascale Directions, Jeff Nichols, Oak Ridge National

Laboratory4:45pm Meeting Wrap-Up, Steve Finn, Steve Conway and Earl Joseph 5:00pm Meeting Ends

Thank You To:Bright Computing

For The Break

Thank You To:Bright Computing

For The Break

Thank YouFor Attending The 42st

HPC User ForumMeeting

Thank YouFor Attending The 42st

HPC User ForumMeeting

Please email:[email protected]

Or check out:www.hpcuserforum.com

Questions?Questions?

mailto:[email protected]

http://www.hpcuserforum.com/

Welcome To The 42 st HPC User Forum Meeting September 2011

Documents

Transcript of Welcome To The 42 st HPC User Forum Meeting September 2011