Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS...

56
© 2011 ANSYS, Inc. May 10, 2012 1 Solving Large Complex Problems “Efficient and Smart Solutions for Large Models”

Transcript of Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS...

Page 1: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20121

Solving Large Complex Problems

“Efficient and Smart Solutions for Large Models”

Page 2: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20122

ANSYS Structural Mechanics Solutions offers several techniques

Page 3: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20123

Current trends in simulation show an increased need for

the computation of large models

Page 4: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20124

Larger model size for higher accuracy

Page 5: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20125

Full assemblies for higher realism

Page 6: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20126

Better design knowledge from design variations

Page 7: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20127

Continuous variations of the parameters provides in-depth information

Page 8: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20128

Even more performance is required!

( )+ +=

x n

Page 9: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 20129

High Performance Computing is a key component of the

ANSYS offering.

Page 10: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201210

High Performance Computing as an EnablerInsight you can’t get any other way

It’s all about getting better insight into product behavior quicker!

HPC enables high-fidelity • Include details - for reliable results

• “Getting it right the first time”

• CONFIDENCE by DESIGN!

HPC enables design exploration & optimization• Consider multiple design ideas

• Optimize the design

• Ensure performance across range of conditions

Page 11: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201211

High Performance ComputingA Software Development Imperative

• Clock Speed – Leveling off

• Core Counts – Growing• Exploding (GPUs)

• Future performance depends on highly scalable parallel software

Source: http://www.lanl.gov/news/index.php/fuseaction/1663.article/d/20085/id/13277

Page 12: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201212

Size of the model – how large is “large”?

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

1 2 3 4

Number of CPUs

Sp

eed

Up 1000 elements

8000 elements64000 elements512000 elements

Page 13: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201213

A simple and productive licensing scheme

ANSYS HPC Pack

ANSYS HPC Workgroup

Page 14: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201214

Which part of the simulation is faster?

Page 15: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201215

Not all steps of the simulation are parallel

Model solution

Page 16: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201216

How should I read speed-up curves?This is the solver part – excellent scaling!

This is YOUR time (elapsed)

Page 17: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201217

The right combination of algorithms and

hardware leads to maximum efficiency

Page 18: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201218

Shared Memory Parallel vs Distributed Memory Parallel

Page 19: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201219

Challenges and solutions for the distributed method

Challenges Solutions

Efficient and relevant decomposition

Partitioning methods,Solver

Load Balancing Partitioning methods,Solver

Speed Hardware(Processors,Interconnects), Solver

Maximum Problem Size Hardware (RAM), Solver

I/O to communicate between cores.

Hardware (Interconnects), MPI, Solver

I/O to write results and overflow files during solution.

Hardware (Disks,Interconnects), MPI, Solver

Page 20: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201220

Sparse or iterative solvers?

Solver type Distributed/SharedMemory

SPARSE (direct) DMP/SMP

PCG (Iterative) DMP/SMP

LANB (direct, modal) SMP

LANPCG (iterative, modal) DMP/SMP

SNODE SMP

Page 21: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201221

Get it in-core!

Incore - 24GB

Optimal - 24GB

Minimum - 24GBOptimal -4GB

Minimum - 4GB

0

500

1000

1500

2000

2500

Time (s)

Page 22: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201222

Check the PCG level!

Page 23: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201223

Balancing the load: a key to efficiency

Page 24: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201224

A consequence for contact users

Page 25: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201225

What could it look like on your model?

6 Mio Degrees of FreedomPlasticity, ContactBolt pretension4 load steps

1 HPCPack

Page 26: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201226

The Right Software Architecture for HPC

Workstation-Basedor

Remote Access

Job SubmissionHost

ANSYS WorkbenchUser Environment/Graphics

Compute Cluster

Mobile UserThin Client

Off-the-shelf High-Performance ComputingANSYS Remote Solve Manager: Workbench-based job submission with full portfolio support for Platform LSF, PBS Pro, and Microsoft Job Scheduler

Bundled third-party Message-Passing software with optimized performance (Intel MPI, Platform MPI) on gigE, 10gigE, or Infiniband cluster fabric.

Multi-core / Multi-node Solver Execution

Graphics Server

Page 27: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201227

Our HPC Partnerships

ANSYS maintains close technical collaboration with the leaders in HPC

This mutual commitment ensures that you get the most possible value from your overall HPC investment

Some current examples:

• Optimized performance on multicore processors from Intel, with R&D focused on Intel’s Many Integrated Core (MIC)

• Over 60% performance boost for the latest Intel® Xeon® E5-2600 processor (Sandy Bridge) family compared to previous Intel (Westmere) generation

• GPU computing accelerates ANSYS Mechanical today, with very active R&D engagement with NVIDIA across full portfolio

• ANSYS and IBM – Optimized cluster and storage architectures for ANSYS

Page 28: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201228

What do your peers say?

“By optimizing our solver selection and workstation configuration, and including GPU acceleration, we’ve been able to dramatically reduce turnaround time — from over two days to just an hour. This enables the use of simulation to examine multiple design ideas and gain more value out of our investment in simulation.”

- Berhanu Zerayohannes, Senior Mechanical Engineer, NVIDIA

Application: Deflection and bending of 3-D glassesSoftware: ANSYS Mechanical

HPC Solution: From 60 hours per simulation to 47 minutes(77x speedup)

Business Ability to ensure robust performance of the 3-DSolution: glasses via examining multiple design ideas

Co

pyr

igh

t 20

11

NV

IDIA

Co

rpo

rati

on

. A

ll ri

ghts

res

erve

d.

Page 29: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201229

Taking advantage of new hardware solutions: GPU

1.52

1.16

1.70

1.20

2.24

1.44

0

1

2

3

V13cg-1 (JCG,

1100k)

V13sp-1 (sparse, 430k)

V13sp-2 (sparse, 500k)

V13sp-3 (sparse, 2400k)

V13sp-4 (sparse, 1000k)

V13sp-5 (sparse, 2100k)

Distributed ANSYS 14.0 Total Simulation Speedups

4 CPU cores

4 CPU cores + 1 GPU

Page 30: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201230

Speed-up from GPU technology

Cores GPU Speedup

2 no 2.25

4 no 4.29

2 yes 11.36

4 yes 11.51

Vibroacoustic harmonic analysis of an audio speaker

Distributed ANSYS Results (baseline is 1 core):

• With GPU, ~11x speedup on 2 cores!

• 15-25% faster than SMP with same number of cores

Windows workstation: Two Intel Xeon 5530 processors (2.4 GHz, 8 cores total), 48 GB RAM, NVIDIA Quadro 6000

Speedup

SMPDANSYS

SMP+GPUDANSYS+GPU

0.00

2.00

4.00

6.00

8.00

10.00

12.00

2

4

Page 31: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201231

Speed-up from Multi-Node GPU technology

Solder Joint Benchmark - 4M DOF, Creep Strain Analysis

Linux cluster : Each node contains 12 Intel Xeon 5600-series cores, 96 GB RAM, NVIDIA Tesla M2070, InfiniBand

Mold

PCB

Solder balls

Res

ult

s C

ou

rtes

y o

f M

icro

Co

nsu

ltEn

gin

eeri

ng,

Gm

bH

Page 32: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201232

ANSYS has a strong commitment to High Performance Computing.

Page 33: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201233

High Performance Computing is dynamic, technology dependent.

1980

20102020

Page 34: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201234

Reduction techniques help

reduce the CPU time and can help

compute design variations more

efficiently

Page 35: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201235

Submodeling is the solution when only a portion of the model matters.

Page 36: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201236

The coarse model provides accurate deformations but inaccurate stresses

Page 37: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201237

The refined model(s) will provide accurate stresses

Page 38: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201238

From the coarse model to the submodelthrough results mapping

Displacements are mapped to the common boundary

Page 39: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201239

Solving two models can be faster than solving a very detailed one

Page 40: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201240

General Procedure

1. Create and analyze the initial model

2. Create the submodel

3. Perform cut boundary interpolation

4. Analyze the submodel

5. Verify that the distance between the cut boundaries and the stress concentration is adequate

Page 41: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201241

Good practice:Verify the cut-boundary distance

Compare path plots at that location between the initial model and submodel.

Use the query option.

List the results.

Etc.

Page 42: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201242

Submodeling with ANSYS Workbench

Page 43: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201243

Page 44: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201244

Submodeling works for a variety of topologies and

nonlinear models as well

Page 45: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201245

From a solid model to a solid model

Stress contour – full model

Stress contour – Submodel

Page 46: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201246

From a shell model to a solid model

Initial geometryDefeatured shell model - deformations

Solid submodel - stresses

Page 47: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201247

Nonlinearities can also be included

Plastic strain

Coarse model

Submodel (line) vsrefined full model (cross)

Page 48: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201248

Substructuring or CMS allows for collaborative work or long transient simulations.

Page 49: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201249

Static (Guyan)

Guyan Reduction procedure

inertia forces are negligible compared to elastic forces

Net result: the reduced stiffness matrix is exact, whereas the reduced mass and damping matrices are approximate

Note: Choosing master DOF is an important step in a reduced analysis, impacting accuracy of results

Page 50: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201250

Component Mode Synthesis

CMS is a type of substructuring which performs a modal analysis of a structure based on independent modal analyses of its parts

The synthesis involves making the components work together as a single structure by satisfying inter-component compatibility and equilibrium constraints

Master DOF are required only at interface nodes

Page 51: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201251

CMS with ANSYS Workbench

Page 52: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201252

APDL macros embedded in the simulation tree for generation, use and expansion pass

Page 53: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201253

Results are available through standard operations

Page 54: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201254

Reduce solution time for harmonic and transient analyses

Page 55: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201255

Comparing the accuracy of a CMS analysis to a standard one

Page 56: Solving Large Complex Problems - Ansys · 2012-10-26 · Solving Large Complex Problems ... ANSYS maintains close technical collaboration with the leaders in HPC This mutual commitment

© 2011 ANSYS, Inc. May 10, 201256

Learn about the methods available in ANSYS Structural Mechanics Solutions.