1

Highlights from the CEIVIZ 2008 EnSight Users Conference in

Baltimore, Maryland USA

Martin J. Faber, Sales Manager CEI Detroit OfficeComputational Engineering, International

Agenda

• Purpose of CEIViz08

• Educate distributors and users

• Introduce 9.0 release

• Give guidance on product direction

• Make distributors more successful in their sales opportunities

• Make users more successful in their usage

• Make personal connections between users, distributors, sales, and developers

Los Alamos National Laboratory

Sep 23-25, 2008 3 4

Roadrunner at a glance

Cluster of 17 Connected Units• 6,120 AMD dual-core Opterons• 12,240 IBM PowerXCell 8i processors• 44.1 Teraflops peak (Opteron)• 1.26 Petaflops peak (Cell eDP)• 1.026 PF sustained Linpack, #1

Top500InfiniBand 4x DDR fabric

• 2-stage fat-tree; all-optical cables• Full bisection BW within each CU

— 384 GB/s (bi-directional)• Half bisection BW among CUs

— 3.3 TB/s (bi-directional)• Non-disruptive expansion to 24 CUs

98 TB aggregate memory• 49 TB Opteron• 49 TB Cell

204 GB/s sustained File System I/O

• 204x2 10G Ethernets to Panasas

Fedora Linux (RHEL possible)SDK for Multicore Acceleration

• Cell compilers, libraries and toolsxCAT Cluster Management

• System-wide GigEnet network2.35 MW Power

• 437 MFlop/Watt, #3 on Green500

Size:• 278 racks• 5200 ft2

• 55 miles of IB cable• 250 tons

5

PowerXCell 8i4 GB

PowerXCell 8i

4 GB

Roadrunner is a cluster-of-clusters of “Triblade” nodes

PowerXCell 8i4 GB

PowerXCell 8i

4 GB

Opteron x2

8 GB

Opteron x28 GB

InfiniBand 4x DDR

2 GB/s, 2µs

2 PCI-E x8 links, 2 GB/s, 2µs each

Triblade schematic

A “connected unit” is 180 Triblades on a first level InfiniBandswitch

6

Metropolis Center’s Five-Sided CAVE

2

7

EnSight and Extrusion: 2D Simulations of Explosively Formed Cu Jet Impacting on a Plate

• 2D simulation of a shaped charge explosively forming a penetrating Cu jet and the impact of the jet on a steel plate:• Material strength parameters were used in both metals.• Used as a test of our continuous adaptive mesh

refinement code Nobel.• Here we use the new EnSight extrude feature to create a 3D

version of the 2D axisymmetric problem by rotation about the axis.

• Different materials are rotated by different amounts to visually separate them in the animation:• HE is rotated by 180 degrees• CU and Steel by 270 degrees

• Materials are colored by speed to show the jet formation and its impact on the steel.

8

EnSight and Extrusion: 2D Simulations of Explosively Formed Cu Jet Impacting on a Plate

9

The DOE ASC Program’s Commitment to EnSight Remains Strong• The US Department of Energy’s Advanced Simulation and

Computing (ASC) program was established by Congress in 1995 to provide the modeling and simulation capabilities required to maintain the US nuclear stockpile in the absence of nuclear testing.

• Since the beginning of ASC EnSight has played a central role in both the LANL and national ASC programs.

• Since June of 2000, ASC contracts with CEI from both LANL and the ASC Tri-Lab have helped to accelerate the development of many EnSight features designed to address the problems of big data:• EnSight Gold and the EnSight Server-Of-Servers• EnSight DR Distributed Rendering• EnSight support for VR with distributed memory clusters• EnSight support for many advanced analysis features like

Python scripting• CEI tools like EnVideo, EnVe and Reveal

10

The DOE ASC Program’s Commitment to EnSight Remains Strong

• In FY08 LANL ASC contracts with CEI have resulted in several additional new features that are driving the release of EnSight 9: • Full MPI support for the EnSight SOS

• Restructuring of the communication between SOS and the DR client to improve performance

• All the benefits of this enormous multi-year development effort are available to everyone in the HPC community via the standard commercial release of EnSight Gold.

• In the future ASC faces many challenges:

• How to utilize the power of multi-core CPU’s for analysis.

• How to track the changing landscape of ASC platform architectures and data sizes.

• ASC will continue to work with CEI to insure that EnSight meets these challenges as we move into the petascale future.

The Goodyear Tire & Rubber Company

Sep 23-25, 2008 11 9/23/2008 12

• Replace repetitive procedures by a “click of a button” • Are intuitive enough to eliminate training • Fast even for very large models• Address various levels of users –

Novice & experts, designers & researchers• “Seamlessly” based on commercialsoftware• Hide the complexity of the numerical technology

Objective: Deploy Advanced Numerical Capabilities via Simplified Visualization Tools

3

9/23/2008 13

Analysts –Experienced FEA usersPerform detailed analyses, visualization,

validation of tools & first line support Define new performance functions

Researchers –Experienced FE developers, scientists withlimited post-processing experience

Product Designers –Focus on projects, designs and TestsAvoid the “distraction” due to numerical issues

Target Users

9/23/2008 14

Intuitive! Simple! Fast !

Invoked: 1. Interactively from the command line - 2. Automatically via the designer’s interface

The Leading Part: Exploiting axi-symmetry, the “core” part is a 2D cross-section.

Custom GUI: Written in QT and interfaced to EnSight using PyQt & EnSight Python extensions.

First Version mimics an existing Legacy Tool

Input: 1. FEA results files 2. ASCII information files

Customized EnSight

Initial Display: GUI & Viewport

15

Tire oriented EnSight viewport

Cross Section: 2D Part Display

16

Deformed & undeformed shapesDistribution of a selected indicator

Ring XY Plots

9/23/2008 17

Back to Full EnSight

9/23/2008 18

4

Summary

9/23/2008 19

• Designed & implemented customized EnSight adjusted to specific users’ needs for visualization of FEA results

• Released “Tire Oriented” EnSight including pre-defined performance functions and graphic options

• Enabled switching to core EnSight for advanced users

• Updated core EnSight to enable GY requested options

• EnSight version used for the customized tool is 8.2.6(j)

Virginia Military Institute

Sep 23-25, 2008 20

What is a Stent?

Stenting of Stenotic Arteries

Wire mesh inserted into an artery to prop it open and increase blood flow

Why use a stent?Angioplasty can damage artery wallPlaque may spring back after angioplastyExpands and holds arterial wall to normal shape

Stenting of Stenotic Arteries

Stent Inflation in Arteries Finite Element Analysis• Artery

• Element type: Solid185• Characteristics of Element: eight nodes, large deflections

and hyperelasticity capabilities (7,680 elements)• Constraints: no rotation, axially constrained on ends

• Stent• Element type: Solid45• Characteristics of Element: eight nodes, large deflections

and plasticity capabilities (12,036 elements)• Constraints: no rotation, internally applied pressure

• Balloon• Element type: Shell43• Characteristics of Element: six nodes, capable of

modeling shell structures and have large deflection and multi-linear elastic capabilities ( 54,456 - 51,616 elements)

• Constraints: no rotation, internally applied pressure

5

Computational Resources

• Pre-processor: Gambit and Harpoon

• Solver: ANSYS 11.0

• Post-Processor: Ensight

• Each model takes approximately

two weeks to run on a conventional

Windows based workstation

Material Models• Artery:

• Five parameter, third-order, Mooney-Rivlin hyperelastic constituitive equation using constants developed by Lally et al.

• Stent:• Modeled after the slotted tube geometry

given by Migliavacca et al.• 316LN stainless steel • Poisson ratio is 0.3 • Young Modulus is 200 GPa

• Balloon:• Empirically collected data

Results – Arterial StressStress on Artery at End of Expansion

Increase in maximum arterial stress is 93% at balloon point of contact and 45% at point of contact with far proximal and distal ends of the stent

Results - EnSight Movie

Sep 23-25, 2008 28

Modeling Conclusions

• Maximum arterial stress at balloon contact is approximately proportional to the degree of balloon overhang

• A 100% increase in balloon overhang results in a 4% increase in max endflare and a 39% change in peak arterial stress

• At the end of expansion, which is of most clinical importance, the increase in max endflare is 2% and the increase in max arterial stress is 93% at the balloon and 45% at the endflare

Next Steps- Flow Studies

6

Data Analysis & Assessment Center

Sep 23-25, 2008 31 Paul AdamsCEIViz 2008

Ray Tracing Definition

• Ray tracing is a realistic method for rendering images constructed from a 3-D environment.

• Ray tracing works by projecting rays backwards. For each pixel in an image, create a ray from the camera passing through this pixel, back to the objects, and back to the light sources.

• Rays that never reach the camera can be ignored.

Paul AdamsCEIViz 2008

Terascale Simulations Definition

• Terascale Simulations refer to simulations performed on High Performace Computers that output Terabytes of data.• This could be a single dataset that is a

terabyte or more in size.• This could be multiple time steps that

together total more than a terabyte in size.• For example 1,400 time steps where

each time step is 2 GB in size.

Paul AdamsCEIViz 2008

EnSight Gold supports PoV-Ray output

• File Save Image• Set Format to PoVRAY

Geometry• EnSight creates three

files:• Filename.pov• Filename.inc

Reading in Data

Paul AdamsCEIViz 2008

• Load Simulation data

• Load 5514 Ship

Paul AdamsCEIViz 2008

Sky Dome Problems

• EnSight can import textured objects.• EnSight cannot export textured

objects.• Don’t worry about it, no one else can

export textures to PoVRay either.• Better to use Sky Sphere from PoV-

Ray

7

Finished Ray Traced Movie

Sep 23-25, 2008 37

General Motors

Sep 23-25, 2008 38

Integrated Virtual Vehicle Development

MANUFACTURINGDESIGN

MARKETING

SALES

SERVICE

RE-USE

VEHICLE SPECIFICATIONSTYLING

CONCEPT

VALIDATION

Focus on complete vehicle life cycle

Integrated Vehicle

Data BaseTCAE / UG

Vehicle Simulation

Animation and Rendering

Buick Velite Concept

Trunk Study

Power WallsImmersive CavesVisualization Rooms

Siemens/UGS TeamCenter PLM Software

• Unigraphics and TCAE• CAD Management and Design

• TeamCenter Community• Workflow, secure data transfer, conferencing

• Visualization Mockup• High-performance, lightweight, JT data format• Manage/view large assembly structures• Sections, measure, annotate, query, compare

• JT 2 Go• Lightweight viewer• Embed into MS Office, etc.

TeamCenter Visualization Mockup

8

VisMockup Surface Comparison

Exterior Design 1

Exterior Design 2

Tri-Color MappingBlue = Common Surface

Things We Like in EnSight

• Quality images, anti-aliasing• Fast dynamic viewing of large models• Compare multiple cases simultaneously• Calculator functions• Derived parts (iso-surfaces)• Case Map• CAD – import/export• Customized color palettes, legends• Query• Command files (same syntax in batch and GUI)• Context files (usually)• evo, EnVe• Case format used for in-house codes• Batch operation• Python, Quicktools (TBD)

Wiper Wind Noise Prediction

Allowable wiper packaging to meet wind noise requirements

Aero CFD Simulation

GM Wind Noise Model1500 lines of EnSight command code

Using only While Loops!

Runs automatically after Fluent job

GM Intellectual Property

dB value

Standard center, zoom, vectors, particle traces, contours, clips, annotations, etc

Improving Pressure Pictures

Cp* Normal [x] indicates drag contribution

Eliminate uninteresting middle scale

GM Movie: The Volt

Sep 23-25, 2008 47

Data Analysis & Assessment Center

Sep 23-25, 2008 48

9

Richard WaltersCEIViz ̀ 08

B-17 Problem

Richard WaltersCEIViz ̀ 08

B-17 Problem

Richard WaltersCEIViz ̀ 08

Particle Trace Geometry

Richard WaltersCEIViz ̀ 08

Default Geometry

Richard WaltersCEIViz ̀ 08

Use Trace Dump

Richard WaltersCEIViz ̀ 08 https://visualization.hpc.mil

Particle Trace Dump

Part 74

This part is a particle trace part Part has 175 number of traces Trace 1 has 1203 number of points xcoord ycoord zcoord time density

... 5.03812e+02 3.05895e+02 1.65197e+02 0.00000e+00

3.10169e+00 …5.03735e+02 3.05872e+02 1.65139e+02 7.81303e-02

3.10167e+00 … 5.03658e+02 3.05849e+02 1.65081e+02 1.56261e-01

3.10227e+00 …...

10

Finished Textured Movie

Sep 23-25, 2008 55

Questions?