Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer...

23
1 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities Chair for Computer Architecture and Parallel Processing, Institute of Computer Engineering, Karlsruhe Institute of Technology Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities Philipp Kirchhofer 1 , Martin Schindewolf 1 , Nehir Sonmez 2 , Oriol Arcas 2 , Osman S. Unsal 2 , Adrián Cristal 2 , Wolfgang Karl 1 1 Karlsruhe Institute of Technology (KIT) 2 Barcelona Supercomputing Center (BSC) KIT – University of the State of Baden-Wuerttemberg and National Research Center of the Helmholtz Association www.kit.edu

Transcript of Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer...

Page 1: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

1 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Chair for Computer Architecture and Parallel Processing, Institute of Computer Engineering, Karlsruhe Institute of Technology

Enhancing an HTM System with Monitoring, Visualization andAnalysis Capabilities

Philipp Kirchhofer1, Martin Schindewolf1, Nehir Sonmez2, Oriol Arcas2,Osman S. Unsal2, Adrián Cristal2, Wolfgang Karl11Karlsruhe Institute of Technology (KIT) 2Barcelona Supercomputing Center (BSC)

KIT – University of the State of Baden-Wuerttemberg andNational Research Center of the Helmholtz Association www.kit.edu

Page 2: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

Motivation

2 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Transactional Memory simplifies parallel programming

But how to achieve good performance and scalability?

Need for a monitoring infrastructure to

identify runtime characteristics of an applicationrunning on an HTM system

detect application bottlenecks

get insight into interaction between application andHTM system

Page 3: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

Project Goals

3 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Develop a monitoring infrastructure for the TMbox HTMsystem using event logs:

Generate events at run time and save for later processing

Recreate HTM state offline

Visualize and analyse saved information

Additional goals:

No probe effect, small hardware overhead, high extensibility,ease of use

Page 4: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignThe TMbox system

4 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Developed at Barcelona Supercomputing Center

MIPS compatible multi-core system(FPGA based, 16 cores on 1 FPGA)

SupportsSTM (TinySTM)HTM (BeeTM)HybridTM (Modified TinySTM)

Page 5: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignThe TMbox system - Block Diagram

5 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 6: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignEvent Generation, Log Unit, Bus Controller

6 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 7: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignEvent Generation, Log Unit, Bus Controller

6 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 8: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignEvent Generation, Log Unit, Bus Controller

6 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 9: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignEvent Generation, Log Unit, Bus Controller

6 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 10: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignPost Processing, Visualization, Analysis

7 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 11: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignPost Processing, Visualization, Analysis

7 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 12: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

DesignPost Processing, Visualization, Analysis

7 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 13: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

ResultsParaver workflow

8 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 14: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

ResultsExample: 4 conflicting threads

9 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Idle

Compute

Compute Wasted

Try Lock

Commit

Abort

Page 15: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

ResultsExample: 4 conflicting threads

9 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Idle

Compute

Compute Wasted

Try Lock

Commit

Abort

Page 16: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

Summary

10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

X Application / HTM runtime behavior is trackablewith no probe effects

X Visualization capabilities lead to in-depth understandingof application / HTM runtime behavior

Metrics provided via offline analysis, e.g.Time spent in Committed & Aborted TransactionsContention / Commit & Abort RateContention between specific threadsHTM System Overhead

Page 17: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

11 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Summary at a glance

The TMbox system now supports:

X Identification of detailed runtime characteristicsof an application

X Easy detection of application bottlenecks

X Getting hints to optimize application concerningboth performance and scalability

Page 18: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

Ongoing work

12 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Combine monitoring with STM runtime environment:Allows analysis of HybridTM systems

See further work in full paper “A low-overhead profilingand visualization framework for Hybrid TransactionalMemory” (to appear in FCCM 2012)

Acknowledgment

This work was supported by a Short Term Scientific Mission(STSM) grant from the European Cooperation in Scienceand Technology (COST) Action IC1001 (EuroTM) duringJune and July 2011.

Page 19: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

13 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Chair for Computer Architecture and Parallel Processing, Institute of Computer Engineering, Karlsruhe Institute of Technology

Enhancing an HTM System with Monitoring, Visualization andAnalysis Capabilities

Philipp Kirchhofer1, Martin Schindewolf1, Nehir Sonmez2, Oriol Arcas2,Osman S. Unsal2, Adrián Cristal2, Wolfgang Karl11Karlsruhe Institute of Technology (KIT) 2Barcelona Supercomputing Center (BSC)

KIT – University of the State of Baden-Wuerttemberg andNational Research Center of the Helmholtz Association www.kit.edu

Page 20: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

Additional slides

14 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Additional slides

Page 21: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

Workflow

15 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Page 22: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

Event Diagram

16 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Event diagram

Page 23: Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

FPGA Usage

17 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

1 2 4 8 16-40-20

020406080

100120140

Slice Registers Slice LUTsBlock RAM Slice LUTs (Regression curve)

Cores

Uni

ts

TMbox FPGA Usage (with monitoring infrastructure) - Increase per Core