Performance and Power Benchmarks

20
Zhang Yu

description

Zhang Yu. Performance and Power Benchmarks. A long time ago in silicon valley far far away…. Tired? Let’s begin with a story. - PowerPoint PPT Presentation

Transcript of Performance and Power Benchmarks

Page 1: Performance and Power Benchmarks

Zhang Yu

Page 2: Performance and Power Benchmarks
Page 3: Performance and Power Benchmarks

A few years ago (like centuries in electronic world) frequency was considered the key element of a cpu`s performance, because of Intel`s dominance in the market place and their continuous bragging about frequency.

Page 4: Performance and Power Benchmarks

In November 2000 Intel's heavily advertised advances in clock speed reached an extreme with the release of the Pentium 4 which sacrificed per-cycle performance and used a deep instruction pipeline to gain higher clock speeds, ignoring problems that this introduced of heat production and power consumption.

Page 5: Performance and Power Benchmarks

Intel: “I am the fastest!” AMD, Apple etc. : “No you are not!”

Page 6: Performance and Power Benchmarks

They decided to settle this…. Let`s race!

Page 7: Performance and Power Benchmarks
Page 8: Performance and Power Benchmarks

Bunny is fast indeed but unfortunately prone to make mistakes….

Page 9: Performance and Power Benchmarks

Deep instruction pipeline (e.g. if a prediction is wrong

performance penalty will be greater because of deeper pipeline.)

higher clock speeds introduced heat production and power consumption

Page 10: Performance and Power Benchmarks

As computer architecture advanced, it became more difficult to compare the performance of various computer systems simply by looking at their specifications. Therefore, tests were developed that allowed comparison of different architectures

Benchmarks are particularly important in CPU design, giving processor architects the ability to measure and make tradeoffs in microarchitectural decisions

Page 11: Performance and Power Benchmarks

Benchmarks are designed to mimic a particular type of workload on a component or system

Page 12: Performance and Power Benchmarks

Industry Standard (audited and verifiable) Business Applications Performance

Corporation (BAPCo) Embedded Microprocessor Benchmark

Consortium (EEMBC) Standard Performance Evaluation

Corporation (SPEC) Transaction Processing Performance

Council (TPC)

Page 13: Performance and Power Benchmarks

BAPCo: MobileMark, SYSmark, WebMark Futuremark:3DMark, PCMark Whetstone PiFast Super PI WinSAT, exclusively for Windows Vista,

providing an index for consumers to rate their systems easily

Page 14: Performance and Power Benchmarks

Benchmarking is not easy and often involves several iterative rounds in order to arrive at predictable, useful conclusions.

Vendors tend to tune their products specifically for industry-standard benchmarks

Page 15: Performance and Power Benchmarks

Benchmarks do not address questions which you did not ask… only see what you measure

Specific application benchmarks will not tell you

about the performance of other applications without proper analysis => extrapolation is not straightforward

You must understand the benchmark itself to understand what it tells you

General benchmarks will not tell you about the details of your specific application

Page 16: Performance and Power Benchmarks

When more power is used, a portable system will have a shorter battery life and require recharging more often. This is often the antithesis of performance as most semiconductors require more power to switch faster

Page 17: Performance and Power Benchmarks

nVidia`s Geforce graphic card: The cooling fan on this card is so

powerful that it can be used to clean the door way.

Page 18: Performance and Power Benchmarks

In 2004 problems of overheating led Intel to abandon further development of its Netburst microarchitecture

Page 19: Performance and Power Benchmarks

The newest version of SPEC (SPECpower_ssj2008) counts power consumption as one of the key factor in performance.

overall ssj_ops/Watt Nowadays we often use Gflops/Watt as

an indicator of performance

Page 20: Performance and Power Benchmarks

http://en.wikipedia.org/wiki/Computer_benchmark

http://www.spec.org/power_ssj2008/ http://en.wikipedia.org/wiki/

Megahertz_myth http://en.wikipedia.org/wiki/

Performance_per_watt