Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance...
Transcript of Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance...
![Page 1: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/1.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Score-P and ScalascaPortable open-source tools for scalableperformance analysis
February 1, 2014 Alexandre Otto Strube
![Page 2: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/2.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Outline
Going Exascale
Scalasca
We’re not alone
Things got messy
Unification
Who uses/develops Score-P
What is ours
Extreme scalability
The future
February 1, 2014 Alexandre Otto Strube Slide 2
![Page 3: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/3.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Going Exascale
February 1, 2014 Alexandre Otto Strube Slide 3
![Page 4: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/4.jpg)
![Page 5: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/5.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
TL;DR
Single core perfomance peaking
# of cores increasingHybrid environmentsThat affects YOU - TODAY - RIGHT NOWHPC is just the spearheadWe only find the problems before the othersSupercomputers of today → notebooks of tomorrow
February 1, 2014 Alexandre Otto Strube Slide 5
![Page 6: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/6.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
TL;DR
Single core perfomance peaking# of cores increasing
Hybrid environmentsThat affects YOU - TODAY - RIGHT NOWHPC is just the spearheadWe only find the problems before the othersSupercomputers of today → notebooks of tomorrow
February 1, 2014 Alexandre Otto Strube Slide 5
![Page 7: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/7.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
TL;DR
Single core perfomance peaking# of cores increasingHybrid environments
That affects YOU - TODAY - RIGHT NOWHPC is just the spearheadWe only find the problems before the othersSupercomputers of today → notebooks of tomorrow
February 1, 2014 Alexandre Otto Strube Slide 5
![Page 8: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/8.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
TL;DR
Single core perfomance peaking# of cores increasingHybrid environmentsThat affects YOU - TODAY - RIGHT NOW
HPC is just the spearheadWe only find the problems before the othersSupercomputers of today → notebooks of tomorrow
February 1, 2014 Alexandre Otto Strube Slide 5
![Page 9: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/9.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
TL;DR
Single core perfomance peaking# of cores increasingHybrid environmentsThat affects YOU - TODAY - RIGHT NOWHPC is just the spearhead
We only find the problems before the othersSupercomputers of today → notebooks of tomorrow
February 1, 2014 Alexandre Otto Strube Slide 5
![Page 10: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/10.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
TL;DR
Single core perfomance peaking# of cores increasingHybrid environmentsThat affects YOU - TODAY - RIGHT NOWHPC is just the spearheadWe only find the problems before the others
Supercomputers of today → notebooks of tomorrow
February 1, 2014 Alexandre Otto Strube Slide 5
![Page 11: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/11.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
TL;DR
Single core perfomance peaking# of cores increasingHybrid environmentsThat affects YOU - TODAY - RIGHT NOWHPC is just the spearheadWe only find the problems before the othersSupercomputers of today → notebooks of tomorrow
February 1, 2014 Alexandre Otto Strube Slide 5
![Page 12: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/12.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
It doesn’t get easier
Increasing machine complexity (gpu, accelerators, etc)
Every doubling of scale reveals a new bottleneckPerturbation and data volumeDrawing insight from measurements
February 1, 2014 Alexandre Otto Strube Slide 6
![Page 13: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/13.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
It doesn’t get easier
Increasing machine complexity (gpu, accelerators, etc)Every doubling of scale reveals a new bottleneck
Perturbation and data volumeDrawing insight from measurements
February 1, 2014 Alexandre Otto Strube Slide 6
![Page 14: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/14.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
It doesn’t get easier
Increasing machine complexity (gpu, accelerators, etc)Every doubling of scale reveals a new bottleneckPerturbation and data volume
Drawing insight from measurements
February 1, 2014 Alexandre Otto Strube Slide 6
![Page 15: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/15.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
It doesn’t get easier
Increasing machine complexity (gpu, accelerators, etc)Every doubling of scale reveals a new bottleneckPerturbation and data volumeDrawing insight from measurements
February 1, 2014 Alexandre Otto Strube Slide 6
![Page 16: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/16.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Example: Sweep3d Wait States on BG/P (2010)
February 1, 2014 Alexandre Otto Strube Slide 7
![Page 17: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/17.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
This is an old song
Several performance tools exist, for many years
Most cease to work in huge processor/core countsKOJAK performance tool was created 16 years ago.
February 1, 2014 Alexandre Otto Strube Slide 8
![Page 18: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/18.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
This is an old song
Several performance tools exist, for many yearsMost cease to work in huge processor/core counts
KOJAK performance tool was created 16 years ago.
February 1, 2014 Alexandre Otto Strube Slide 8
![Page 19: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/19.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
This is an old song
Several performance tools exist, for many yearsMost cease to work in huge processor/core countsKOJAK performance tool was created 16 years ago.
February 1, 2014 Alexandre Otto Strube Slide 8
![Page 20: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/20.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
Started in 2006 (following KOJAK from ’98)
Goals:
Scalable performance analysis toolsetSpecifically targeting large-scale parallel applications such asthose running on IBM Blue Gene or Cray XT with 10,000s or100,000s of processes
February 1, 2014 Alexandre Otto Strube Slide 9
![Page 21: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/21.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
Started in 2006 (following KOJAK from ’98)Goals:
Scalable performance analysis toolsetSpecifically targeting large-scale parallel applications such asthose running on IBM Blue Gene or Cray XT with 10,000s or100,000s of processes
February 1, 2014 Alexandre Otto Strube Slide 9
![Page 22: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/22.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
Started in 2006 (following KOJAK from ’98)Goals:
Scalable performance analysis toolset
Specifically targeting large-scale parallel applications such asthose running on IBM Blue Gene or Cray XT with 10,000s or100,000s of processes
February 1, 2014 Alexandre Otto Strube Slide 9
![Page 23: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/23.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
Started in 2006 (following KOJAK from ’98)Goals:
Scalable performance analysis toolsetSpecifically targeting large-scale parallel applications such asthose running on IBM Blue Gene or Cray XT with 10,000s or100,000s of processes
February 1, 2014 Alexandre Otto Strube Slide 9
![Page 24: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/24.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)
PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:
scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 25: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/25.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)Portable
IBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:
scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 26: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/26.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10
Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:
scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 27: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/27.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:
scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 28: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/28.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++
MPI 2.2, basic OpenMP & hybrid MPI+OpenMPUnique:
scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 29: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/29.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:
scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 30: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/30.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:
scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 31: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/31.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:scalable trace analysis
Automatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 32: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/32.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:scalable trace analysisAutomatic wait-state search
Parallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 33: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/33.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalability
INSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 34: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/34.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca: Features
Open source (New BSD license)PortableIBM Blue Gene, Cray XT, SGI Altix, IBM SP, blade clusters,Solaris, Linux clusters, NEC SX, K Computer, Fujitsu FX10Supports common parallel programming paradigms &languages
Fortran, C, C++MPI 2.2, basic OpenMP & hybrid MPI+OpenMP
Unique:scalable trace analysisAutomatic wait-state searchParallel replay exploits memory & processors to deliverscalabilityINSIGHTFUL
February 1, 2014 Alexandre Otto Strube Slide 10
![Page 35: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/35.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
This looks understandable...
February 1, 2014 Alexandre Otto Strube Slide 11
![Page 36: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/36.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
... but this is a real code.
February 1, 2014 Alexandre Otto Strube Slide 12
![Page 37: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/37.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
and this.
February 1, 2014 Alexandre Otto Strube Slide 13
![Page 38: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/38.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
... it can get really confusing.
February 1, 2014 Alexandre Otto Strube Slide 14
![Page 39: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/39.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
February 1, 2014 Alexandre Otto Strube Slide 15
![Page 40: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/40.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
February 1, 2014 Alexandre Otto Strube Slide 16
![Page 41: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/41.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
February 1, 2014 Alexandre Otto Strube Slide 17
![Page 42: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/42.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
February 1, 2014 Alexandre Otto Strube Slide 18
![Page 43: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/43.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
February 1, 2014 Alexandre Otto Strube Slide 19
![Page 44: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/44.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Scalasca
February 1, 2014 Alexandre Otto Strube Slide 20
![Page 45: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/45.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
We’re not alone
Several tools exist
Different goals, similar needsSeparate measurement systems and output formatsComplementary features and overlapping functionalityRedundant effort for development and maintenanceLimited or expensive interoperabilityComplications for user experience, support, training
February 1, 2014 Alexandre Otto Strube Slide 21
![Page 46: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/46.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
We’re not alone
Several tools existDifferent goals, similar needs
Separate measurement systems and output formatsComplementary features and overlapping functionalityRedundant effort for development and maintenanceLimited or expensive interoperabilityComplications for user experience, support, training
February 1, 2014 Alexandre Otto Strube Slide 21
![Page 47: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/47.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
We’re not alone
Several tools existDifferent goals, similar needsSeparate measurement systems and output formats
Complementary features and overlapping functionalityRedundant effort for development and maintenanceLimited or expensive interoperabilityComplications for user experience, support, training
February 1, 2014 Alexandre Otto Strube Slide 21
![Page 48: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/48.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
We’re not alone
Several tools existDifferent goals, similar needsSeparate measurement systems and output formatsComplementary features and overlapping functionality
Redundant effort for development and maintenanceLimited or expensive interoperabilityComplications for user experience, support, training
February 1, 2014 Alexandre Otto Strube Slide 21
![Page 49: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/49.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
We’re not alone
Several tools existDifferent goals, similar needsSeparate measurement systems and output formatsComplementary features and overlapping functionalityRedundant effort for development and maintenance
Limited or expensive interoperabilityComplications for user experience, support, training
February 1, 2014 Alexandre Otto Strube Slide 21
![Page 50: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/50.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
We’re not alone
Several tools existDifferent goals, similar needsSeparate measurement systems and output formatsComplementary features and overlapping functionalityRedundant effort for development and maintenanceLimited or expensive interoperability
Complications for user experience, support, training
February 1, 2014 Alexandre Otto Strube Slide 21
![Page 51: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/51.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
We’re not alone
Several tools existDifferent goals, similar needsSeparate measurement systems and output formatsComplementary features and overlapping functionalityRedundant effort for development and maintenanceLimited or expensive interoperabilityComplications for user experience, support, training
February 1, 2014 Alexandre Otto Strube Slide 21
![Page 52: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/52.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Things got messy
February 1, 2014 Alexandre Otto Strube Slide 22
![Page 53: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/53.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Unification
February 1, 2014 Alexandre Otto Strube Slide 23
![Page 54: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/54.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Score-P project idea
Communnity project with common infrastructure
What we share:
Single instrumentation and measurement systemCommon data formats: Open Trace Format 2 (OTF2) fortracesPerformance report: Cube4
Single development effort, testing, supportSingle installation, interoperability, etc
So, Score-P is the base instrumentation/measurement forseveral projects
February 1, 2014 Alexandre Otto Strube Slide 24
![Page 55: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/55.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Score-P project idea
Communnity project with common infrastructureWhat we share:
Single instrumentation and measurement systemCommon data formats: Open Trace Format 2 (OTF2) fortracesPerformance report: Cube4
Single development effort, testing, supportSingle installation, interoperability, etc
So, Score-P is the base instrumentation/measurement forseveral projects
February 1, 2014 Alexandre Otto Strube Slide 24
![Page 56: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/56.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Score-P project idea
Communnity project with common infrastructureWhat we share:
Single instrumentation and measurement system
Common data formats: Open Trace Format 2 (OTF2) fortracesPerformance report: Cube4
Single development effort, testing, supportSingle installation, interoperability, etc
So, Score-P is the base instrumentation/measurement forseveral projects
February 1, 2014 Alexandre Otto Strube Slide 24
![Page 57: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/57.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Score-P project idea
Communnity project with common infrastructureWhat we share:
Single instrumentation and measurement systemCommon data formats: Open Trace Format 2 (OTF2) fortraces
Performance report: Cube4
Single development effort, testing, supportSingle installation, interoperability, etc
So, Score-P is the base instrumentation/measurement forseveral projects
February 1, 2014 Alexandre Otto Strube Slide 24
![Page 58: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/58.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Score-P project idea
Communnity project with common infrastructureWhat we share:
Single instrumentation and measurement systemCommon data formats: Open Trace Format 2 (OTF2) fortracesPerformance report: Cube4
Single development effort, testing, supportSingle installation, interoperability, etc
So, Score-P is the base instrumentation/measurement forseveral projects
February 1, 2014 Alexandre Otto Strube Slide 24
![Page 59: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/59.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Score-P project idea
Communnity project with common infrastructureWhat we share:
Single instrumentation and measurement systemCommon data formats: Open Trace Format 2 (OTF2) fortracesPerformance report: Cube4
Single development effort, testing, support
Single installation, interoperability, etc
So, Score-P is the base instrumentation/measurement forseveral projects
February 1, 2014 Alexandre Otto Strube Slide 24
![Page 60: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/60.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Score-P project idea
Communnity project with common infrastructureWhat we share:
Single instrumentation and measurement systemCommon data formats: Open Trace Format 2 (OTF2) fortracesPerformance report: Cube4
Single development effort, testing, supportSingle installation, interoperability, etc
So, Score-P is the base instrumentation/measurement forseveral projects
February 1, 2014 Alexandre Otto Strube Slide 24
![Page 61: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/61.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Who uses/develops Score-P?
Scalasca (Fz-Juelich, RTWH Aachen)
Vampir (TU Dresden)Periscope (Tu Munich)Tau (U. Oregon)
February 1, 2014 Alexandre Otto Strube Slide 25
![Page 62: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/62.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Who uses/develops Score-P?
Scalasca (Fz-Juelich, RTWH Aachen)Vampir (TU Dresden)
Periscope (Tu Munich)Tau (U. Oregon)
February 1, 2014 Alexandre Otto Strube Slide 25
![Page 63: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/63.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Who uses/develops Score-P?
Scalasca (Fz-Juelich, RTWH Aachen)Vampir (TU Dresden)Periscope (Tu Munich)
Tau (U. Oregon)
February 1, 2014 Alexandre Otto Strube Slide 25
![Page 64: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/64.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Who uses/develops Score-P?
Scalasca (Fz-Juelich, RTWH Aachen)Vampir (TU Dresden)Periscope (Tu Munich)Tau (U. Oregon)
February 1, 2014 Alexandre Otto Strube Slide 25
![Page 65: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/65.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
And why we did it?
February 1, 2014 Alexandre Otto Strube Slide 26
![Page 66: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/66.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Cleaning the house
February 1, 2014 Alexandre Otto Strube Slide 27
![Page 67: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/67.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functions
Generation of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profiles
Needs recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 68: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/68.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profiles
Needs recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 69: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/69.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinking
Minimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profiles
Needs recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 70: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/70.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overhead
Times each function was calledTime spent in each functionAmount of data transferred
Call-path profiles
Needs recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 71: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/71.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was called
Time spent in each functionAmount of data transferred
Call-path profiles
Needs recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 72: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/72.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each function
Amount of data transferredCall-path profiles
Needs recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 73: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/73.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profiles
Needs recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 74: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/74.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profiles
Needs recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 75: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/75.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profilesNeeds recompilation
Some overhead - might need filteringTrace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 76: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/76.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profilesNeeds recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 77: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/77.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profilesNeeds recompilationSome overhead - might need filtering
Trace analysis
Identifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 78: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/78.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profilesNeeds recompilationSome overhead - might need filtering
Trace analysisIdentifies inneficiency patterns in communication andsynchronization
Traces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 79: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/79.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
What do we measure?
Measurement of MPI, OpenMP, User-level functionsGeneration of flat MPI profiles
Only relinkingMinimum overheadTimes each function was calledTime spent in each functionAmount of data transferred
Call-path profilesNeeds recompilationSome overhead - might need filtering
Trace analysisIdentifies inneficiency patterns in communication andsynchronizationTraces can quickly get huge - better filter that
February 1, 2014 Alexandre Otto Strube Slide 28
![Page 80: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/80.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Extreme scalability
All parallel:
Data collection/reduction
Analysis:
Pattern searchDelay analysisCritical-path analysis
Visualization
February 1, 2014 Alexandre Otto Strube Slide 29
![Page 81: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/81.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Extreme scalability
All parallel:
Data collection/reductionAnalysis:
Pattern searchDelay analysisCritical-path analysis
Visualization
February 1, 2014 Alexandre Otto Strube Slide 29
![Page 82: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/82.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Extreme scalability
All parallel:
Data collection/reductionAnalysis:
Pattern search
Delay analysisCritical-path analysis
Visualization
February 1, 2014 Alexandre Otto Strube Slide 29
![Page 83: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/83.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Extreme scalability
All parallel:
Data collection/reductionAnalysis:
Pattern searchDelay analysis
Critical-path analysis
Visualization
February 1, 2014 Alexandre Otto Strube Slide 29
![Page 84: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/84.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Extreme scalability
All parallel:
Data collection/reductionAnalysis:
Pattern searchDelay analysisCritical-path analysis
Visualization
February 1, 2014 Alexandre Otto Strube Slide 29
![Page 85: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/85.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Extreme scalability
All parallel:
Data collection/reductionAnalysis:
Pattern searchDelay analysisCritical-path analysis
Visualization
February 1, 2014 Alexandre Otto Strube Slide 29
![Page 86: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/86.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Some MPI patterns
time
pro
cess
ENTER EXIT SEND RECV COLLEXIT
(a) Late Sendertime
pro
cess
(b) Late Receiver
time
pro
cess
(d) Wait at N x Ntime
pro
cess
(c) Late Sender / Wrong Order
February 1, 2014 Alexandre Otto Strube Slide 30
![Page 87: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/87.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Late sender
February 1, 2014 Alexandre Otto Strube Slide 31
![Page 88: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/88.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Late sender and application topology
February 1, 2014 Alexandre Otto Strube Slide 32
![Page 89: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/89.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Direct wait time analysis
A
B
C Recv
Send
Send
foo
foo
foo
bar
bar Recv
bar
time
Recv
Recv
Direct wait
February 1, 2014 Alexandre Otto Strube Slide 33
![Page 90: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/90.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Indirect wait time analysis
Recv
Send
Send
foo
foo
foo
bar
bar Recv
A
B
C
bar
time
Recv
Direct waitIndirect wait
Recv
February 1, 2014 Alexandre Otto Strube Slide 34
![Page 91: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/91.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Direct wait time
February 1, 2014 Alexandre Otto Strube Slide 35
![Page 92: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/92.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Indirect wait time analysis
February 1, 2014 Alexandre Otto Strube Slide 36
![Page 93: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/93.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
Root cause analysis
A
B
C Recv
Send
Send
foo
foo
foo
bar
bar Recv
barDELAY
time
Recv
Recv
Direct waitIndirect wait
Recv
cause
February 1, 2014 Alexandre Otto Strube Slide 37
![Page 94: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/94.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
6D Hardware topology
February 1, 2014 Alexandre Otto Strube Slide 38
![Page 95: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/95.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
The Future
February 1, 2014 Alexandre Otto Strube Slide 39
![Page 96: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/96.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
The Future
Energy awareness
Bring performance analysis to YOU!There’s a bunch of experts craving for users and parallelapplication [email protected]://www.scalasca.org
February 1, 2014 Alexandre Otto Strube Slide 40
![Page 97: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/97.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
The Future
Energy awarenessBring performance analysis to YOU!
There’s a bunch of experts craving for users and parallelapplication [email protected]://www.scalasca.org
February 1, 2014 Alexandre Otto Strube Slide 40
![Page 98: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/98.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
The Future
Energy awarenessBring performance analysis to YOU!There’s a bunch of experts craving for users and parallelapplication developers!
[email protected]://www.scalasca.org
February 1, 2014 Alexandre Otto Strube Slide 40
![Page 99: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/99.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
The Future
Energy awarenessBring performance analysis to YOU!There’s a bunch of experts craving for users and parallelapplication [email protected]
http://www.scalasca.org
February 1, 2014 Alexandre Otto Strube Slide 40
![Page 100: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/100.jpg)
Mem
bero
fthe
Hel
mho
ltz-A
ssoc
iatio
n
The Future
Energy awarenessBring performance analysis to YOU!There’s a bunch of experts craving for users and parallelapplication [email protected]://www.scalasca.org
February 1, 2014 Alexandre Otto Strube Slide 40
![Page 101: Score-P and Scalasca and Scalasca... · Portable open-source tools for scalable performance analysis February 1, 2014 Alexandre Otto Strube. Helmholtz-Association Outline Going Exascale](https://reader033.fdocuments.in/reader033/viewer/2022060600/6053f5a747df6a7a0843a247/html5/thumbnails/101.jpg)