Optimistic Assumptions in Polyhedral...
Transcript of Optimistic Assumptions in Polyhedral...
![Page 1: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/1.jpg)
Optimistic Assumptions in Polyhedral Compilation
Johannes Doerfert 1 Tobias Grosser 2
1Saarland UniversitySaarbrücken, Germany
2ETH ZürichZürich, Switzerland
October 29, 2015
![Page 2: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/2.jpg)
computer science
saarlanduniversity
Be Optimistic!Programs might be nasty but programmers are not.
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 2 / 20
![Page 3: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/3.jpg)
computer science
saarlanduniversityWhen static information are insufficient
Optimistic Assumptions & Speculative Versioning
Optimistic Assumptions
1 Make optimistic assumptions to (better) optimize loops
2 Derive runtime conditions that imply these assumptions
3 Version the code based on the assumptions made and conditions derived.
Speculative Versioning
if (/* Runtime Conditions */)/* Optimized Loop Nest */
else/* Original Loop Nest */
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 3 / 20
![Page 4: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/4.jpg)
computer science
saarlanduniversityWhen static information are insufficient
Optimistic Assumptions & Speculative Versioning
Optimistic Assumptions
1 Make optimistic assumptions to (better) optimize loops
2 Derive runtime conditions that imply these assumptions
3 Version the code based on the assumptions made and conditions derived.
Speculative Versioning
if (/* Runtime Conditions */)/* Optimized Loop Nest */
else/* Original Loop Nest */
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 3 / 20
![Page 5: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/5.jpg)
computer science
saarlanduniversityWhen static information are insufficient
Optimistic Assumptions & Speculative Versioning
Optimistic Assumptions
1 Make optimistic assumptions to (better) optimize loops
2 Derive runtime conditions that imply these assumptions
3 Version the code based on the assumptions made and conditions derived.
Speculative Versioning
if (/* Runtime Conditions */)/* Optimized Loop Nest */
else/* Original Loop Nest */
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 3 / 20
![Page 6: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/6.jpg)
computer science
saarlanduniversityWhen static information are insufficient
Optimistic Assumptions & Speculative Versioning
Optimistic Assumptions
1 Make optimistic assumptions to (better) optimize loops
2 Derive runtime conditions that imply these assumptions
3 Version the code based on the assumptions made and conditions derived.
Speculative Versioning
if (/* Runtime Conditions */)/* Optimized Loop Nest */
else/* Original Loop Nest */
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 3 / 20
![Page 7: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/7.jpg)
computer science
saarlanduniversityWhen static information are insufficient
Optimistic Assumptions & Speculative Versioning
Optimistic Assumptions
1 Make optimistic assumptions to (better) optimize loops
2 Derive runtime conditions that imply these assumptions
3 Version the code based on the assumptions made and conditions derived.
Speculative Versioning
if (/* Runtime Conditions */)/* Optimized Loop Nest */
else/* Original Loop Nest */
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 3 / 20
![Page 8: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/8.jpg)
computer science
saarlanduniversityWhen static information are insufficient
Optimistic Assumptions & Speculative Versioning
Optimistic Assumptions
1 Make optimistic assumptions to (better) optimize loops
2 Derive runtime conditions that imply these assumptions
3 Version the code based on the assumptions made and conditions derived.
Speculative Versioning
if (/* Runtime Conditions */)/* Optimized Loop Nest */
else/* Original Loop Nest */
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 3 / 20
![Page 9: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/9.jpg)
computer science
saarlanduniversityWhen static information are insufficient
Runtime Conditions
Runtime Conditions
Fast to derive (compile time)
Fast to verify (runtime)
High probability to be true
ToDo: A feedback/profile driven approach
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 4 / 20
![Page 10: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/10.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
(A) Applicability/Correctness1 No Alias Assumption1
2 No Wrapping Assumption2
3 Finite Loops Assumption2
4 Array In-bounds Assumption2
5 Valid Multidimensional View Assumption (Delinearization)3
(B) Optimizations1 Array In-bounds Check Hoisting2
2 Parametric Dependence Distances4
3 Possibly Invariant Loads
1Joint work Fabrice Rastello (INRIA Grenoble) & others. [OOPSLA’15]2Joint work with Tobias Grosser (ETH)3Tobias Grosser & Sebastian Pop (Samsung) [ICS’15]4Joint work with Zino Benaissa (Qualcomm)
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 5 / 20
![Page 11: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/11.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Alias Assumptions
void mem_copy(int N, float *A, float *B) {if (&A[0] >= &B[N+5] || &A[N] <= &B[5]) {
#pramga vectorizefor (i = 0; i < N; i++)
A[i] = B[i+5];
} else {/* original code */
}}
Compare minimal/maximal accesses to possible aliasing arrays
Use the iteration domain of the accessesDo not compare accesses to read-only arrays
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 6 / 20
![Page 12: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/12.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Alias Assumptions
void mem_copy(int N, float *A, float *B) {if (&A[0] >= &B[N+5] || &A[N] <= &B[5]) {
#pramga vectorizefor (i = 0; i < N; i++)
A[i] = B[i+5];
} else {/* original code */
}}
Compare minimal/maximal accesses to possible aliasing arraysUse the iteration domain of the accessesDo not compare accesses to read-only arrays
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 6 / 20
![Page 13: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/13.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Alias Assumptions
void mem_copy(int N, float *A, float *B) {if (&A[0] >= &B[N+5] || &A[N] <= &B[5]) {
#pramga vectorizefor (i = 0; i < N; i++)
A[i] = B[i+5];
} else {/* original code */
}}
Compare minimal/maximal accesses to possible aliasing arrays
Use the iteration domain of the accessesDo not compare accesses to read-only arrays
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 6 / 20
![Page 14: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/14.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Alias Assumptions
void evn_odd(int N, int *Evn , int *Odd , int *A, int *B) {
if (N%2 ? ((&B[N+1] <= &Odd [0] || &Odd[(N+1)/2] <= &B[1]) &&(&A[N+1] <= &Odd[0] || &Odd[(N+1)/2] <= &A[1]))
: ((&B[N] <= &Evn[0] || &Evn[(N+1)/2] <= &B[0]) &&(&A[N] <= &Evn [0] || &Evn[(N+1)/2] <= &A[0])) ) {
for (int i = 0; i < N; i += 2)if (N % 2)
Odd[i/2] = A[i+1] - B[i+1];else
Evn[i/2] = A[i] + B[i];
} else {/* original code */
}}
Compare minimal/maximal accesses to possible aliasing arrays
Do not compare accesses to read-only arrays
Use the iteration domain of the accesses
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 7 / 20
![Page 15: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/15.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Alias Assumptions
void evn_odd(int N, int *Evn , int *Odd , int *A, int *B) {
if (N%2 ? ((&B[N+1] <= &Odd [0] || &Odd[(N+1)/2] <= &B[1]) &&(&A[N+1] <= &Odd[0] || &Odd[(N+1)/2] <= &A[1]))
: ((&B[N] <= &Evn[0] || &Evn[(N+1)/2] <= &B[0]) &&(&A[N] <= &Evn [0] || &Evn[(N+1)/2] <= &A[0])) ) {
for (int i = 0; i < N; i += 2)if (N % 2)
Odd[i/2] = A[i+1] - B[i+1];else
Evn[i/2] = A[i] + B[i];
} else {/* original code */
}}
Compare minimal/maximal accesses to possible aliasing arrays
Do not compare accesses to read-only arrays
Use the iteration domain of the accesses
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 7 / 20
![Page 16: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/16.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Alias Assumptions
void evn_odd(int N, int *Evn , int *Odd , int *A, int *B) {
if (N%2 ? ((&B[N+1] <= &Odd [0] || &Odd[(N+1)/2] <= &B[1]) &&(&A[N+1] <= &Odd[0] || &Odd[(N+1)/2] <= &A[1]))
: ((&B[N] <= &Evn[0] || &Evn[(N+1)/2] <= &B[0]) &&(&A[N] <= &Evn [0] || &Evn[(N+1)/2] <= &A[0])) ) {
for (int i = 0; i < N; i += 2)if (N % 2)
Odd[i/2] = A[i+1] - B[i+1];else
Evn[i/2] = A[i] + B[i];
} else {/* original code */
}}
Compare minimal/maximal accesses to possible aliasing arrays
Do not compare accesses to read-only arrays
Use the iteration domain of the accesses
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 7 / 20
![Page 17: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/17.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Alias Assumptions
void evn_odd(int N, int *Evn , int *Odd , int *A, int *B) {
if (N%2 ? ((&B[N+1] <= &Odd[0] || &Odd[(N+1)/2] <= &B[1]) &&(&A[N+1] <= &Odd[0] || &Odd[(N+1)/2] <= &A[1]))
: ((&B[N] <= &Evn[0] || &Evn[(N+1)/2] <= &B[0]) &&(&A[N] <= &Evn [0] || &Evn[(N+1)/2] <= &A[0])) ) {
for (int i = 0; i < N; i += 2)if (N % 2)
Odd[i/2] = A[i+1] - B[i+1];else
Evn[i/2] = A[i] + B[i];
} else {/* original code */
}}
Compare minimal/maximal accesses to possible aliasing arrays
Do not compare accesses to read-only arrays
Use the iteration domain of the accesses
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 7 / 20
![Page 18: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/18.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Wrapping Assumption
void mem_shift(unsigned char N, float *A) {if (N <= 128) {
#pramga vectorizefor (unsigned char i = 0; i < N; i++)
A[i] = A[N + i];
} else {/* original code */
}}
Finite bit width can cause integer expressions to “wrap around”
Wrapping causes multiple addresses for one memory location
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 8 / 20
![Page 19: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/19.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Wrapping Assumption
void mem_shift(unsigned char N, float *A) {if (N <= 128) {
#pramga vectorizefor (unsigned char i = 0; i < N; i++)
A[i] = A[N + i];
} else {/* original code */
}}
Finite bit width can cause integer expressions to “wrap around”
Wrapping causes multiple addresses for one memory location
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 8 / 20
![Page 20: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/20.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Wrapping Assumption
i ∗ c0 + p ∗ c1 ≡p (i ∗ c0 + p ∗ c1) mod 2k
i ∈ [0, N-1] ∧ N ∈ [0, 28]
(N + i) ≡p (N + i) mod 28
=⇒ (N + i) ≤p 255
=⇒ N ≤ 128
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 9 / 20
![Page 21: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/21.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Wrapping Assumption
i ∗ c0 + p ∗ c1 ≡p (i ∗ c0 + p ∗ c1) mod 2k
i ∈ [0, N-1] ∧ N ∈ [0, 28]
(N + i) ≡p (N + i) mod 28
=⇒ (N + i) ≤p 255
=⇒ N ≤ 128
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 9 / 20
![Page 22: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/22.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Wrapping Assumption
i ∗ c0 + p ∗ c1 ≡p (i ∗ c0 + p ∗ c1) mod 2k
i ∈ [0, N-1] ∧ N ∈ [0, 28]
(N + i) ≡p (N + i) mod 28
=⇒ (N + i) ≤p 255
=⇒ N ≤ 128
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 9 / 20
![Page 23: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/23.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
No Wrapping Assumption
i ∗ c0 + p ∗ c1 ≡p (i ∗ c0 + p ∗ c1) mod 2k
i ∈ [0, N-1] ∧ N ∈ [0, 28]
(N + i) ≡p (N + i) mod 28
=⇒ (N + i) ≤p 255
=⇒ N ≤ 128
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 9 / 20
![Page 24: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/24.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Finite Loops Assumption
void mem_shift(unsigned N, float *A) {if (N % 2 == 0) {
#pramga vectorizefor (unsigned i = 0; i != N; i+=2)
A[i+4] = A[i];
} else {/* original code */
}}
Allows to provide other LLVM passes real loop bounds
Infinite loops create unbounded optimization problems
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 10 / 20
![Page 25: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/25.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Finite Loops Assumption
void mem_shift(unsigned N, float *A) {if (N % 2 == 0) {
#pramga vectorizefor (unsigned i = 0; i != N; i+=2)
A[i+4] = A[i];
} else {/* original code */
}}
Allows to provide other LLVM passes real loop bounds
Infinite loops create unbounded optimization problems
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 10 / 20
![Page 26: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/26.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Array In-bounds Assumptions
void stencil(int N, int M, float A[128][128]) {if (N <= 128) {
#pragma loop interchangefor (int i = 0; i < N; i++)
for (int j = 0; j < M; j++)A[2*j][i] += A[2*j+1][i];
} else {/* original code */
}}
Out-of-bound accesses introduce multiple addresses for one memorylocation (e.g., &A[1][0] == &A[0][128])
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 11 / 20
![Page 27: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/27.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Array In-bounds Assumptions
void stencil(int N, int M, float A[128][128]) {if (N <= 128) {
#pragma loop interchangefor (int i = 0; i < N; i++)
for (int j = 0; j < M; j++)A[2*j][i] += A[2*j+1][i];
} else {/* original code */
}}
Out-of-bound accesses introduce multiple addresses for one memorylocation (e.g., &A[1][0] == &A[0][128])
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 11 / 20
![Page 28: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/28.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Array In-bounds Assumptions
void stencil(int N, int M, float A[128][128]) {if (N <= 128) {
#pragma loop interchangefor (int i = 0; i < N; i++)
for (int j = 0; j < M; j++)A[2*j][i] += A[2*j+1][i];
} else {/* original code */
}}
Out-of-bound accesses introduce multiple addresses for one memorylocation (e.g., &A[1][0] == &A[0][128])
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 11 / 20
![Page 29: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/29.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Valid Multidimensional View Assumption
#define A(x, y) A[n1 * x + y]void set_subarray(float *A, int o0, int o1, int s0,
int s1, int n0, int n1) {if (o1 + s1 <= n1) {
#pragma parallelfor (int i = 0; i < s0; i++)
for (int j = 0; j < s1; j++)A(o0 + i, o1 + j) = 1;
} else {/* original code */
}}
Define multi-dimensional view of a linearized (one-dimensional) array
Derive conditions that accesses are in-bounds for each dimension
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 12 / 20
![Page 30: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/30.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Valid Multidimensional View Assumption
#define A(x, y) A[n1 * x + y]void set_subarray(float *A, int o0, int o1 , int s0 ,
int s1, int n0, int n1) {if (o1 + s1 <= n1) {
#pragma parallelfor (int i = 0; i < s0; i++)
for (int j = 0; j < s1; j++)A(o0 + i, o1 + j) = 1;
} else {/* original code */
}}
Define multi-dimensional view of a linearized (one-dimensional) array
Derive conditions that accesses are in-bounds for each dimension
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 12 / 20
![Page 31: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/31.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Valid Multidimensional View Assumption
#define A(x, y) A[n1 * x + y]void set_subarray(float *A, int o0, int o1, int s0,
int s1, int n0, int n1) {if (o1 + s1 <= n1) {
#pragma parallelfor (int i = 0; i < s0; i++)
for (int j = 0; j < s1; j++)A(o0 + i, o1 + j) = 1;
} else {/* original code */
}}
Define multi-dimensional view of a linearized (one-dimensional) array
Derive conditions that accesses are in-bounds for each dimension
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 12 / 20
![Page 32: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/32.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Array In-bounds Check Hoisting
struct SafeArray { int Size , int *Array };
inline void set(SafeArray A, int idx , int val) {if (idx < 0 || A.Size <= idx)
throw OutOfBounds;A.Array[idx] = val;
}
void set_safe_array(int N, SafeArray A) {for (int i = 0; i < N; i++)
for (int j = 0; j < i/2; j++)set(A, i+j, 1); /* Throws out -of-bounds */
}
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 13 / 20
![Page 33: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/33.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Array In-bounds Check Hoisting
struct SafeArray { int Size , int *Array };
inline void set(SafeArray A, int idx , int val) {if (idx < 0 || A.Size <= idx)
throw OutOfBounds;A.Array[idx] = val;
}
void set_safe_array(int N, SafeArray A) {for (int i = 0; i < N; i++)
for (int j = 0; j < i/2; j++)set(A, i+j, 1); /* Throws out -of-bounds */
}
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 13 / 20
![Page 34: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/34.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Array In-bounds Check Hoisting
struct SafeArray { int Size , int *Array };
inline void set(SafeArray A, int idx , int val) {if (idx < 0 || A.Size <= idx)
throw OutOfBounds;A.Array[idx] = val;
}
void set_safe_array(int N, SafeArray A) {for (int i = 0; i < N; i++)
for (int j = 0; j < i/2; j++)set(A, i+j, 1); /* Throws out -of-bounds */
}
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 13 / 20
![Page 35: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/35.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Array In-bounds Check Hoisting
struct SafeArray { int Size , int *Array };
inline void set(SafeArray A, int idx , int val) {if (idx < 0 || A.Size <= idx)
throw OutOfBounds;A.Array[idx] = val;
}
void set_safe_array(int N, SafeArray A) {if ((3*N)/2 <= A.Size) {
for (int i = 0; i < N; i++)for (int j = 0; j < i/2; j++)
A[i+j] = 1;
} else {/* original code */
}}
Hoist in-bounds access conditions out of the loop nest
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 14 / 20
![Page 36: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/36.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Array In-bounds Check Hoisting
struct SafeArray { int Size , int *Array };
inline void set(SafeArray A, int idx , int val) {if (idx < 0 || A.Size <= idx)
throw OutOfBounds;A.Array[idx] = val;
}
void set_safe_array(int N, SafeArray A) {if ((3*N)/2 <= A.Size) {
for (int i = 0; i < N; i++)for (int j = 0; j < i/2; j++)
A[i+j] = 1;
} else {/* original code */
}}
Hoist in-bounds access conditions out of the loop nestJohannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 14 / 20
![Page 37: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/37.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Check Hoisting
void copy(int N, double A[N][N], double B[N][N]) {if (DebugLevel <= 5) {
#pragma parallelfor (int i = 0; i < N; i++)
#pragma simdfor (int j = 0; j < N; j++)
A[i][j] = B[i][j];
} else {
for (int i = 0; i < N; i++) {for (int j = 0; j < N; j++)
A[i][j] = B[i][j];
if (DebugLevel > 5)printf("Column␣\%d␣copied\n", i)
}
}}
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 15 / 20
![Page 38: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/38.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Parametric Dependence Distances
void vectorize(int N, double *A) {if (c >= 4) {
#pragma vectorize width (4)for (int i = c; i < N+c; i++)
A[i-c] += A[i];
} else {/* original code */
}}
Assume large enough dependence distance, e.g., for vectorization
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 16 / 20
![Page 39: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/39.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Parametric Dependence Distances
void vectorize(int N, double *A) {if (c >= 4) {
#pragma vectorize width (4)for (int i = c; i < N+c; i++)
A[i-c] += A[i];
} else {/* original code */
}}
Assume large enough dependence distance, e.g., for vectorization
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 16 / 20
![Page 40: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/40.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
void may_load(int *size0 , int *size1) {for (int i = 0; i < *size0; i++)
for (int j = 0; j < *size1; j++)...
}
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 17 / 20
![Page 41: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/41.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Possibly Invariant Loads
void may_load(int *size0 , int *size1) {int size0val = *size0;int size1val = 1;
if (size0val > 0)size1val = *size1;
for (int i = 0; i < size0val; i++)for (int j = 0; j < size1val; j++)
...}
Hoist invariant loads
Keep conditions for conditionally executed loads
Powerful in combination with alias checks
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 18 / 20
![Page 42: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/42.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Possibly Invariant Loads
void may_load(int *size0 , int *size1) {int size0val = *size0;int size1val = 1;
if (size0val > 0)size1val = *size1;
for (int i = 0; i < size0val; i++)for (int j = 0; j < size1val; j++)
...}
Hoist invariant loads
Keep conditions for conditionally executed loads
Powerful in combination with alias checks
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 18 / 20
![Page 43: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/43.jpg)
computer science
saarlanduniversityOptimistic Assumptions in Polly
Possibly Invariant Loads
void may_load(int *size0 , int *size1) {int size0val = *size0;int size1val = 1;
if (size0val > 0)size1val = *size1;
for (int i = 0; i < size0val; i++)for (int j = 0; j < size1val; j++)
...}
Hoist invariant loads
Keep conditions for conditionally executed loads
Powerful in combination with alias checks
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 18 / 20
![Page 44: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/44.jpg)
computer science
saarlanduniversityOngoing Work
Use profiling to minimize non-beneficial code duplication
Derive more powerful checks (e.g., generate inspector loops)
Find more opportunities to speculatively optimize using runtime conditions
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 19 / 20
![Page 45: Optimistic Assumptions in Polyhedral Compilationllvm.org/devmtg/.../DoerfertGrosser-OptimisticAssumptionsInPolly.pdf · Programs might be nasty but programmers are not. Johannes Doerfert](https://reader034.fdocuments.in/reader034/viewer/2022050407/5f84081439145b37fd4148bf/html5/thumbnails/45.jpg)
computer science
saarlanduniversity
Thank You.
Johannes Doerfert , Tobias Grosser Be Optimistic! October 29, 2015 20 / 20