GTC On-Demand Featured Talks | GPU Technology...
Transcript of GTC On-Demand Featured Talks | GPU Technology...
![Page 1: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/1.jpg)
![Page 2: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/2.jpg)
●●●●●
![Page 3: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/3.jpg)
●○○
●○○
![Page 4: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/4.jpg)
●○○○○
●○
●○
![Page 5: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/5.jpg)
●○
●○
![Page 6: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/6.jpg)
●●●
![Page 7: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/7.jpg)
![Page 8: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/8.jpg)
●○
●○
●
![Page 9: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/9.jpg)
Solution Sandboxing Enforced Supported
CUDA_VISIBLE_DEVICES ✓ ✘ ✓
Solution Sandboxing Enforced Supported
CUDA_VISIBLE_DEVICES ✓ ✘ ✓
Permissions on /dev/nvidia* ✓ ✓ ✘
Solution Sandboxing Enforced Supported
CUDA_VISIBLE_DEVICES ✓ ✘ ✓
Permissions on /dev/nvidia* ✓ ✓ ✘
cgroups ✓ ✓ ✓
(since
Cuda7)
![Page 10: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/10.jpg)
☓
✓
![Page 11: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/11.jpg)
![Page 12: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/12.jpg)
●○○
![Page 13: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/13.jpg)
![Page 14: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/14.jpg)
![Page 15: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/15.jpg)
Application Optimal CPU/GPU
NAMD (2014) ~2.5
NAMD (2016) ~7
Gromacs ~8
Theano ~1
NVbio ~2
![Page 16: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/16.jpg)
![Page 17: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/17.jpg)
![Page 18: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/18.jpg)
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 coresJob #4: 2 GPUs, 5 coresJob #5: 1 GPU, 2 cores
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2
Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 coresJob #4: 2 GPUs, 5 coresJob #5: 1 GPU, 2 cores
Torque’s cpuset Home solution
![Page 19: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/19.jpg)
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 cores
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2
Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 cores
Torque’s cpuset Home solution
![Page 20: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/20.jpg)
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 cores
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2
Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 cores
Torque’s cpuset Home solution
![Page 21: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/21.jpg)
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 coresJob #4: 2 GPUs, 5 coresJob #5: 1 GPU, 2 cores
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2
Job #1: 1 GPU, 2 coresJob #2: 2 GPUs, 5 coresJob #3: 2 GPUs, 5 coresJob #4: 2 GPUs, 5 coresJob #5: 1 GPU, 2 cores
Torque’s cpuset Home solution
![Page 22: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/22.jpg)
●
●
![Page 23: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/23.jpg)
![Page 24: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/24.jpg)
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2Torque’s solution
GPU0
GPU1
GPU2
GPU3
0 5
1 6
2 7
3 8
4 9
GPU4
GPU5
GPU6
GPU7
10 15
11 16
12 17
13 18
14 19
Socket #1 Socket #2Custom solution
![Page 25: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/25.jpg)
●
○
![Page 26: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/26.jpg)
●○
![Page 27: GTC On-Demand Featured Talks | GPU Technology Conferenceon-demand.gputechconf.com/gtc/2016/presentation/s...10 15 11 16 12 17 13 18 14 19 Socket #1 Socket #2 GPU0 GPU1 GPU2 GPU3 0](https://reader035.fdocuments.in/reader035/viewer/2022070908/5f83f4d74c89af168a7c1463/html5/thumbnails/27.jpg)
●
○○
●○