NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured...
Transcript of NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured...
![Page 1: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/1.jpg)
GPU Technology Conference| September 30th 2009
NVIDIA Nexus – Application Development Environment for Heterogeneous Platforms
![Page 2: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/2.jpg)
Windows Development Environment
Vis
ual Stu
dio
Build
Debug
Profile
CPU
GPU
Tools
Compiler
Shader Debugger
Languages
GPU
Compute Debugger
Compute Profiler
Graphics Debugger
Graphics Profiler
Edit
![Page 3: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/3.jpg)
… what developers really want
Vis
ual Stu
dio
ProfileGPU Performance
Tools
DebugGPU Source and
Graphics Debugger
BuildCPU
GPU
CUDA Project
System
Platform Analysis
CPU GPU
EditCPU
GPU
GPU Code Browsing
Intellisense
GPU
CPU
GPU
CPU
![Page 4: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/4.jpg)
NVIDIA Nexus
• Full-featured debugging on GPU
• Platform-wide activity analysis
• Visual Studio 2008 integration
Enables Seamless Co-Processing Development
![Page 5: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/5.jpg)
C/C++
DirectX10/DirectX11 and OpenGLCUDA Driver API, OpenCL and DirectCompute
GPU
Nexus OverviewMicrosoft Visual Studio 2008 SP1
CPU
Debug
DirectX Frame
Nexus
Build Profile
HLSL Source
CUDA
DirectX Frame System Trace: OS,
CUDA, DirectX,
OpenCL,
OpenGL/Cg, and
User eventsDirectX HUD and
Experiments
CUDA C Project
System
User Application
HLSLCUDA C, OpenCL C, and HLSL
![Page 6: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/6.jpg)
Native GPU Debugging
• No emulation
• No arithmetic discrepancy
• GPU pauses at the breakpoint
• Inspect GPU state and memory
• Faster programmer productivity
![Page 7: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/7.jpg)
CUDA ArchitectureThread
per-threadlocal memory
Block
per-blockshared
memory
Kernel 0
. . .per-device
globalmemory
. . .
Kernel 1
. . .Global barrier
Local barrier
![Page 8: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/8.jpg)
My Heterogeneous Computing Sample…CPU GPU
GPU Memory
Patch of 3D
vertices
Fancy initialization
Sinesoid
High_frequency_sinesoid
DeviceToHost memcpy
glDrawArray(…)
Tim
e
![Page 9: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/9.jpg)
Nexus C-CUDA Debugger Demo
![Page 10: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/10.jpg)
Developing for Heterogeneous Platforms
• CPU and GPU cooperation
• PCI-E / memory transfers
• Latency
![Page 11: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/11.jpg)
Platform Analysis
• Collect platform activity
– OS – process, thread, thread switch, and module
events
– CPU API Trace – CUDA driver API, DirectX, OpenGL,
OpenCL, Cg2.2 and User Events
– GPU Task Trace – C-CUDA and OpenCL launches and
memory copies
• Display summary pages, timeline, API call logs,
and GPU task logs
![Page 12: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/12.jpg)
Nexus Platform Analysis Demo
![Page 13: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/13.jpg)
CUDA Profiling
• Kernel tuning basic
– Memory coalescing
– Branch divergence
– Instructions executed
– Warp serialization
• Use of hardware performance counters
![Page 14: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/14.jpg)
Nexus CUDA Profiler
![Page 15: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/15.jpg)
Nexus Build
• C++ project system
– Nexus options: launch, sync,…
– CUDA vsprop files
• CUDA project system
– NVCC build integration
– Error reporting
– Debugger session
![Page 16: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/16.jpg)
Nexus Products
Nexus Standard Nexus ProfessionalPrice Free $349
PlatformsWindows Vista SP1
Windows 7
Windows Vista SP1
Windows 7
IDE IntegrationVisual Studio 2008 SP1 Standard
and above
Visual Studio 2008 SP1 Standard
and above
CUDA -C debugging and profiling
DirectCompute debugging and profiling
Remote Debugging
OpenCL Profiling
Memory Checker
Data breakpoints -
Buffer Visualizer -
System Trace (CPU + GPU) -
Priority Ticket Support -
![Page 17: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/17.jpg)
Supported Operating Systems
32bit
64bit
32-on-64Windows Vista SP1 Windows 7
![Page 18: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/18.jpg)
System Requirements
Remote Debugging
Desktop Mobile
![Page 19: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/19.jpg)
System Requirements
Full GPU acceleration
Full GPU acceleration
SLI Multi-OS Multi-GPU
Local Debugging
![Page 20: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/20.jpg)
GPU Requirements
• CUDA 1.1 capable GPU
• GeForce 9 and GTX series
• QuadroFX x700 and x800 series
• Tesla C1060
• Fermi architecture-based products
• Non-NVIDIA DirectX 10 and 11 GPUs (with reduced
feature set)
![Page 21: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/21.jpg)
Roadmap and Schedule
Beta1
October ‘09
Beta2
January ‘10
Release
Q1’10
C-CUDA
DirectX 10
DirectCompute
DirectX 11
OpenCL 1.0
OpenGL 3.2/Cg2.2 Trace only
Trace only
Trace only
Trace only
Trace only
![Page 22: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/22.jpg)
Conclusion and Recap
• Revolutionizing GPU development
– GPU is now a first-class development target
– All Compute and Graphics languages and APIs
• Co-Processing Development Solution
– Clear view of the overall platform activities
– Deep analysis of specific workloads
• Visual Studio 2008 SP1 Standard and Above
• Windows Vista SP1 and Windows 7
![Page 23: NVIDIA Nexus Application Development Environment for …€¦ · NVIDIA Nexus •Full-featured debugging on GPU •Platform-wide activity analysis •Visual Studio 2008 integration](https://reader033.fdocuments.in/reader033/viewer/2022050609/5fafef4f4d6f755b437a50a4/html5/thumbnails/23.jpg)
Q&A• 1-hour Nexus Labs @ Piedmont Room:
– Friday (2pm-5pm)
• Register for the Beta program today:
http://developer.nvidia.com/object/nexus.html
• For Linux - CUDA-gdb talk
– Friday, Gold Room at 2h30pm