CUDA Developer Tools | Performance Analysis with NVIDIA Nsight Systems Timeline

In this episode of the CUDA Developer Tools tutorial series, Eyal Soha, senior software engineer at NVIDIA, introduces code performance analysis using the Timeline View in NVIDIA Nsight Systems. Basic knowledge of C++ CUDA programming is recommended. 

Highlights include:

◽ Explore the Nsight Systems timeline, a powerful tool for analyzing GPU performance. Learn how the Timeline View helps you understand code processes and uncover optimization opportunities.

◽ Get an overview of the timeline interface and how to navigate the metrics Nsight Systems collects. Read the timeline, customize your view, and understand CPU and GPU utilization.

◽ Learn how NVTX markers in the code add annotations to the timeline, highlighting essential activities such as memory transfers and kernel executions. 

◽ Learn how to use the timeline view to make improvements to your code. Understand concepts like "latency hiding" to identify bottlenecks and make informed optimizations. Explore the benefits of parallelism and uncover how asynchronous operations can impact code performance. 

Check out the blog post the code being analyzed in this tutorial is based on: https://developer.nvidia.com/blog/how-overlap-data-transfers-cuda-cc/

Learn more about CUDA Developer Tools: https://developer.nvidia.com/tools-overview