CUDA Programming Model for Hopper Architecture

This session will introduce new features in CUDA for programming Hopper architecture. The new programming model for Hopper is more hierarchical and asynchronous. CUDA programming for Hopper introduces optional level of hierarchy called Thread Block clusters, that enable multiple thread blocks within the cluster to communicate using a common pool of shared memory. The asynchronous data movement is now hardware accelerated in all directions between global and shared memories. We will look at how to exploit the new programming model in applications for performance tuning.