CUDA Streams & Pipelining Demo

Covers techniques for overlapping computation and memory transfers to maximize GPU utilization using Streams and Events. CUDA Streams & Pipelining Demo turns that idea into something you can manipulate directly and watch respond.

Covers techniques for overlapping computation and memory transfers to maximize GPU utilization using Streams and Events. It focuses on CUDA Streams, CUDA Events, Asynchronous Execution, Pinned Memory, Blocking vs. Non-blocking from the “Asynchronous Execution and Streams” section.

The “Execution Mode”, “Workload Chunks: 4”, “Playback Speed” sliders change the key inputs; the “Synchronous”, “Pipelined (Async)”, “Restart Animation” buttons run actions or reset the demo. Every change updates the visualization in real time, so you can see exactly how each variable affects the outcome.

This course provides a comprehensive introduction to CUDA C++ programming, covering the fundamental architecture and programming model of NVIDIA GPUs. Students will learn how to leverage the Single Instruction, Multiple… This demo is the interactive piece for the “Asynchronous Execution and Streams” section. Open the full 2.1.Intro to CUDA C++ course wiki at https://www.getlykke.com/explore/public/21intro-to-cuda-c-1b53b50f-8aff-44bb-aa75-b57f1f93675c for notes, flashcards, quizzes and the other demos.

You'll build intuition for CUDA Streams, CUDA Events, Asynchronous Execution, Pinned Memory, Blocking vs. Non-blocking — and, crucially, see how they behave when you change the inputs, which is hard to get from a textbook or lecture on 2.1.Intro to CUDA C++ alone.