https://sankethbk.github.io/blog/tags/programming/Recent content in Programming on Sanketh's BlogHugo -- 0.166.0en-usSun, 30 Aug 2026 00:00:00 +0000https://sankethbk.github.io/blog/posts/gpu/2026-08-30-2-cuda-programming-model/Sun, 30 Aug 2026 00:00:00 +0000https://sankethbk.github.io/blog/posts/gpu/2026-08-30-2-cuda-programming-model/<h1 id="cuda-programming-model-writing-and-launching-kernels">CUDA Programming Model: Writing and Launching Kernels</h1> <p>The <a href="https://sankethbk.github.io/blog/gpu/2026-08-30-cuda-thread-hierarchy">previous note</a> covered the hierarchy: thread, warp, block, grid, and how those map to SMs. This note turns that hierarchy into actual code. By the end, you will have seen a complete CUDA program, understood every line, and know how a host program hands work to the GPU.</p> <p>CUDA is an extension of C/C++. Most of the code you write is ordinary C++. A small number of CUDA-specific pieces — kernel functions, the launch syntax, a few memory APIs, and built-in thread indices — turn a sequential program into a massively parallel one.</p>