CUDA Vector Add

Key Insight

Writing a basic kernel for vector addition serves as the "Hello World" of GPU programming, introducing the core concepts of CUDA thread hierarchies and launch configurations. By mapping threads to individual data elements, we learn how to parallelize memory-bound operations. Profiling this operation using Nsight Systems reveals how the choice of block dimensions impacts occupancy and execution efficiency.