CS6023 GPU Programming

Schedule

Month	Dates	Topic	Comments
January	16, 17, 19, 20	Introduction, Computation	Hello World, One, Two, Three Grid, Blocks, Threads Kernel Launch: 1D, 1D-General, 2D
	23, 24, 27	Computation	Holiday on 26 CPU-GPU Communication (cudaMalloc, cudaMemcpy) Global variables Matrix mult.: CPU, Outer parallel, Outer+Inner parallel
	30, 31	Computation	Thread Divergence Divergence due to switch Problem Set 1
February	2, 3	Memory	Memory Coalescing AoS versus SoA Barrier
	6, 7, 9, 10	Memory	Lecture on 10 from Intel on oneAPI in CS25 from 9:30 to 12:30 Linked List Copying Shared Memory Shared Memory with Barrier String Permutation Dynamic Shared Memory Dynamic Shared Memory with Multiple Arrays CUDA GDB Error Handling Dangling Pointer
	13, 14, 16, 17	Memory	Texture Memory (via CUDA SDK) Constant Memory Bank Conflicts Problem Set 2 NvProf Original Code Loop Fusion Kernel Fusion Converting Loop to Blocks
	20, 21, 23, 24	Synchronization	Convolution Worklist Insertion Task Donation
	27, 28	Synchronization	Reduction: i + N/2, N - i, i + 1 Prefix Sum / Scan
March	2, 3	Synchronization	MidSem on 2. No Global Barrier Global Barrier using Atomics Hierarchical Global Barrier
	6, 7, 9, 10	Synchronization	Linked List Insertion CPU-GPU Shared Pinned Memory Persistent Kernel Problem Set 3
	13, 14, 16, 17	Synchronization	Guest lectures by Dr. Pradeep Ramachandran on Sycl / DPC++ Array increment: Sequential, Parallel Thrust basics Thrust Reduction Thrust Prefix Sum Thrust-like device vector implementation
	20, 21, 23, 24	Synchronization	Basic Stream Program with Asynchronous memcpy with cudaHostAlloc Cooperative Kernels
	27, 28, 30, 31	Support, Functions	Class at 10:00 on 27 Dynamic Parallelism Conditional Child Kernels using Global Device Memory with Non-Blocking Streams
April	1	Functions	MultiGPU: Number of Devices Cross-Device Synchronization
	3, 6	Topics	Holidays on 4 and 7 PTX: CUDA Code, Assembly Code Basic Warp Voting Converting Mask to Count (popc) Use of ffs Conditional Participation in ballot
	10, 11, 13, 14	Topics	Loop Unrolling, Unrolled Assembly Heterogeneous Computation
	17, 18, 20, 21	Topics	with Shared Variable Task Distribution OpenMP Reduction with HostAlloc'ed Memory Dynamic Scheduling OpenCL: Driver, Kernel
	24, 25, 27	Case Study
May	1		EndSem from 9:00 -- 12:00

GPU Programming Crossword Puzzle (click and type)

Courtesy: crosswordlabs.com

Happy faces -- since the course was coming to an end (Photo Courtesy: Anmol)