Your GPU is idle because the CPU keeps interrupting
The host and device paradigm decides whether your GPU works or waits. Where CPU and GPU interaction turns into a bottleneck, how CUDA streams overlap transfers with compute, and which one-line habits trigger a synchronization stall.