Why your GPU sits idle while the CPU pins at 100%
A GPU at 10% while every CPU core is pinned at 100% is a data loading problem, not a hardware problem. What I change first in a PyTorch pipeline: DataLoader workers, pin_memory, mixed precision and torch.compile.