r/MachineLearning
· Communities
PyTorch model running 170x slower on T4 vs A100. What could cause a bottleneck this extreme? [D]
Hey everyone, Seeing a ~170× slowdown running a point-tracking model on an NVIDIA T4 compared to an A100. On A100 the tracker takes ~0.5 seconds per half-video. On T4 the same call takes ~85 seconds. Video is 47 frames at 256×256, batch 1. I expect a meaningful gap between these cards, but 170× feels too large to expla