Ask HN: Why does single-node DDP sometimes get slower with more GPUs?

2 pointsby traceopt-ai5 hours ago