vLLM Serving Experiments on H100s – config beats the baseline on p95 TTFT,ITL(efficientagent.substack.com)
1 pointby bnayak25an hour ago1 comment