RL Is Bottlenecked by Inference. Scale It Independently(skypilot.ai)
10 pointsby alex000kim4 hours ago2 comments
  • 4 hours ago
    undefined
  • efiop3 hours ago
    what did gpu hours look like here? with 3 replicas for a 1.8x speedup, the cost tradeoff isn’t obvious.
    • efiop3 hours ago
      ah, nevermind. 3 engines seem cheaper overall too: 7x661s vs 5x1200s of allocated H100 time per step. Nice.