RL Is Bottlenecked by Inference. Scale It Independently (skypilot.ai)

what did gpu hours look like here? with 3 replicas for a 1.8x speedup, the cost tradeoff isn’t obvious.