Predictive Speculative KV Replication for Bursty LLM Inference(jwlabs.vercel.app)
33 pointsby shreybirmiwal8 hours ago2 comments
  • holtkam22 hours ago
    Awesome animations!
  • msp265 hours ago
    the hand drawn diagrams and highlights are charming