Prefill a 284B model on Nvidia. Decode it on Apple Silicon. Over plain 10GbE(github.com)
2 pointsby jnainaan hour ago1 comment
  • jnainaan hour ago
    pd-bridge — heterogeneous prefill/decode for DeepSeek-V4-Flash