HyperCache – Distributed KV-cache quantization and relative RoPE reuse(github.com)
2 pointsby samganyx3 hours ago1 comment