INT2 KV-cache quantization is getting surprisingly good(arxiv.org)
1 pointby yunuyean3 hours ago1 comment