HexCore: Low-Latency Paged KV Cache Allocator in C++20 and CUDA(github.com)
2 pointsby XXXGhost2 hours ago1 comment