256K context with 72MiB of KV cache on the GPU(github.com)
3 pointsby GreenGames2 hours ago1 comment