Out-of-core LLM inference engine written from scratch in Rust(github.com)
3 pointsby Vage918 hours ago1 comment