user:anotherCodder
created:Sep 6, 2024
karma:24
about:

Solo engineer. I build memra, an LLM inference engine in Rust and CUDA for RTX Blackwell: https://github.com/avifenesh/memra

I also run a hosted inference API on it: https://inference.tiyuvta.ai