user:sleepyeldrazi
created:Jun 3, 2021
karma:80
about:

Personal projects at https://git.kokoham.com/sleepy . Trying to optimize LLM inference frameworks for local models in speed, and explore interesting quants for size.