Adaptive speculative decoding on a $300 GPU(github.com)
2 pointsby gogo27gallet4 hours ago1 comment