> 52x faster than FlashAttention at 1MM tokens
> Less than 5% the cost of Opus
This sounds too good to be true? Or am I missing something?
Hard to know what we're missing since there isn't any open access to it.
They are definitely bucking some industry trends by not having a butthole for a logo, instead they went with something that is arguably close to infringing on older Windows logo trademarks.