Lossless compression of LLMs to 12-bits(github.com)
1 pointby AlpinDale2 hours ago1 comment
  • AlpinDale2 hours ago
    A lossless encoding of BF16 weights to NF12, with speedups roughly proportional to amount of memory saved.