2 pointsby shivnathtathe5 hours ago1 comment
  • jcalvinowens3 hours ago
    > true 4-bit precision

    This isn't one of the new block floating point schemes, it's bona fide 4-bit precision weights. It boggles my mind that can actually work.