My "4-bit" quant was 6.2 bits per weight(koleslaw.ai)
3 pointsby murphman4 hours ago1 comment