GSD-LQ: Zero-calibration sub-4-bit compression and 7B in 3.78 GB VRAM(github.com)
1 pointby Phantom309-CED4 hours ago1 comment