A 35B MoE on a 16 GB GPU, without the offload tax(www.lucebox.com)
2 pointsby GreenGames3 hours ago1 comment