The architecture of open-weight LLMs: MoE, hybrid layers, ternary weights(www.silasdata.com)
3 pointsby silasylan hour ago1 comment