Hacker News
new
top
best
ask
show
job
Efficient and Lossless Moe Diffusion LLM Inference with I/O-Aware Expert Offload
(
tide-paper.vercel.app
)
1 point
by
imalomder
6 hours ago
1 comment
imalomder
6 hours ago
Hi HN, this is my research project that allow people to locally deploy MoE Diffusion LLMs more efficiently. With this method, you can fit a 100B LLaDA2.0-flash model into a PC with a RTX5090 and run it faster than other methods.