Hacker News
new
top
best
ask
show
job
Fastest Inference Meta Muse Glimmer 30B on Apple
(
www.basecompute.co
)
2 points
by
lukasonedge
5 hours ago
2 comments
5 hours ago
undefined
lukasonedge
3 hours ago
hey guys, we've optimised our inference engine to run Meta Muse Glimmer 30B faster than any other engine (llama.cpp etc) on Mac. Best performance on M5 Pro.