Hacker News
new
top
best
ask
show
job
DeepInfer, our in-house inference framework, now open source
(
twitter.com
)
3 points
by
awasum_yannick
5 hours ago
3 comments
5 hours ago
undefined
awasum_yannick
5 hours ago
This probably makes enterprise private inference cheaper. Wonder if this can be generalized to server other LLMs not just DeepSeek...should not be too hard
pluc
5 hours ago
https://news.ycombinator.com/item?id=50163277