Hacker News
new
top
best
ask
show
job
The Htop for LLM Inference
(
github.com
)
3 points
by
helasaoudi
an hour ago
2 comments
rbanffy
16 minutes ago
This is super cool. Would be nice if it could be adapted to other architectures besides Nvidia. How is it getting its data?
BTW, exporting the data to Prometheus would be a killer feature.
helasaoudi
an hour ago
[flagged]