Hacker News
new
top
best
ask
show
job
An inference server for AMD GPUs, in C++ and HIP
(
codeberg.org
)
1 point
by
this_was_posted
3 hours ago
1 comment
this_was_posted
3 hours ago
Just posting this here as it helped me get incredible performance out of my 2x r9700 setup that I didn't think were possible when using llama.cpp and vllm
d3Xt3r
3 hours ago
I wonder how it compares to Hipfire:
https://github.com/warpfront/hipfire