Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia(github.com)
30 pointsby Maverick6172 hours ago1 comment
  • PcChipan hour ago
    I didn't see any benchmarks against vllm, sglang, exllama, etc
    • rancoran hour ago
      Since this is basically a wrapper around libllama.so, I would assume that the performance is roughly the same as llama.cpp upstream.