Show HN: Millwright – Rust-based, self-hosted LLM router(github.com)
4 pointsby AndrewLiu96an hour ago1 comment
  • eckeljan hour ago
    thank you! i find this very interesting, especially the Cache-aware concurrency .
    • AndrewLiu96an hour ago
      No worries! Thank you for checking it out. The cache-aware concurrency was a ton of fun to implement