1 pointby 9999000009994 hours ago1 comment
  • Redster4 hours ago
    What are you using your local LLM for? What's the smallest/weakest model (and probably at what speed) that would make the hardware spend worth it?
    • 9999000009993 hours ago
      I’d like coding assistance and light logic.

      Maybe the DeepSeek R1 distilled

    • verdverm2 hours ago
      having your own hardware lets you do much more than serve LLMs, it's a great learning platform in general

      the other thing is that the little models are getting better and more capable, so the hardware ROI becomes greater over time