14 pointsby Curiositry6 hours ago1 comment
  • Twirrim2 hours ago
    I've been finding it very practical to run the 35B-A3B model on an 8GB RTX 3050, it's pretty responsive and doing a good job of the coding tasks I've thrown at it. I need to grab the freshly updated models, the older one seems to occasionally get stuck in a loop with tool use, which they suggest they've fixed.
    • ufish235an hour ago
      Can you give an example of some coding tasks? I had no idea local was that good.
    • fragmedean hour ago
      Which models would that be?