28 pointsby akras145 hours ago5 comments
  • Dathuil4 hours ago
    My first deep dive with Claude Code was in Jan of this year. I was working on rebuilding an old city builder game from the the 00s and was trying to parse the original images from the game files. There was plenty if info on the structure online so I said I'd let Claude give it a go. I was running one of the sonnets I think.

    After about 5 prompts I had a web interface that I could drag the files into and it presented me a grid of all the images and I was able to export more common sprite sheets. Whole thing took maybe 10-15min and my mind was blown.

    I have tried to do the same recently with the newer models and we're still not writing code by the time the older models had finished their work. Something has definetly changed in relation to how much pre work the newer models are doing and maybe it's by design for more consistant results.

    • jeffybefffy51929 minutes ago
      Not commenting on speed, but it seems models and their harnesses have generally gotten much worse over time. My suspicion is that the "Frontier" labs really dont have a strong handle on good quality evals that equal expectations of their users, so they just churn out new models for marketing to sell the shit out of.

      Recently cancelled my Codex subscription because I cannot stand 5.6-sol/terra/luna. On top of that, Codex the harness is just so dammed buggy in VS Code.

      I just discovered https://tinfoil.sh, which is fully private and attestable AI which works amazing with Kilo Code. Its costing me at API prices but for cheaper to run models which so far feel more consistent then what I get from frontier models.

    • Flavius3 hours ago
      > I have tried to do the same recently with the newer models and we're still not writing code by the time the older models had finished their work

      Claude used to run at ~150tps in January. Now it runs at 50tps if you're lucky. That explains most of the speed issues without even getting into technical details about the new models.

      • Dathuil3 hours ago
        Oh that's interesting. When did that happen? a 3x reduction in speed would probably explain it
  • latentsea2 hours ago
    I miss humans.
  • theowaway2134562 hours ago
    Site is broken: "Error establishing a database connection"
  • datakan3 hours ago
    Seems the site is down
  • setnone3 hours ago
    it won me over at 4.6 and lost at 4.7 and the image 'How multiagent turf war runs ended' [0] might explain the shift in the behaviour

    [0] https://www.anthropic.com/research/multiagent-systems