And having to pay more and/or using slightly less capable models isn't a disaster, it's not like you need a frontier model for everything.
This was a more relevant conversation six months, since then OpenAI have been much more competitive on price for top models, Anthropic much less so but they're showing some signs of improvement in the 5.5 releases, and we've had an abundance of cheaper open source models.
we should be prepared for that. a bunch of enterprises were shocked after github switched to usage based pricing for copilot lol, and now devs stuck w just $29 of spend for a month are just coping.
i think as long as the economic benefit to a person is higher than their inference cost, it's fine, but a lot of the wasteful burn of tokens on silly things will most likely end
I don't believe AI only vendors can survive on their own over the long term under current conditions. They have no moat.
I look for the Mag7 to absorb individual AI vendors at fire sale prices once they start having trouble raising new capital to meet their already huge debt obligations.
And at some point, these same players will push to ban Chinese models (for "national security" reasons) and start to collude on pricing.
Their real long term objective is an effective monopoly on AI compute. Any plans you make now are unlikely to prove effective at that point. You won't be able to afford the hardware or power to run your own competitive model.
But don't worry, be happy --- and let the cheap tokens roll --- for now. And global warming is just fake news.
it’s not just about what’s changing, but also what you specifically would need or want, and what you can afford to do or buy.
put differently, you’ll get anecdotes here, but what you need and what responders need is likely to differ.
“Best agentic coding harness,” for example. For what end?