I also don't want to use the Claude Code and Codex agent harnesses. The good thing with Codex subscription is that it can be used in other harnesses, unlike Claude. As far as I know, only Anthropic has this restriction.
It's really strange because when Opus 5 released, there were some that pointed this out, but a bunch simply said it was the best and as good as Fable etc etc.
but for me, it caused me to get very demotivated and avoid interacting with the model, at least when using Claude Code.
I've moved to Codex 5.6-Sol. Much saner English, much better at execution, and gets stuff done in a matter-of-factly kind of way (Claude Code is a mess these days -- it gets things wrong and goes around in circles).
But I'm harness agnostic and am not locked in. I just keep my issues in Kata Tracker (https://www.katatracker.com/) and switch harnesses/model when I need to.
Being loyal to a particular model/harness seem unwise to me.
Astra’s outputs are much more concise while being similarly accurate, they seem more information dense. It’s also extremely fast and doesn’t have to “go check instead of answering from memory” if the answer is already in context, or dig super deep into a project before answering.
It’s honestly refreshing to work with Astra after being basically burned out from reading Claude’s responses.
It’s not perfect. It’s just as “mid” for professional SWE work as Opus/Fable, regularly making incorrect assumptions/generalizations, requiring steering in large codebases, and being incapable of making reasonable long-term software design decisions on its own in complex projects.
- like a fancy auto complete (here are some stub methods, they should do X, fill them in)
- using fairly detailed plans and test harnesses, so blowing up the world is hard
The 3.X Flash family have been fairly capable models, and the selling point for me is just raw speed. Gemini is noticeably faster than the competition, about 3-4x, and I just get work done faster with it.
That said I'm keeping an eye on Open Weights. DS4 Flash was good until price hikes, and finding a provider that serves at high speed and without quantisation at the prior price is tricky.
There's no Gemini pro model currently, so you gotta pair that with a 20 openai plan for access to more advanced stuff if you need it.
A few months ago that would've been bigger model stuff, but now you can do that in a couple hours with Flash and direction.
Used to pay for a Claude 20x plan and did everything in Opus, but I hate how it talks now and recent events (OAI scooping, Anthropic's spying, third party Chinese model hosts stealing and selling credentials) have really pushed me towards local AI for personal needs. Am not allowed to use Chinese models for work even if self-hosted so not much choice there.
I'd love to hear more about your setup. I have a single GB10 and am thinking about adding an additional one.
Initial setup was a tad annoying because I had to update their firmwares and then power cycle them to get the 200GbE link working at full speed. After setting that up, it has been pretty smooth. I don't directly deal with the cluster, usually I just have the LLM itself handle updates/stopping to load different models.
Generation speed and TTFT is decent with Qwen3.8-flash, and it does a good job for my fiddling around with enough concurrency for multiple sessions/subagents. GLM 5.3-flash was also nice, but not too much better for how much slower it is.
I should also add that I already maintain a homelab with a couple of computers, VMs etc, so I am probably somewhat more tolerant of the occasional issue and fine with manually managing stuff over SSH. I think this is just a tradeoff of self-hosting relatively recent tech though.
I have a triple 3090 rig, but it mostly stays powered off because of the massive power draw and cooling requirements. The Sparks are slower but at peak they consume as much power as my 3090 machine at idle.
The recent talk of regulation has me wanting to pick up 2 more Sparks, but that's mostly to have the capacity to play with multiple models, local model tuning and to be ahead in case they force some limits/registration requirements for buying new hardware (kind of like the attempts to regulate 3d printers).
As a side project, I'm doing an experimental task now (having Astra implement my own personal Google Docs clone, OT and everything, for my blog), and it feels more capable than Fable but needs to be watched closer than Fable. It is obsessed with verification and evidence to the point that I've needed to make some absolute rules to stop it from repeatedly e.g. making unit tests with 10,000 test cases with 5+ hours of runtime
For well-defined coding tasks, I'd default to either Luna or Sonnet, or hell, just writing it by hand.
I prefer Cursor at this point just because of Composer. Claude Code is passable but the lack of a good, fast, cheap workhorse sucks. Sonnet and Haiku aren’t it.
I also do like Codex and Sol, Terra, and Luna. They are decent but I don’t find they stand out enough to use over the others.
Additionally, I have not tried Astra and found Fable to really not worth the cost for the tasks I do.
Finally, the latest Grok is actually a beast of a model, but expensive enough to not be a stand out.
For my personal stuff, I'm on a small $20 plan, so I need to use tokens conservatively. I was very rarely exceeding limits until I built a Dark Software Factory. It's not as efficient at token use. So, I use Sonnit over Opus here.
At work I have a $100 plan that I rarely exceed so I use Opus. I have access to Fable too, and I did use it a lot while it was new, but I don't find it improves most of my work by too much. I do mostly bug fixing across several hundred repositories with hundreds of thousands of lines of code, mostly written by humans over the past 20-years. These projects interact with each other so I run claude from the root of my sandbox (I was nervous to try this but I'm not looking back now).
I also use Sol as a secondary for my personal work. I pay for it because I like to talk to ChatGPT on the web. Since I already have the subscription, I let Sol write plans for me. It does a better job at certain tasks and it saves me some Claude tokens. Maybe I should consider Terra for the task, but I don't run up against my usage limits for the little bit I use it.
I'm trying to use Gemma 4 12b for some workloads but I haven't mastered the model yet. It's still very experimental for me. I can get work from it but it takes a lot of hand-holding. For local models, however, it's all I have the RAM for.
V4 flash latest has been great for me. It's so cheap it's almost free.
Grok is keeping up and really good at explicit stuff, i think that's a drawdown for me. I think most nsfw was made with grok
As for meta ai, i feek it's a total joke, i don't have access to muse cause meta has decided not to support older OS versions (I'm on Android).
This comment box makes me feel almost as if I'm coding, because of the font. Pretty noice
For what it's worth, here's a take on its speed vs cost vs intelligence: https://artificialanalysis.ai/models/deepseek-v4-1-flash
I can go all day and night with this thing with multiple sessions going, and I spend like $2 per day retail. With opencode-go, that fits within the $10/mo subscription, so that's what it ends up costing in real life.
I'm glad that you have the luxury burn $200/mo. But that aside, it's not obvious to me that handing your pennies to an American company that is in cahoots with the American military, willing to self-censor at the direction of the American government, investing in large-scale raping of the planet to build new power plants data centers -- is better than handing your (20x fewer) pennies to a Chinese company who releases its models in the open, and is investing in efficiency so that we can run the same inference for a fraction of the resources.
In cost-per-task, it's a 32x multiple Fable vs DS41. Either it really does cost them more electricity/gpu, or else they are succeeding convincing the masses that Anthropic's models are necessary for everyday tasks, when this is truly just not the case. Either way seems a tragedy.
Especially regrettable from my perspective, is the idea that to do computer programming in these modern times, you have to fork over an amount comparable to many people's monthly rent. Even if your employer is happy to direct their funds that way, we lose quite something when recreational coding comes with a substantial personal monetary cost.
Astra low on the $200/mo "20x Pro" plan gets me through a single day.
For work, given we pay API pricing anyway, I've been happy experimenting with K3-medium as my default, and now I'm planning on trying GLM 5.3 as well. Sol-medium is my fallback for my work purposes but I occasionally use Opus 4.8 as an additional reviewer.
I like the open weight models because much of my time at work is spent on security hardening (specifically, hardening my own service), and Sol/Opus keep snitching on me and blocking my prompts.
Defaulting to Sol Medium/Light for most planning and implementation I think is tricky or want more care in.
Luna Extra High for everything else (implementation, tedious take over my browser and do stuff).
I read all of its output tokens and lots of thinking tokens to understand the general flow of things, but only minimally look at code these days. I can't grok what Claude models speak and it's gotten worse. OAI models speak my kind of tech language I guess.
Light human review, some automated review.
Most work is for internal use.
For high-level strategic conversations, I use Fable.
For planning, I use Opus or Sol. Sol is generally preferred; it’s faster, cheaper, and less verbose. But I still find Opus more capable on the most nuanced or complex tasks.
For planned implementation, I use Sonnet.
For one-shot unplanned implementation, I’ll use whatever model seems best for the task. FWIW, I’m increasingly turning to Grok here.
I use Luna all over my workflow for reporting.
For more long work, I now use Fable to create a PLAN.md. I tell it to make a plan that will be executed by other models, and most of the time it ends up choosing Opus or Sonnet.
I didn't start doing this recently. Before that, I would just use the top model for everything. Splitting the work across different models depending on the task has helped a lot. They run faster, and I usually get much better results
Here is the script https://github.com/mariocesar/dotfiles/blob/main/common/.loc...
Granted, yesterday I threw a few tasks to Astra which the former 2 botches; it produced clean, correct solutions quickly, so pending further eval, this may take over.
IMO unless it's a mechanical tasks, it's worth it to use carefully -crafted queries on the more expensive models, than iterate through messier solutions on the cheaper ones.
edit: maybe not. Astra has imitated Fable, and appears unusable for biology due to safeguards.
I'm not as up to date on the other vendors' models, but when I last used Gemini my feelings were similar between Pro and Flash.
A day ago I activated Google AI Pro free via Google's tie-up with a local company (I do pay for this company's product though and it's anything but costly). Now I will use this too.
No other reasons to pick these, or not picking anything else.
- LLM expense budget
- What type of dev: work, personal, real time spaceship thrust vectoring, html contact forms for family, etc.
- human in the loop with short as possible turns, software factories that can run for days, or something in the middle
Just off the top of my head. I'm sure there are others I'm missing.
Privacy policy is not great with deepseek api, but you are always just trusting their word with any hosted llm and in theory i could at least self host the models i use from deepseek.
GLM-5.3, GLM-5.3-Flash and Kimi K3 are also fine, but slower, more expensive, and less good for what I use them for, which is mostly Python and CUDA programming with some JS and HTML inbetween.
But almost all of my tasks are verifiable tasks, which means that the LLM can check whether it is done or whether it needs to keep trying. If you are mostly working on problems where the quality metric is based on vibes, YMMV.
I haven't tried Astra or Fable yet, because I am not made of money and am happy with my current setup. Also, the Opus models' writing is absolutely insufferable. My blood pressure rises every time I see a Claude-generated slop README.
- Preferred: Claude Code with Opus 5 Medium
If I don’t care about the code, i.e. I’m writing something quick just to test something, I’ll use GPT Astra to save my Fable tokens. For conversations and research I usually go with GPT Astra Pro.
For Home Assistant I use a combination of Grok 4.20 and DeepSeek Flash 4.1. Grok as a voice assistant, because it’s the only model with good latency here in Brazil (it’s nearly instant), and DeepSeek for everything else.
I don’t really use LLMs for writing, but I’m writing a fiction book on the side, and when I tried to use one for ideas, Gemini Flash 3.8 gave me the closest to good writing out of the ones I tested. Not enough for me to use it for the task, though.
unbeatable price/intel ratio per M tokens:
$0.10 (input)
$0.20 (output)
$0.002 (cached-input)
...and then sprinkle in some other models when i think a second opinion will help
most engineering tasks don’t require frontier llms
when they get stuck, then i consider moving up to more capable models
purchasing a claude plan seems widely unnecessary to me
the tasks they do better than the average engineer cut both ways: unless you have an existing portfolio of well written and designed work done pre-llms, it looks like you’re producing slop that pretends to be well designed
poor typography choices despite using the mode,
poor layout choices despite using popular CSS frameworks
etc
bad engineers will always be bad engineers
tools don’t make up for it
edit: a follow up to this— everyone is using eyebrows in their layouts and have no fucking clue why it was done to begin with
everyone has a status pill floating above their front page hero display text and its not fucking status related
so gross