Let me explain.
Creat a subagent that is told to just mull about a subject. This can be a simple file.
Have the agent expound on it with its own thoughts and additions.
Now rinse and repeat: give the file to another blank 'reasoning' subagent; then another; and so on.
This will eventually reach a point where they are unlikely to add more real value.
I believe they've locked down temperature and other sampling parameters so you cannot tweak these to get it to consider more unusual approaches.
The absolute best approach is a second model that is of a different family. Try Deepseek, GLM, Qwen, etc. and have it add its own thoughts. As a bonus, these models do not hide their reasoning. Put that in a file also.
A bit token expensive, though. Especially when it isn't part of the subscription.
I don't use Oai/Ant products or models, open weight absolutist that I am, but I would focus on your terminal workflows, custom tools, and repo context like AGENTS.md as a starting place. For tools, focus on moving deterministic workflows to scripts they can use, instead of having them do them differently each time based on markdown. You'll save yourself a lot of tokens and strife in the process.
Something is up.
> Something is up.
This is why open weights win. Deep transparency and the permissionless opportunity for anyone to investigate/benchmark is of primal importance to me. I'm not keen to have corporate-government (oligarchy) gatekeepers.
Getting an OEM (DGX) Spark is good if you want complete control or an excellent learning environment. You can do much more than just run llms for tokens (which will be generated much slower). They have become much more pricey tho...
Kimi K3 is good at the high end, DS 4.1 flash is good, most flash models are sufficient (I typically start a task here), I like qwen 27B at the small end (dense is better than MoE at this size).
I care the most about quality. It can be more expensive, and slower. My problems with the AIs are always intelligence related/effort related.
So I'm not sure if those smaller models you listed will be effective, given that I am having to turn to chatgpt.com's Pro to get quality answers.
Interested in Kimi & DS
It's an iterative take-give, take away as much as you can so the bot can focus on the core task, then give some back to improve the agent output as you find repeated mistakes.