> Additionally, we’re introducing a new ultra mode that goes beyond the capabilities of a single agent by leveraging subagents to accelerate complex work.
https://openai.com/index/previewing-gpt-5-6-sol/
Can someone explain how this compares with Pro? I thought Pro was already something similar.
Same. I suspect they'll get better at taking in terrible prompts over time though... Maybe that's what Fable does better, reminds me of Sora 2, it would take my crappy prompt and expound upon it. I told it once to generate a video of someone working at some company that changed its name, but the old name had historic relevance, it referred to the new company name without me telling it to, by virtue of me wanting a video of TODAY with a 90s icon.
It’s far more careful than opus and puts far more effort into testing and validating by default.
Switching back to opus at work was a downgrade. Similar requests felt more clunky and needed far more hand holding.
The responses I get from pro don't feel like ensembles. They are often very one directional.
> We generally treat GPT-5.5’s safety results as strong proxies for GPT-5.5 Pro, which is the same underlying model using a setting that makes use of parallel test time compute. As noted below, we separately evaluate GPT-5.5 Pro in certain cases because we judge that the setting could materially impact the relevant risks or appropriate safeguards posture.
https://deploymentsafety.openai.com/gpt-5-5/model-data-and-t...
There have been multiple podcasts with people from OpenAI which have confirmed this.
To what effect I don’t know… I thought subagents were useful because they were explicitly single purpose and bound to a narrow context
const audits = await pipeline(found.files, file =>
agent(`Audit ${file} for missing authentication checks.`, { label: file }),
)
Apparently in the web chat (and also in Claude Code?[0] Though I haven't tried yet) they can call the Anthropic API and your subscription key gets auto-magicked into the requests somehow.
Those are two separate things of course (aside from the key-injection) but I guess there's no reason it couldn't run completely in the front-end... hmm...
https://www.theinformation.com/newsletters/ai-agenda/openai-...
"However, these inference optimizations, which rival Anthropic refers to as “compute multipliers,” are a big focus for all the labs. Anthropic CEO Dario Amodei has been publicly talking about the concept since at least mid-2023, when he said on a podcast that the company limits “the number of people who are aware of a given compute multiplier” because it could give other AI labs a leg up if they were to be able to replicate them. (Compute multipliers can also refer to efficiency optimizations in the model-training phase.)"
Yes, on a world with finite resources where your industry is singlehandedly siphoning ALL THE RESOURCES - hoard general efficiency optimizations and treat them as trade secrets - winning is all that matters, normal people and other species and the planet be damned.
Everything I hear about Dario these days makes me like him less and less. He sure did seem to speed run the 'tech leader with scruples' to 'tech villain' path! I guess all the cycles are compressing as we approach the singularity..
OpenAI tried to pull off the same trade secret thing with RL when they announced o1 and o3, aka "Compute time scaling". Then Deepseek revealed it with Deepseek R1.
Could also be something like Deepseek DSpark. Or using diffusion like DiffusionGemma as a draft model. The timing between the release of those, and this article, makes me think its maybe one or both of those things
OpenAI seems to be trading roles back with Anthropic becoming misanthropic. I hope they both start heading in the direction of how the AI field was prior to LLMs.
Collaboration and benefit for all should always be the primary motivator.
Of all the things to never happen, this is never going to happen the most.
That train left the station for good once hundreds of billions to trillions of dollars were involved.
On the bright side, in the long run I suspect the vast majority of the value of AI will not be captured by the model making labs and the vast investments in them are going to implode, so...
(BTW Anthropic only exists because Sam Altman is a liar, Dario admitted this.)
Except for, you know, all the outside investors and the forthcoming IPO.
What kind of rosy-eyed chump believes in the "tech leader with scruples" bullshit? It always lies.
Did some people just ignore Mark Zuckerberg and Tim Cook's sociopathy, somehow? Did anyone buy into their "privacy is a human right" nonsense?
The thing I can't quite square is that it doesn't really fit my lived experience. I have known sincere, genuine people in the types of positions that I'm sure someone like you would declare to be sociopathic.
But beyond that, I just don't know why it would actually be true that everyone at the top is a villain. Why couldn't someone like Dario (or even Altman, gasp) be sincere? Because if he is, it does seem like a lot of the moves he's made would make sense given his worldview.
But if you assume he's just a villain, then you can twist any of those moves to just be further evidence of that which you already believe.
I don't know, I just find cynicism interesting, and a little sad.
You don't have to assume anything. A true "good guy" doesn't openly say that he's fine with autonomous, AI-powered weapons being used against me, and mass surveillance applied to me and my family just because I don't live in the US. A true "good guy" doesn't say "privacy is a human right", and then immediately (and completely) bend the knee to an authoritarian government on this issue.
I went in the opposite direction - how far can I push myself to see multiple facets of a story? That is a wild ride, and it gets progressively more wild.
Please, I'm dying to hear the optimist's take on Mark Zuckerberg's career. It wouldn't happen to be embarassingly foolish, would it?
Why should I treat Sam and Dario with special white gloves? Are they different, this time? They have peers in China that do the same research and actually release it to the public. They let you run the production weights on your own machine. Am I a cynic, for comparing these CEOs to their populist superiors? Am I stupid for assuming their hostility when they refuse to give us the benefit of the doubt?
I'll believe their actual altruism when I see it. Both are seeped in "boy genius" puffery and lie out their ass. If this is the future of intelligent innovation, then America is truly declining.
What you think could be a big chunk, is more likely to be a fraction of a percent of queries.
And what use is similar query caching - so you (very often! if actually cost effective, maybe half the time) get a response to a query that was different from yours. Including for when you have a lot of context input already. You’re going to get trash.
If it were constrained to only very common initial prompts, and somehow the long tail did not actually dominate as it does with Google search (can't find the reference at the moment but it was a famous article some years ago), it also wouldn't account for serious enough cost savings. Long context is what is expensive.
This might only work in constrained domains like customer service where there’s tolerance for generic answers and escalation paths. For technical work? For general purpose use, with secretly canned responses charged at full price?
The transform script(s) are cached and can be played back or adjusted. Surely for some breadth of question inputs, they map more often to similar answers--but not static answers; instead, evented edits.
It's nearly untenable for a human to keep private edit scripts to generate code changes. The extra steps for custom regex, essentially one-offs for a shared codebase, is inefficient. But maybe not to an LLM.
By contrast, when coding, devs typically have hundreds of thousands of tokens in the context window, and may use many millions of input tokens per day.
Caching requires the full prefix to match exactly. If a single word differs near the beginning of the prompt, nothing after that can share the cache. So this type of caching would save a few queries that cost virtually nothing, but wouldn't help with the stuff where cost matters.
“ Automatic Prefix Caching (APC in short) caches the KV cache of existing queries, so that a new query can directly reuse the KV cache if it shares the same prefix with one of the existing queries, allowing the new query to skip the computation of the shared part.”
https://docs.vllm.ai/en/latest/features/automatic_prefix_cac...
I haven't really used it yet.
2 months ago management was showing us scoreboards, praising leaders who used most tokens. Last few weeks, we're getting weekly emails, telling us that whenever we can - we should use cheaper models, and that we should watch the page which shows our tokens usage.
> This process is automatic. Your browser will redirect to your requested content shortly. Please allow up to 0 second…
more competition is always good for consumers.
I think gpt-5.5-pro runs 12x parallel gpt-5.5 agents behind the scene and uses OpenAI's secret sauce to synthesize their answers into one insanely good response.
If that's at all reflective of what it costs them to run it, I imagine they're in the same boat as Anthropic with Fable; they probably can't afford to offer it at subscription prices given current cost to operate it.
If 5.6 Sol Ultra has efficiency improvements (at one or more layers), and it allows OpenAI to offer a model that's competitive with Fable on the subscription plans, I'll guess a lot of folks will switch.
Fable is notably better than what came before. I watched it figure out stuff on its own over and over, on extremely hard problems, that I previously needed to guide a model to an understanding about, or work with them back and forth for several turns to figure it out together. Like, I've been reverse engineering a hardware device lately, and I've tried to tackle it a few times in the past with both some version of GPT and a couple of versions of Opus (most recently 4.7). In all cases, I barely made progress...would have gotten there eventually, probably, as I'm stubborn, but there were roadblocks constantly, with me and the models getting stumped and going around in circles in the end on every prior attempts.
Fable figured out other ways to find out what's happening, it dug into config files, found and extracted Boost-serialized data, compared that data to the observed behavior, built tools to compare the observed data with our emulated behavior, without being prompted. Would I have gotten there? Eventually, maybe. All prior models didn't; they mostly just tried the things I suggested and stopped at "well, that didn't work" or declared success after seeing results that matched their misunderstanding of the problem. I guess it's possible my prior attempts with other models had "loosened the lid" on the problem; we did already have a long list of documented "this didn't work" and a pile of tools for finding out if something worked. But, even so, I was impressed.
There probably will still be a "OK, let's rewrite this so it's not using lookup tables to precisely simulate the hardware behavior in software, because we don't need the noise, too" stage of the process...but, in one day with Fable, it solved a problem that I'd banged on for at least a week or too in the past with very little real progress. I don't think the models write exceedingly good code, even the best ones, but it sure does figure shit out quick.
OpenAI models have always been the worst in my experience for verbose, slop formatted responses, with each generation increasing in sloppiness.
I'm not that impressed by Fable's writing to be honest, still has the AI giveaways like em dash.
I hate that I have had to remove it from my writing style because people assume it’s AI generated. But I think that ship has sailed. I’ll have to do without now.
https://news.ycombinator.com/item?id=44344246
107 comments, 1 year ago.