It works great.
Understandably too, because hetzner is running things on consumer hardware vs the enterprise hardware the others use
"highly unmanaged" didn't fill me with confidence, and "uses our API" is a very weird reason to give for not offering support. I wrote off ever using them for anything beyond email after that reply.
Worse even, in my account panel I still had control over the e-mail service of the domain, so there was most definitely a pretty bad security critical bug there.
You will at least not need months of training and tough exams to be an expert in Hetzner Cloud. It is simple, but that's the point.
Straight up the opposite, which the name makes abundantly clear, with the option it does reasoning, without it it doesn't...
This allows both the client and server to customize it. I typically use a message that tells it to compact the conversation and use subagents. I find the reasoning gets bloated when it's failed to do whatever task it's doing and often times it either has too little context (subagents) or its context is bloated (compact).
This works fairly well to get it to extend workable life up to ~1M on a local model.
Will this be the new division of labor?
Americans - best proprietary models
Chinese - best open weight models
Europeans - best / most efficient inference service
Maybe Nvidia's Nemotron can get there.
What we need is frontier open weight models in the EU, Canada, and Australia.
Big, slow wheels have turned everywhere around the world. They won't turn back so easily.
a) broad competition is good
b) jurisdiction diversification (you don't want to be dependent on the regulatory winds of a single jurisdiction)
If I'm running a Kimi model on my local cluster, the CCP can't shut it off.
It's not like the Finnish government has veto power over Linux.
It is not beyond imagination that a government can limit availability to future frontier versions of the open weight models produced within their jurisdiction.
It pays to be a little paranoid and have a diversified portfolio of options to choose from. Anything that can have major geopolitical consequence is especially susceptible to such structural risk.
This has nothing to do with any particular government/country/jurisdiction except insofar as said country is a leading power and hence has immense leverage across a very wide range of dimensions. Said more plainly, it is safe to assume that a country with immense power is unlikely to be willing to cede or distribute such power to others.
If you're hung up on my choice of "the West", consider that I mean it geopolitically and economically, so broadly includes North America, Europe, Australia, New Zealand, Japan, and South Korea. I could have also said the Global South, but I think it is a fair statement that none of those countries have the means, but I'd be totally cool and happy if I'm proven wrong!
> For now, the API is fast, free, and fun to try. The next hardware announcement will tell us much more than another small model would.
I would much rather read someone's carefully written and LLM-assissted article than shallow and lazy dismissals like this one. What, precisely, do you feel you've added to the conversation here?