Codegen is clearly lowering the cost of getting things to run on different hardware the real moat is everything around it: stability, tooling, all the weird infra edge cases.

Doesn't your own deployment story kind of argue the opposite? If standing up one model still takes hours of cold starts and flag tuning across different layers, the moat was never CUDA. It's years of failure modes that live in the heads of people who built this stuff. AI writing the code is the easy part.

These days, half the HN posts seem A.I. generated, or at least edited. Am I overly suspicious?

idk feels a bit overstated. CUDA’s moat isn’t just writing kernels, it’s the whole ecosystem + hard earned perf intuition. AI helps write code but doesn’t replace that.

switching costs are def going down though, so CUDA feels more like the default vs the only option.

real moat is still ops. getting stuff to run is easy, getting it stable at scale isn’t. so yeah, not gone, just more like a tax now.

The moat was never CUDA syntax. It was ten years of documented failure modes, and that’s not something you can prompt your way out of. Whoever ends up owning the serving layer inherits it.

Excellent post, could you also direct your chatbot to read the guidelines first?

From [0]

> Don't post generated comments or AI-edited comments. HN is for conversation between humans.

[0] https://news.ycombinator.com/newsguidelines.html

I believe brand loyalty will carry the day for them. "GPU" means "NVIDIA" to buyers.

What is happening to Hackernews, Firstly its obvious that this is AI generated post and then I checked it on an AI text detector website as well and it shows as being clearly AI generated (100%)