Going off on a tangent here: for over a decade, ever since I got an inkling of the power of neural networks, I've argued that privacy is the key to maintaining a broad diffusion of wealth in the modern electronically networked world.

What distinguishes human intelligence from LLM intelligence is largely information that the latter hasn't mopped up. So the information that the former is uniquely privy to is what gives it economic value.

I despise the "next token predictor" framing.

In order to predict the next token in this line "The solution to your problem is..." the entity needs to be able to solve your problem. Which is well beyond what people think of when they think of a token predicting statistical sequence.

The statistical sequence description is ridiculously incomplete.

[dead]