List the things you want people to know and they can use AI to learn them
"One note on wording. Below, I write that these systems “seek” or “try” things. This is shorthand for a mechanism rather than a claim about consciousness or human-like intent. We use similar shorthand when describing many other situations, like a plant seeking sunlight. A system trained by trial and error behaves as if it were pursuing whatever its training rewarded, and that as-if description is what makes its behavior predictable."
https://yoshuabengio.org/en/publication/why-are-ai-agents-ly...
So there is some attempt to remain grounded. Using shorthand wording makes it easier to reach more people with your message, the whole goal of writing a post like that, but also likely means more people are mislead into treating the short hand as the truth rather than for what it is.
But do we really know how LLM's(and the layers above, harness, RL, etc) work, or is there some emergent, surprising phenomena in those systems?
LLMs are a real, genuinely-useful technological innovation that happens to have arrived first in software engineering. Lots of SWEs spend their whole day talking with LLMs and feel a personal connection/expertise with the thing that's also at the top of the hype cycle for non-technical news