Howard makes a great analogy of LLMs interpolating between knowledge. This means LLMs can do combinatorial creativity but struggle with transformative creativity.
Also explains why LLMs are good at coding but not software engineering at a high level.