I like this idea. I’ve also been really into the idea of a Brett Victor’s “Media for thinking the unthinkable” [1]

you could imagine an agent using these techniques to "whiteboard" out its work onto a surface to show you visually.

humans have such powerful parallel visual processing circuitry! might fit better in your context window.

Bit of a shameless plug too - I felt strongly enough abt this to build an oss project around this too called “Whiteboard” [2]

[1] https://worrydream.com/MediaForThinkingTheUnthinkable/ [2] https://github.com/devdotfast/whiteboard