Wouldn't he have more to show for it than some 'Encrypted notes' app?
>Context is expensive - Yeah. It's been the main point of contention for a while, right?
>It performs a quick search and then writes to those files, ignoring arch - The entire point of the Sol -> Terra loop is to solve this. Its not an inherent flaw, its a short coming of current models.
Also, all of these were worse have have been getting better over time. Context is getting bigger and cheaper. These are not proven to be inherent flaws in LLMs