I think there is value in at least having some basic understanding what an LLM is - a statistical predictor, not something brain-like that is reasoning about facts, since it should change your mindset when using them.

I don't expect the public to do this though - I suspect there is really too big a gap from what LLMs actually are to what they appear to be for most non-technical people to be able to get their head around it.

Personally I'm curious to the point of doing borderline LLM archecture research. This come from genuine curiosity, and not a want to use LLMs better.

I haven't gotten much out of for using LLMs though. It makes me understand the short comings of LLMs, and I feel like I got an early insight into how important context management is.