Spent a few hours the other day trying to get Claude to produce some spring-boot code. Match the library versions to behavior and between each other. The thing that it should be perfect for. Nope. The moment I’m not explicit, it doesn’t even put version numbers into POM. Until it randomly does. Easier and faster to take the time, read the docs and do it myself.
That only means that LLMs suffer from a discoverability issue. An average user would need to know if it's worth paying the monthly cost for their circumstances, not pay and then find ways of justifying it.