I suspect this is why places like Reddit are so valuable. With the voting system, they can correlate AI output with peoples approval. They are essentially ranking how well the output is received.

This doesn't mean this stuff will improve drastically as it might just highlight how low the bar is for some folks, but it is better than nothing.

Sort of like how reality TV was considered broadcast anesthetic slop, and yet people couldn't get enough of it and it is still with us decades later.

Most/some of what we call slop now was more generally accepted before AI. Slop is not only the content. It is the volume, and it is the lack of intent or value from the producer. No amount of data is going to fix that.