Most training is post-training in modern AI (~90%). They are not memorising lets play videos, that is absurd.

Try and get an LLM to recite the entire first book of Harry Potter and it goes off track usually during chapter 2.