It’s a shame transparency is so poor here. A simple grep of the training data would likely give a clear explanation of where this has come from.
Do such services actually work? The internet is forever.
There's also been some revenge porn laws in the US that have some cross over. But it's definitely mostly hopes and dreams if you have the money to spend, not something strictly practical.
It's like saying that someone publishing your bank account balance or nude photos is fine, because someone once stole that data and released it on the internet.
Or is "publicly available" used here to include data breaches and data sold by gray area data brokers? If this is your point then what would qualify as private information ? If this isn't your point
Which makes me think what other things like this has happened with Ai.