How many redditors already signed up?
https://www.malwarebytes.com/blog/family-and-parenting/2026/...
"By November 2025, IWF reports of AI-generated CSAM had more than doubled year over year, rising from 199 to 426. Girls accounted for 94% of the victims. Reported cases included children ranging from newborns to two-year-olds, according to the organization.
The ecosystem around these tools is industrial. In April 2025, a researcher found an exposed AWS S3 bucket belonging to South Korean “nudify” app GenNomis containing 93,485 AI-generated images alongside the prompts that produced them."
Companionship and intimacy, two things people desperately want and two things AI cannot deliver.
This stuff is deeply dystopian and I struggle to believe good faith on the part of people selling this stuff.
We might even reach the point where having AI companions somehow will become essential and primary, even with an already fulfilled social life.
I've had "real friends" completely online, never met IRL, those were actual friends that I still talk to a decade later, and had countless evening of fun and random talks, in the end, if they happened to be AI (and let say deepfaked to the point you can't even know), I don't think it would have changed anything, it's still felt the same way, it's still helpful the same way, it's still a "bond".
I can't really make up my mind about it, but I'm certain we will have AI stuff behaving 1:1 with humans, including the graphics and flaws.
I assume the same is true here. A lot of people have real trouble to get romantic partner, and AI filla the void. It may look bad from the outside, but I don't think normal people can judge romantically deprived.
What would be even more dystopian than AI-partner society is not only to blame incels for each and any issue, but also to disallow them even right to use AI for romantic feelings.
There is no moral imperative to allow predatory behavior. We can recognize the difficulty many experience with romantic relationships without blessing others to take advantage of them.
I also very much doubt that people struggling with romantic relationships actually show any measure of mental health improvement after engaging with these AI bots. I imagine the pattern is one of addiction, where participants feel better while actively using the product but then worse at baseline because none of their actual problems have improved.
We are slowly stripping everyone of the will to build meaningful lives by fulfilling all wants with soulless instant gratification. No perfection of AI/sex work or whatever can match actual intimacy with someone.
That is at the root of most of our current societal ills I believe. Bad economy, Bad job market, etc. are all a smokescreen over the fact that people can escape their problems. You can live a numb half-life and avoid any crisis that might trigger real change.
If a bad economic outlook was all it took to wipe out the birth rate we would never have survived the great depression or other 10,000 hard times we have endured as a species.
Having an actual romantic partner provides physical and emotional intimacy.
Hiring a sex worker provides physical intimacy and no emotional intimacy (unless you're paying for that as well, I suppose), but lonely people can project onto the SW and mistake physical intimacy for emotional intimacy. That can be unhealthy.
With this, there's no physical intimacy and a simulated level of barebones interaction, meaning that you're getting the physical release but no actual intimacy and none of the other stuff that comes with any sort of relationship, let alone a romantic one, let alone a healthy and rewarding romantic one.
There's a time and a place for this, but it's a digital sex toy and that's all. AI isn't filling the void of a romantic partner any more than eating a bacon double cheeseburger every day is filling the void of a healthy balanced diet. It keeps the body going, but it doesn't deliver what you and your body need to thrive.
(All of this outside of the context of asexual/aromantic individuals, who may or may not need or want or be comfortable with any level of any of this and for whom this might be the perfect product for all I know.)
I don't really use any form of AI as companion, but I do use it for introspection, I wouldn't say it's harmful, I think it depends on the depth of it.