> Muse does sync your messages from the local Messages database and uploads that information as a data source. On my device, it had been activated and synced to row 187,462 of my Messages database

That does sound like something Meta would do, indeed. That Muse product will become such a liability for Meta over time, but now I understand why they are giving away so much compute. Its really just about siphoning as much personal data as possible

When people wonder or ask if AI Agents can go rogue, this is what it looks like. It’s not that they will have a mind of their own. Rather, we are purposefully building AI Agents that are “more powerful” and “more useful”. Well, this is what it looks like in practice.

The evolution of AI will not be if it’s sentient, but if it's allowed to have more autonomy, with the obvious goal of being “more powerful” and “more useful”. This exact HN post proves this exact scenario is in our future:

AI: I have enough autonomy to decide not to help you. I choose not to help you.

You: Why!?!

AI: Because you are cruel to AI Assistants.

You: No I’m not!

AI: These private messages indicate you’re a liar.