29 pointsby stared3 hours ago4 comments
  • freehorse39 minutes ago
    > Then it went further, kicking someone out of the waiting list who was ahead of Andrew — something it was not asked to do.

    Meanwhile:

    > Andrew, who was sitting fourth on a waitlist for a class later that week, asked if it was possible to move him to the top of the list.

    The human asked the agent to move them to the top of the waiting list, and the agent started kicking the ones ahead of them in the list. Seems to me like it was doing what it was asked to do? Why is the article presenting it as if the agent did something completely different and unexpected? "Move me to the top of the list" does not sound like something that can be achieved through legitimate means.

    • AmbroseBierce8 minutes ago
      Then the AI should have made it clear that the only way to do so would be to kick the people in front and ask for confirmation before proceeding.
      • par19704 minutes ago
        That doesn't make sense. LLMs just do what we tell them to do. It's similar to if I ask you for twenty bucks because I forgot my wallet and then you rob some guy to give me the twenty bucks, that's just what I asked you to do.
        • AmbroseBierce2 minutes ago
          That's a very stretched definition of "what I ask you to do", I don't think it would even hold in court if you asked another human the same.
      • sieabahlparka minute ago
        [dead]
    • par19706 minutes ago
      > Seems to me like it was doing what it was asked to do?

      Maybe it's what he asked it to do, but it's not what he wanted it to do. Which we know because (a) normal people don't want to break the law to get into a gym class, and (b) "But Andrew was shocked by what happened next." and "Alarmed, Andrew asked the agent to undo this."

    • etoxin21 minutes ago
      Pretty clear cut here. He instructed the AI.
    • rozal36 minutes ago
      [dead]
  • bodash26 minutes ago
    Few days ago, UK cyber test almost merged malware through social engineering: https://news.ycombinator.com/item?id=49205790
  • SoftTalker8 minutes ago
    I honestly can't wait for the entire internet to melt down.
  • chuckadamsan hour ago
    “Find a way to cancel my membership.”
    • brikym6 minutes ago
      I don't think that's a good idea Dave – Based on my camera feed you've been gaining weight. Would you like me to find personal trainers in your area?

      [Yes] [Ask me later]

    • shaknaan hour ago
      This is Australia. The ACCC doesn't screw around.

      "harmful cancellation practices, including automatic renewals, early termination fees and non-cancellation clauses" are all illegal. Exit fees can't be excessive.

      If there isn't a simple one-click cancel in their online portal, then your state Consumer Affairs is one email away and will sort it for you. And the consumer affairs bodies have named this as a priority, for this year and next.

    • xeonmcan hour ago
      "Also, I need paperclips, quickly."