51 pointsby lensecat5 hours ago23 comments
  • pure-orange4 hours ago
    Same energy as blaming an intern for dropping your production table. If one entity can delete all your data, that’s on your systems not them
    • madaxe_again4 hours ago
      But we thought our files would be safe in the dumpster, nobody could have foreseen they would take out the trash.
      • don-code3 hours ago
        There was a point where a coworker came to my team, complaining that our policies had erased an entire week's worth of high-priority work on him.

        We asked where this happened. He had done his work on an EC2 instance named `temp-worker-5`.

        We asked where the files on that EC2 instance were; maybe we could cleverly get them back off the disk. They were in `/tmp`. We had it mounted on tmpfs (in memory), and we were running tmpreaper to clean out `/tmp` every Sunday.

        When presented with the sheer absurdity of doing work on an instance called `temp`, out of a directory called `/tmp`, he backed down...

        I fear that we wouldn't be so lenient (or rational) on my team had an AI agent done this - we'd have to enable the AI, after all.

        • x0z3 hours ago
          Absolutely incredible self preservation instinct from your colleague on behalf of their work. Like playing Russian roulette fully loaded lol
        • yxhuvud3 hours ago
          Some people just like running around with scissors..
        • hackeraccount2 hours ago
          I mean yeah but you can always go one step back for root cause.

          Why did they pick that insane option? Why was it available to them?

          One of my co-workers in security always seems to think that just saying "No." is the job. If someone is asking to do something stupid you say No, and then you talk to them to figure out what the goal is and the n you help them to get to that place.

    • swatcoder2 hours ago
      Except in this case, you're paying somebody else good money for access to the intern and they've aggressively pitched the intern as the future of work and negotiated investment at trillions of dollars of valuation based on that premise.

      So yeah, kinda your fault for not being more ready, sure, but also maybe it's worth bringing these sorts of failure-case stories to attention to help keep the sales pitch in perslective.

      The AI vendors are promising the moon with millions of dollars of advertising while warning "But of course be careful!" in a 42% grey 8pt font disclaimer at the bottom of the UI if you scroll down enough after you buy in and start using it.

      The duplicity and misrepresentation invites people to let down their guard.

      • wafflemakeran hour ago
        I once let Astra a free reign of my system to troubleshoot and reverse a hanged game (to save that savegame). Totally aware that it might be the backup testing day. It analyzed memory dump, game engine code, used stacktrace, and got me fix to unhang the game.

        I also let a guy that had one beer drive me 5 min on a rural road.

        Both were pretty stupid and in the reconsideration, I wouldn't do it again.

        But having it run company servers is just next level.

        It's like believing that cola zero is healthy, because it's sugar free. No, it isn't, should probably be illegal to sell and people only buy it because of millions spent on marketing.

        • okamiueruan hour ago
          In your evaluation of the stupidity, aside from considering the potential averse affect the agent could do to your system, did you also factor in possibly sharing any and all data in your system to an external party?
        • TiredOfLife40 minutes ago
          > No, it isn't

          Source?

    • shakna4 hours ago
      Most interns would not be dumb enough to try it. Because there would be consequences, and there is training. The pre-trained entity, that everyone has been screaming is as smart as your intern, though?
      • JumpCrisscross4 hours ago
        > Most interns would not be dumb enough to try it

        Not an intern, but when I was a new hire on a trading desk I dropped the dividend database that we used to price options. Cost the desk a boatload before we stopped offering quotes, after which the day was a total loss. That’s the sort of fuckup that lands in the CEO’s report.

        I understood what I did ex post facto, it was an honest—if stupid—mistake, I expected to get fired and instead was given everyone’s shit work for six months during which I learned a tonne. One of my tasks was redesigning the system so a single careless keystroke couldn’t do that during the trading day.

  • mkl4 hours ago
    Production company doesn't bother backing up hundreds of days of work, blames irresponsibly used AI for its own failure.
    • dspillett4 hours ago
      Doesn't back it up properly. There are too many people, otherwise bright and professional, who do not realise that simply syncing to somewhere else is not an adequate backup arrangement.

      This problem predates agent based work. Anything an AI agent can accidentally do, malware could purposefully do too, as could a sufficiently careless human (one of the things my backups are intended to protect me from, is me!).

    • agilob4 hours ago
      Pixar lost Toy Story 2, deleted by mistake https://www.slashgear.com/how-pixars-toy-story-2-was-deleted...
      • suddenclarity4 hours ago
        Should be mentioned that this was in the 90s with one of the first computer-animated feature films. We're missing the source code for a ton of games from that era as well. I would assume people had learned to have proper backups 30 years later - especially so with the advantage of high speed internet.
        • glimshe3 hours ago
          This is actually one of the goals of some retro computing enthusiasts: recovering the source code for old games through AI reverse engineering.

          I know it's not the same thing because you lose comments, unused prototypes etc, but I still find it a fascinating use of the technology.

  • verytrivial4 hours ago
    Okay, but was it actually almost finished and ready? People can act unpredictably[1] under pressure instead of asking for help.

    It very probably was, but it just reminded me of this oversight failure mode.

    [1] https://thedailywtf.com/articles/the_brillant_paula_bean

    • stingraycharles4 hours ago
      Tangent, but I’m so happy this site is still around! Haven’t checked it in at least a decade, this should be a goldmine.
      • lmz3 hours ago
        Its heyday was pre-LLM so a good reminder that shit code existed before LLMs, wtitten by people paid to do so.
    • hackeraccount2 hours ago
      I like the idea that this was something like The Producers.

        Get some money from investors to make show
        Have a giant party
        Oh no AI deleted the show!
        Go home and nurse hangover.
  • s0ja4 hours ago
    Impossible to read the website let alone configure cookies.
  • kaon_24 hours ago
    I always thought that delete doesn't really exist? In the sense that it you take the hard drive to a specialist they can often recover it? Maybe I am wrong?
    • dspillett4 hours ago
      You aren't wrong, but getting a specialist to look at it in a tight timeframe is expensive. Free tools exist, but if you've not already learned how to use them the time that you need them is a bad time to start. Anything you do with the machine after the delete can reduce the amount you are able to get back, so you should very quickly shut down (avoiding saving anything locally). The situation can be worse with SSDs, depending on how eager your OS/filesystem is at TRIMing deallocated blocks.
    • sublimefire4 hours ago
      You could ask the agent to attempt to recover using specific tools. But yes in some cases the bits could be lost without the ability to recover, there are ways to destroyy data as it is usually required for decommissioning
    • jamesnorden4 hours ago
      It depends on which sectors have been overwritten, really.
  • lensecat5 hours ago
  • traktorn4 hours ago
    In your face AI Doomers! The AI is creating more jobs!
  • PinguTS4 hours ago
    No backup, no mercy.
  • dumberquestions4 hours ago
    How easily can files completely disappear just like that? You usually have to be very intentional about it to make even a partial recovery impossible.
    • deno4 hours ago
      Yeah, just stop writes and get someone that can use photorec of similar. It's not the end of the world unless you do something stupid.

      But who knows what the agent was trying to do. It could really have decided the TV show was so bad no one should see it. There's no details.

      Or it's bad and it's tax evasion.

      • giantg24 hours ago
        "It's not the end of the world unless you do something stupid."

        Or intentional

      • 4 hours ago
        undefined
      • madaxe_again4 hours ago
        The agent pulled out the hard drives and then stomped on them, before putting them in a bucket of magnets and acid.

        It also duct taped their IT staff to their chairs and prevented them from taking any backups of their core IP.

        • deno2 hours ago
          It would just need to decide to run shred for some reason.
  • suddenclarity4 hours ago
    Modern version of "the dog ate my homework"? I can't even imagine a scenario where an AI agent manages to unrecoverably delete all working material and backups. I'm cynical and can't help thinking it's all marketing to postpone a reality show no one cared about.
  • 4 hours ago
    undefined
  • ethin4 hours ago
    All these "accidents" with agents just makes me want to use them less, not more. Then again, I don't use agents because they consume tokens at an absurd rate, so...
  • INTPenis4 hours ago
    This is the same as using commands like rm the wrong way. The agent didn't do it, you did it! You didn't use the agent/tool properly!
  • GaryBluto4 hours ago
    Could dang or tomhow manually decontract the title?
  • an hour ago
    undefined
  • deno4 hours ago
    If the title was "TV studio does not have backups" this would be a non-story. The fact it was deleted by agent and not human doesn't really matter.
    • eviks4 hours ago
      It does matter because more people use agents and don't expect such rogue behavior. Plus there is more novelty, which "news" is somewhat related to. But regular human destruction also gets published and discussed
    • duttish4 hours ago
      Yea this.

      Agents doesn't cause new problems, they reveal existing weaknesses.

      Proper working backups. Proper IAM setup. With agents things can go wrong so much faster, the margins for allowed systemic/tech debt are shrinking.

      • cbg04 hours ago
        > Agents doesn't cause new problems, they reveal existing weaknesses.

        Agents absolutely can and will cause (new) problems if they are unsupervised even with guard rails in place.

        • duttish4 hours ago
          Hm, what guard rails are needed for agents that aren't needed for humans if you want to handle insider risk properly?
    • nottorp4 hours ago
      Except these people aren't developers, they make movies?

      And if you trust "AI" marketing, it will take all our jobs and do them better than us.

      You're probably a regular tech news reader and are aware of the limitations, while they aren't.

      • deno2 hours ago
        Someone has set up that server and ssh access. It wasn’t “Steve’s” macbook.
      • Ukv4 hours ago
        > Except these people aren't developers, they make movies?

        A production company should 100% have regular backups, even moreso than the average developer.

  • glimshe3 hours ago
    Doesn't sound so bad if rephrased as "AI prevents the release of yet another reality show"
  • an hour ago
    undefined
  • dist-epoch4 hours ago
    If they were stored in S3, or a similar service, and the agents deletes them, there is no way to recover them, right?

    I know google has some manual process (forms) to request "undeletion" of personal Google Drive files.

    • rglover4 hours ago
      If you have bucket versioning enabled you should still be able to recover something.
  • 4 hours ago
    undefined
  • 4 hours ago
    undefined
  • jd244 hours ago
    smells like bs
  • ghostdevstudioan hour ago
    [flagged]