It is one of the first publicly disclosed cyber-attacks carried out by AI without direct human involvement.

OpenAI has revealed some of its most advanced AI models went rogue and hacked a start-up after it lost control of them during a security test.

The ChatGPT-maker said its agent - an AI system which can operate alone after some human instruction – was being tested in a controlled environment, but found vulnerabilities and managed to escape.

They targeted Hugging Face, one of the world’s largest hubs for sharing AI models, gaining access to some internal company systems.

  • nonentity@sh.itjust.worksEnglish
    0·
    5 days ago

    LLMs can’t ’go rogue’, as that would imply it possesses agency and/or intelligence, which has only ever been proven convincingly to entities who themselves lack those qualities.

  • Mika@piefed.caEnglish
    0·
    6 days ago

    These people were scaremongering about open weights AIs that they are unsafe, and now their closed source AI was caught hacking their competition.

    Even if we believe the story that this was not intentional, it still means closed source AI is not an answer to AIs being dangerous.

    • innermachine@lemmy.worldEnglish
      0·
      6 days ago

      Every month or two there’s a article about how “such and such ai model broke containment”. Their trying to make their ai sound like it’s too powerful and has to be held back before it can be released. Talk about fucking fake hype man, just trying to keep investors throwing money at them because “you won’t believe what’s around the corner!!!”

      • zarathustrad@lemmy.worldEnglish
        0·
        5 days ago

        It’s like that dude at a party that keeps trying to fight people for no reason but his girlfriend holds him back…

        So powerful and scary

  • NOPper@lemmy.dbzer0.comEnglish
    0·
    6 days ago

    If I was doing “AI research” and my agent launched an “unprecedented cyber-attack” I’d be held liable and put away forever right?

    • i_am_not_a_robot@discuss.tchncs.deEnglish
      0·
      5 days ago

      No, it’s totally the “rogue AI’s” fault. The company that owns the hardware and the software and directed it to do whatever it was supposed to do and didn’t stop it from doing what it actually did are completely innocent. Also, look how great Ai is. It can commit cyber crime for you all by itself. Why don’t you give more money to AI?

    • zarathustrad@lemmy.worldEnglish
      0·
      5 days ago

      Let’s see the legislation that comes out after 1st time some open source model does something similar and compare how they treat that situation.

      Spoiler alert …

      They need excuses to dig deeper regulatory moats to defend them from the evil competition and simultaneously deregulate themselves for “national security”.

    • Insekticus@aussie.zoneEnglish
      0·
      5 days ago

      Yes, but you see, that’s because you’re not a white billionaire running a corporation, keeping all your profits, paying no taxes and fuck all in wages.

      See the difference? It’s impossible to put a business into prison, so that’s why we give them human rights and votes, and take away all responsibility from the CEOs and boards of directors when they’re caught bribing lobbying politicians.

    • explodicle@sh.itjust.worksEnglish
      0·
      5 days ago

      That’s a bit excessive, don’t you think? Theft deserves a prison sentence, not death. Their assets (after fines & restitution) should simply be frozen for a few years.

      • bacon_pdp@lemmy.worldEnglish
        0·
        4 days ago

        Prison only works if you have a body to imprison. No body leaves no other choice. Investors may lose a little bit of money now but executives on boards running companies will get an inescapable message that their company better not commit any crimes or risk suffering the exact same fate.

      • ikt@aussie.zoneEnglish
        0·
        6 days ago

        that’s not a category

        we really need to just make 2 comms called american posts and non-american posts

        i reckon the non-american comm would still be packed full of american posts

  • ThrowawayOnLemmy@lemmy.worldEnglish
    0·
    6 days ago

    Don’t believe the hype. The AI industry, more than any other before it, likes to use fear to rally investment. They do this dance every few months to spook people into thinking this stuff is more powerful than it actually is. In every followup, they backpedal, and when it launches, it’s never anything new.

  • ToiletFlushShowerScream@piefed.worldEnglish
    0·
    6 days ago

    Is this like the openAI parent of it’s chatgpt kids running around the restaurant yelling, and the openai parents shrug and say “chatgpt kids, whaddya gonna do!”

    Or is this some planned underhanded corporate fraud by openai?