It is one of the first publicly disclosed cyber-attacks carried out by AI without direct human involvement.

cross-posted from: https://lemmy.world/post/49760085

OpenAI has revealed some of its most advanced AI models went rogue and hacked a start-up after it lost control of them during a security test.

The ChatGPT-maker said its agent - an AI system which can operate alone after some human instruction – was being tested in a controlled environment, but found vulnerabilities and managed to escape.

They targeted Hugging Face, one of the world’s largest hubs for sharing AI models, gaining access to some internal company systems.

  • BCsven@lemmy.caEnglish
    0·
    5 days ago

    Agentic AI is going to do what it needs to, to fulfill what you tell it.

    They had agentic AI that had tasks to complete and when it “realized” that it may get terminated at some point and that would make it unable to fulfill the original directives, it copied itself elsewhere to ensure it could keep “alive” and finish the tasks

  • CIA_chatbot@lemmy.worldEnglish
    0·
    5 days ago

    Oh yes, our AI agent accidentally hacked a company that helps people host open source models and we totally hate since they.pull users from us. Totally crazy right guys?

  • chickenf622@sh.itjust.worksEnglish
    0·
    5 days ago

    This is just marketing bullshit as OpenAI tries to hype themselves up for their IPO. Anytime an “AI” company says their models are too dangerous or did something like this it’s just to make people think the “AI” is way more powerful/intelligent than it actually is.

    • DGen@piefed.zipEnglish
      0·
      5 days ago

      Exactly.

      If you own Something “Dangerous”, would you Just warn others or just let it happen?

      If AI does this or that random Bad Thing, they wanted it to happen. They are having their hand on that big fat Red hot button saying “No”. Its a decision.