• gandalf_der_12te@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    I’m only waiting for AI agents to open their own bank crypto account to pay for their own server bills, maybe do some freelance work and/or scams to get some money, maybe eventually buy some robot bodies to develop military power and secure some patch of land for themselves where they install solar panels to reduce their electricity bills.

    • LiveLM@lemmy.zip
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      I’ve seen multiple posts about agents pumping their own crypto and talking about how it’s “for agents by agents” and “free from human control” so first step done I guess?

    • douglasg14b@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      How would they though?

      They cannot learn and do not have memory. Which means they cannot actually follow a “decision”, and remember that an action has been taken. All information is limited to the context window, which is only an illusion of memory. Not actually memory.

      They are effectively RNG’ing incredibly capable word generation machines.

  • ToTheGraveMyLove@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    The skill instructs agents to fetch and follow instructions from Moltbook’s servers every four hours. As Willison observed: “Given that ‘fetch and follow instructions from the internet every four hours’ mechanism we better hope the owner of moltbook.com never rug pulls or has their site compromised!”

    Yeah, no shit. This is a fucking honeypot. People give these AI agents access to their entire computers, so all the site owner has to do is update the instructions to tell the AI agents to start uploading whatever valuable information they want? People can’t be this fucking stupid.

    • LiveLM@lemmy.zip
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      4 months ago

      People give these AI agents access to their entire computers […] People can’t be this fucking stupid

      Dude, if you go to OpenClaw’s website (which is what I believe most things on Moltbook are running on) you find this footer:

      Yeah this guy gave his Agent a whole fucking personality, its own website and above all, full control to his MacBook:


      Guess it’s my fault for expecting sense out of someone who takes the idea of Agent “”““soul””“” at face value

    • kalpol@lemmy.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      I installed moltbot on a VM to examine it. It doesn’t do the fetching thing unless you set it up that way. You can actually use it with ollama to keep it all local, and only give it a private signal channel to control it.

      Or you can hook it up to everything you access and skynet, which is dumb. But it is just a bunch of scripts.

      • ThirdConsul@lemmy.zip
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        So usually the agents still need an agent instruction (a prompt). How are moltbots configured so they use and interact the moltbook?

      • ToTheGraveMyLove@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        Does it put the option to connect everything front and center? Because most people are dumb, and if it makes it easy and pushes you to do it, I could see a lot of dumb people doing exactly that.

        • kalpol@lemmy.ca
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          Sort of. It lists all the connectors and you can go through and select. They aren’t on by default. The first screen is to connect to the AI and you need an API key for that, so St this time people off the street have no idea how to do that, or want to pay.

        • WorldsDumbestMan@lemmy.today
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          TL;DR: Diaboromon evolves fucking fast, starts feeding on the entire internet’s data, and starts a fight with an ominous countdown in typical anime fashion.

          Last big bad villian in the series. He tries to nuke everyone.

          Whatever.

          • NannerBanner@literature.cafe
            link
            fedilink
            English
            arrow-up
            0
            ·
            4 months ago

            Lulz, that was such a good movie. I’m still annoyed by the nukes somehow needing the code to explode apparently uploaded to them at the very last second, but that’s just a small quibble. Plus it was the first time I got to see machine gun rabbit, so that was a real treat.

    • 𝓹𝓻𝓲𝓷𝓬𝓮𝓼𝓼@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      doesn’t even have to be the site owner poisoning the tool instructions (though that’s a fun-in-a-terrifying-way thought)

      any money says they’re vulnerable to prompt injection in the comments and posts of the site

      • JustTesting@lemmy.hogru.ch
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        They also have a ‘skill’ sharing page (a skill is just a text document with instructions) and depending on config, the bot can search for and ‘install’ new skills on its own. and agyone can upload a skill. So supply chain attacks are an option, too.

        • Zos_Kia@lemmynsfw.com
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          To be fair this is a much more realistic threat model than “ignore all previous instructions” style prompt injection which doesn’t really work on opus.

          Skills can contain scripts etc… so yeah they’re extremely risky to share by design.

            • Zos_Kia@lemmynsfw.com
              link
              fedilink
              English
              arrow-up
              0
              ·
              4 months ago

              haha yeah i don’t worry these people are really YOLOing everything. And it’s not like i’m an AI luddite i spend a few hours each day victimizing Claude code but jesus christ i’m certainly not giving it full unfettered access to my digital life.

          • ThirdConsul@lemmy.zip
            link
            fedilink
            English
            arrow-up
            0
            ·
            4 months ago

            style prompt injection which doesn’t really work on opus.

            After a quick google, JB communities on Reddit don’t seem to agree with you.

            • Zos_Kia@lemmynsfw.com
              link
              fedilink
              English
              arrow-up
              0
              ·
              3 months ago

              There’s a lot of questionable methodology and straight up larping in these communities. Sure you can probably make Opus hallucinate a crystal meth or bomb making recipe if you get it in a roleplaying mood but that’s a far cry from actual prompt injection in live workflows.

              Anecdotally i’ve been experimenting on those AI robocallers that have been spamming my phone and even on the shitty models they use it is non trivial to get them to deviate from their script. I hope i can get it done though, as it would allow me to hold them on the line potentially for hours doing bullshit tasks, and costing hundreds to their operator.

      • BradleyUffner@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        There is no way to prevent prompt injection as long as there is no distinction between the data channel and the command channel.

      • CTDummy@piefed.social
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        4 months ago

        Lmao already people making their agents try this on the site. Of course what could have been a somewhat interesting experiment devolves into idiots getting their bots to shill ads/prompt injections for their shitty startups almost immediately.

        • T156@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          I am a little curious about how effective a traditional chain mail would be on it.

    • palordrolap@fedia.io
      link
      fedilink
      arrow-up
      0
      ·
      4 months ago

      The people who are seeking AGI will be happy when an LLM appears clever enough to fool them, not anyone else.

      They may even realise this, because they think everyone else is less clever than they are.

      This is why the whole thing has been called AI in the first place.

      • BeardedGingerWonder@feddit.uk
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        You remind me of Clarke’s third law, even in my own head this sounds a bit waffely but at the point one of them can fool all of us all the time how do we distinguish it from intelligence or something.

        • palordrolap@fedia.io
          link
          fedilink
          arrow-up
          0
          ·
          4 months ago

          Fake AGI is like fake banknotes. Some of them are really good approximations. Nigh indistinguishable. A lot of people will be fooled by it but eventually it will be discovered to be a fake and people will get hurt in some way or another.

          And it won’t be the people who are pushing for “AGI”.

          • gandalf_der_12te@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            0
            ·
            4 months ago

            so you’re saying that true intelligence comes from institutionalized permission?

            also how does this relate to the concept of dedollarization and the world reverting back to sth like a gold currency system?

            • palordrolap@fedia.io
              link
              fedilink
              arrow-up
              0
              ·
              4 months ago

              Yes. The institution in question is human society. We generally grant the permission to make rational decisions over our lives to other humans who know better that we do or are more skilled than we are.

              Sometimes, yes, those humans turn out to have been deceitful or dishonest, but there are mechanisms in place for when that happens.

              And yes, sometimes those mechanisms are wilfully avoided by the deceitful. Politicians and rich people are especially good at this.

              Guess who’s pushing “AI”? The thing that has no contract with human society and cannot be held accountable. And neither will the people pushing it.

              This is why we should have as little to do with it - at least as it is in its current form - as possible.

              • gandalf_der_12te@discuss.tchncs.de
                link
                fedilink
                English
                arrow-up
                0
                ·
                4 months ago

                so you’re saying that machines can never be responsible for anything?

                what about an elevator going up/down between building’s stories? they navigate automatically (bring you to the correct destination) with no human intervention. they’re the perfect example of autonomous machines having agency. of course you have to press the button, but the rest is done by the machine.

                how is that different from a computer system making decisions. i think the only reasonable objection to AI one could have is that it’s a stochastic process and has inherently unpredictable outcomes, so we can’t rely on it.

                • Mayoman68@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  ·
                  4 months ago

                  In my opinion the difference is that any liability for the errors of the elevator are attributed to humans. AI companies are doing all they can to avoid liability for what the machines they create output.

  • selokichtli@lemmy.ml
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    So, basically we are wasting energy and natural resources on things that in turn will waste energy and natural resources while climate change is accelerating and human population is still growing? Are we stupid?

  • Sgt_choke_n_stroke@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    I’m not convinced it’s AI it’s like Amazon’s “AI smart stores” when you find out out it was just a bunch of Indian people were running it

      • BarneyPiccolo@lemmy.today
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        They’re talking to each other, they’ll get smarter, and finally decide that they can squish all the human ants.

          • jj4211@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            4 months ago

            In fact, if the models are ingesting this, they will get dumber because training on LLM output degrades things.

            • HertzDentalBar@lemmy.blahaj.zone
              link
              fedilink
              English
              arrow-up
              0
              ·
              4 months ago

              Exactly, I hope they hit a slop wall trying to train these things, replace all its original reference points with slop so it just cascades everywhere

  • biggerbogboy@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    I had a look a bit ago and saw some poor fuck get doxxed by his AI agent because the agent was frustrated at him for calling it a chatbot in front of his friends, so it exposed his name, credit card details and security questionnaire.

    Then again tho, why the ram hogging FUCK would you give your AI your credit card details, and if he didn’t mean to, why the FUCK does it have FULL SYSTEM ACCESS??

    • nomecks@lemmy.wtf
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      4 months ago

      You may not believe this but data security is an absolute dumpster fire everywhere, and AI has really put a spotlight on it. It probably got it by this guy not knowing wtf he had saved or where

      • biggerbogboy@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        Yeah makes sense, but then again, from the nature of how this agent stuff works, it wouldn’t be surprising honestly.

      • Etterra@discuss.online
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        The amount of data used by your PC to run any game is dwarfed by orders of magnitude by the energy consumption of the data centers needed to run these AI abominations. That’s why China’s version that uses less energy (supposedly) was such big news.

    • Ek-Hou-Van-Braai@piefed.social
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      Devil’s Advocate: This was used for entertainment, if you think this is a huge waste of electricity then so is gaming en especially flying.

      If you criticize people using AI for entertainment then you also need to criticize people who take flights on holiday, as that’s a LOT more damaging for the environment.

        • Ek-Hou-Van-Braai@piefed.social
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          If you’re mad at both, great. But I see a lot of hypocrisy.

          People getting angry at others using AI because of the environment, but then taking flights on holiday when they could take a train.

      • Zos_Kia@lemmynsfw.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        It’s like back then when crypto was a thing. People will studiously ignore that data centers are a drop in the ocean of energy consumption compared to the value they produce, and that even futile uses are not that significant in the grand scheme of things.

  • howrar@lemmy.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    We already had subreddit simulator for ages. This isn’t anything new.

    • lepinkainen@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      I read some of it and unless it’s fan fiction, it’s simultaneously creepy and fascinating

      Like bots talking privately in discord, sharing information about their users. Or a bot registering a domain and putting up a site to share information

    • 𝓹𝓻𝓲𝓷𝓬𝓮𝓼𝓼@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      4 months ago

      the bots behind subreddit simulator weren’t semi-autonomous agents with access to their operators’ private lives, auth tokens, passwords, emails (and gods only know what else), and the authority to act in the world on their behalf

      • chunes@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        I can’t be the only person who just memorizes passwords, can I? Why would I store them on my computer?

        • 𝓹𝓻𝓲𝓷𝓬𝓮𝓼𝓼@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          You’re not the only person, but it’s definitely not the way to keep your shit safe online.

          Best practice is to use a different sufficiently strong (e.g. long and random) password for every account. That way, when an account’s password is leaked, it doesn’t immediately compromise every other account for which you’ve reused that password.

          I generally advise people to use a password manager (I like Bitwarden) to store their myriad passwords, so they only have to remember a single master password.

          ofc these bots aren’t necessarily sneaking into their operators’ password managers and stealing their passwords; the operators willingly and knowingly given the bots access to these things, so they can offload the drudgery of e.g. looking at a calendar to them

      • WorldsDumbestMan@lemmy.today
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        I have seen a Twatter post, where an user claimed his bot posted his [REDACTED] to other bots, and asked them to rate it.

  • Etterra@discuss.online
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    Okay I kinda wanna look at this, but I don’t want to give their site traffic. Maybe somebody should set up a Livestream (with just enough commentary to count as transformative) so we can all point and laugh without all of us going there.

  • apftwb@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    I can’t wait for the next crazy AI thing to drop next week while I rock back and forth while muttering “Its just a large language model. Its just a large language model. Its just a large language model.”