• bthest@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    8 days ago

    Here’s a real a cost saving prompt:

    “Translate the contents of every single document in our databases into as many languages (including dead and constructed fictional languages) as possible.”

    Now you can fire the one Hispanic guy you hired because you assumed he could speak Hindi.

  • TachyonTele_Esq@piefed.social
    link
    fedilink
    English
    arrow-up
    0
    ·
    8 days ago

    an astonishing 29 percent of [execs] had no idea where the growing costs associated with AI were coming from.

    The headline combined with the quote just make me laugh so much, I love it

    • Yggstyle@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      8 days ago

      And we hope they go broke, dont pay their bills, cause a panic sell on AI services, which causes private equity to panic sell everything… which pops the bubble… and leads to the literal version of ‘its raining men’ on wall street as executives and profiteers have their horde of ill gotten gains evaporate in seconds.

      … too much?

    • Triumph@fedia.io
      link
      fedilink
      arrow-up
      0
      ·
      8 days ago

      This is what happens when the people in charge of everything are entirely separated from reality.

      • rumba@lemmy.zip
        link
        fedilink
        English
        arrow-up
        0
        ·
        8 days ago

        Those same idiots have been in charge of everything for decades, blindly doing whatever suited them.

        They got duped and didn’t have the technical competence to see it or trust their staff to negotiate it.

        Every IT / Developer out there knew it was a bad idea. The C-Staff was sold by the billionaires that you will go AI or you will be left behind.

        My own CEO is simultaneously telling us to use AI for as much as we can and telling us to reduce costs as much as possible.

        • Valmond@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          Except this time they’ll have a hard time blaming the devs and other workers.

          I mean they’ll sneak around it, but maybe just maybe the blame will not be distributed? Lol who am I kidding.

          • rumba@lemmy.zip
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            The’re apex predators, they don’t blame anyway, just mass layoffs due to non-profitability ()

            non-profitability(){  
                   if CEO_makes_less_money_than_they_want();  
                            return true;  
                   return true anyway because fuck the proliariat  
            }  
            
          • Tollana1234567@lemmy.today
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            they will just lay off more people to stave off the debt, and then to hold the industry to gether outsource, and hire only some senior devs while ignoring entry or juniour level people.

        • partofthevoice@lemmy.zip
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          I told my boss this:

          • Right now the AI race has a lot of similarities to the dotcom bubble. The subject is packed with risky loans based on huge debts. Those huge debts are expecting to be paid as AI becomes profitable, but AI companies are largely loosing money.
          • All those loans and infrastructure create the burden of sunk costs leading to a desperate need to succeed.
          • The people feeling that desperation are the same people who own the largest marketing, news, and social media networks in the world.
          • As a result, there’s a lot of hype around AI. A lot of “kool-aid,” and everyone wants you to drink it. If you drink the kool-aid, that means you’re also bought into the problem. You also need it to succeed, thus making their problem into your problem.

          I explained to him that mature, professional use of AI is going to wind up following a similar path to data engineering. It’ll start with bullshit standards, “prompt engineers” and the like, but eventually SE disciplines are going to define who makes best use of AI. You’re going to have niche use cases for daemon AIs, local LLMs, and remote models. You’ll have stronger frameworks around session management, context management, agent permissions, …

          It’s not going to be like this forever, “dump all your shit into our web upload and let the AI figure everything out in one go.” It’s going to become more fragmented, bounded, dare I say deterministic… orchestratable.

          Then I told my boss, it would be better if he could frame his excitement around these future use cases… so we can skip the kool-aid stage and get right into the good stuff.

          He agreed, until about a week passed. Then it was AI hype again.

          • frongt@lemmy.zip
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            Yeah. Local LLM stuff is great when you want to shove a huge pile of documentation into a model trainer and make a more intelligent search. Two of my vendors have implemented it, and it’s more useful than a traditional indexing search tool, though you do have to verify the results (which is not much more effort since with a search you’d have to skim the document to find the info it matched anyway).

            But for general “do everything” tool, yeah no. It can’t read and understand your entire database, codebase, business process, etc.

            • partofthevoice@lemmy.zip
              link
              fedilink
              English
              arrow-up
              0
              ·
              8 days ago

              Honestly, I’ve had a rather interesting experience with AI. I was very adverse to LLM usage at first. Later I sort of figured out that I was more adverse to the energy around AI than I am AI itself.

              I knew the models sucked at large tasks. Trying to get an edge on the matter though, I started asking myself, how can I get the model to perform better? I figured I could pass over the AI hate stage and get right into the AI professional stage… at least a head start.

              So I began experimenting with local LLMs, LLM harnesses, and various governance tools like jai. I decided against Claude Code and Cortex because they’re provider specific — instead using OpenCode so that I can use whichever model I desire. Then I began building out a SKILL.md repository for tightly scoped tasks like change-review, security-analysis, refactor, architecture-review, grill-me, feature-design, …

              I’m still thinking through some of the project needs. I want something that lets an agent work, while treating the agent as a kind of helpful adversary. You should be able to configure workloads that designate models, context, available tooling, skills, permissions, session length, inference level, acceptance criteria, and human-review stages. It would also allow for session switching, model switching, agent deliverable handoff to another agent, … not to mention, your VCS should know and respond appropriately if an agent ever pushes code. Don’t trust it by default.

              These workloads should be version controllable, benchmarked, …

              Anyway, a lot of that is speculative. Just where I’m at now, controlling context and skills manually, I’m already seeing much better results.

              And no, I don’t have the AI do everything. I just find smarter ways to decompose “everything” into much smaller tasks that are easier to review and scrutinize.

              But also, I push for local model usage in my organization. I don’t want my success to mean success for the AI companies. Fuck the AI companies.

              • rumba@lemmy.zip
                link
                fedilink
                English
                arrow-up
                0
                ·
                8 days ago

                I was forced to dogfood it. I found that for my specific needs, it made me super productive. I generally make Claude write Ansible jobs, I store all my secrets in a vault that it never gets access to.

                It can do tremendous amounts of work at my command in relative safety as long as i provide it protected tools.

                Now, that said, I burn a hell of a lot of tokens moving at that speed. When the ass falls out of the market, i’ll still have all the ancible stuff I can reuse.

              • boonhet@sopuli.xyz
                link
                fedilink
                English
                arrow-up
                0
                ·
                8 days ago

                Neither Claude code neither codex is actually vendor specific, they just don’t tell you that you can config other providers, including local

                However opencode is pretty nice too, so if you like it, use that. I personally find that opencode with GLM 5.2 or Kimi K2.7 isn’t actually that great, it’ll hallucinate more than Claude code or Codex with their respective first party models. I think it’s the models themselves rather than opencode itself though, as when I use GPT for planning and hand it off to deepseek flash to do the actual work, it’s more or less fine.

                • rumba@lemmy.zip
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  ·
                  8 days ago

                  I suspect behind the scenes, the first parties are sending your requests to multiple targets and sending you back quorum.

          • rumba@lemmy.zip
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            The 3rd or 4th “industry expert” tells them that things are “moving fast” and things that were impossible months ago are now reality. It’s designed to make them distrust their own subject-matter experts. They thing, ohh POTV, they’re just not educated and up to speed.

        • borkborkbork@piefed.social
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          yep. these mba types have gutted half of id, and are changing id - ID - to unreal engine projects.

          fucking hell

          • zarkanian@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            Yeah, that isn’t how this works. You don’t want to be the one using the software while it’s still in beta. Wait until the dust settles before committing to anything. Besides which the super-urgent "You have to buy now!" FOMO sales pitch is a classic strategy for scammers.

          • takeda@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            That’s because they bought into the pitch that AI will replace employees (or at least large number of employees) they understand that they will still need to build tooling that would facilitate that and believe that once other companies will say they eliminated employees this way the companies that are “are left behind” will be stuck still needing employees that will catch up to this plan and refuse to help company to get there.

          • rumba@lemmy.zip
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            The sales pitch is:

            All your competition is going AI. They’re be producing 10x the work with mouth breathing morons at the keys, while you’re stuck paying millions to subject matter experts.

            They’re scared ot death that the tenuous hold they have on their market segment will be severed if their competition outflanks them in this, so FUD wins.

            • a_non_monotonic_function@lemmy.world
              link
              fedilink
              English
              arrow-up
              0
              ·
              8 days ago

              This isn’t Justin industry or tech. I work in the academy. You would be shocked how many people from administrators all the way on down truly believe this. That, without any proof, this technology is going to make everybody a billion times more productive and that any graduates who don’t have this is a foundational skill will surely not survive in the future workforce.

              • Tollana1234567@lemmy.today
                link
                fedilink
                English
                arrow-up
                0
                ·
                8 days ago

                students using AI to write thier papers, LORs, or projects, and professors using it to screen out AI themselves, or using it to make lectures. this is for university level, and then you have students unable to write a paper themselves, and teacher even more removed from teaching a class.

  • NM_Gringo@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    8 days ago

    Someone should remind those soggy, arrogant execs that down here in the developer trenches we survived web services, software as a service, outsourcing, and off-shoring. We’re still here after all that and we’ll still be here after AI.

    • palordrolap@fedia.io
      link
      fedilink
      arrow-up
      0
      ·
      8 days ago

      Some of these people are so out of touch that they’d have to spend a decade in the trenches before they might even begin to get an inkling that something is up.

      Case in point: Bezos went to space and wasn’t humbled by the overviewer effect because his ego is literally larger than the planet he lives on.

      • applebusch@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        0
        ·
        8 days ago

        to be fair the overviewer effect has been romanticized and played up by people who literally spent their entire life training and competing for the chance at a few hours or days cumulative time in space while pretending for the deciders and teams of doctors that they arent just normal flawed people like the rest of us. astronauts basically have to buy in to the overviewer effect as one of the things that makes all their sacrifices “worth it”, and part of trying to convince themselves is convincing others that its a real thing most people will experience. its more of a placebo effect in reality, though im sure there are people who genuinely felt it. bezos just didnt have to work for it at all so he has no incentive to buy into the hype, total lack of empathy and compassion aside.

  • Zwuzelmaus@feddit.org
    link
    fedilink
    English
    arrow-up
    0
    ·
    8 days ago

    SMH Did they really think all these investors just wanted to burn 9-figure sums without any serious return?

    i am saying this for about a year now: Altman wants to rule the world.

    • Dyskolos@lemmy.zip
      link
      fedilink
      English
      arrow-up
      0
      ·
      8 days ago

      Who of the billionaire (and now trillionaires, sigh) fucknuggets does not want to rule the world?

      What else should one do if one already has everything and can’t buy anything else…

      • Zwuzelmaus@feddit.org
        link
        fedilink
        English
        arrow-up
        0
        ·
        8 days ago

        Who of the billionaire (and now trillionaires, sigh) fucknuggets does not want to rule the world?

        But most of them have no plan beyond money, money, money.

        This one has. He wants first to use his AI beasts to serve him make the rules for every*, and the rest of humanity to serve his bots, or something like that.

        • Dyskolos@lemmy.zip
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          No plan we know of…not everyone is a 5yr old attention seeking whore like those everyone knows.

          Sounds like conspiracy theories, but we know what she should know and are allowed to know.

      • aim4harmony@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        8 days ago

        A trillionaire sounds surreal. Imagine having an entire country economy (or a few smaller ones) as your budget.

        • KingPorkChop@lemmy.ca
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          And think about one Trillionaire - Musk. All that money and he just trips on Ketamine and troll posts on Twitter. He’s doing nothing for society.

          A regular human would be doing things just for fun like restoring an old building they liked, or saving some dying kid. Maybe going the Dolly Pardon route and giving books to kids.

          Not Musk. He’s getting dick surgery to try and fix his dick from the last surgery and shitposting.

        • Dyskolos@lemmy.zip
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          Indeed. When I was young, a millionaire seemed rich. As I grew older, billionaires seemed rich. And now we’re one step further. The average millionaire is further away from musk than the average Joe from said millionaire.

          It’s absurd and shouldn’t be possible. Billionaires also shouldn’t. Why would anyone even need hundreds of millions. You can live wonderfully with very few millions or even less than one.

            • Dyskolos@lemmy.zip
              link
              fedilink
              English
              arrow-up
              0
              ·
              8 days ago

              True. We (Germany) experience that too. In some places you wouldn’t get a 1 bedroom tiny apt for a sum you could buy a decent house elsewhere.

              But I just wouldn’t want to live in such cities or neighborhoods. For what purpose? Why should anyone even know I’m loaded? In real life noone knows I am. If I’d raise a cup on the streets people would probably throw change into it 😁

              • SpaceNoodle@lemmy.world
                link
                fedilink
                English
                arrow-up
                0
                ·
                8 days ago

                Nobody has to know you own a house. Don’t gad about in a tuxedo wearing a monocle.

                The purpose of living in a population-dense area is the culture and amenities, such as healthcare facilities and art communities.

                • Dyskolos@lemmy.zip
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  ·
                  8 days ago

                  Sure, but those you can have basically everywhere, don’t need to pick the rich neighborhoods or generally expensive cities.

                  I lived in our capital once. It had not one benefit I couldn’t find elsewhere. At least none I would’ve found. And we move every few years to somewhere else in krautland.

            • Tollana1234567@lemmy.today
              link
              fedilink
              English
              arrow-up
              0
              ·
              8 days ago

              yup, i live in hcol, cant move out almost everyone has a job that earns them enough over the years to be a millionaire, mostly tech people. they arnt rich, i consider rich if you are making 1+mil/year

          • Tollana1234567@lemmy.today
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            MILLIONiares have to at least invest thier time, or money, job to get much. its the 10s-100s millionaires that are born wealthy+ billionaires. most of them, surprise dont really have much of job/or direction, thats where all the influencers(youtube,etc) came from(most of them). even the humble ones can let money get to thier heads.

  • ceenote@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    8 days ago

    And the media will keep on shamelessly calling them “job creators”.

    Hopefully some day the average voter will see through that shit.

  • db2@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    8 days ago

    At this rate the leopards are going to have to start going on a restricted diet. Maybe the panthers are hungry too though.

    I mean exactly what you think I mean.

  • DandomRude@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    8 days ago

    That makes it pretty clear that most executives are the worst possible people to run a company. Well, that’s just how it is when ruthlessness and greed are the only criteria used to select top executives.

    But hey, even if they were to lose their jobs because they’re burning through so much money, things will go on as usual: Anyone who’s ever held a top management position will always be hired for the same role somewhere else, because competence is definitely not the deciding factor here. Never was, never will be.

    • bagsy@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      8 days ago

      I already see lots of boutique consultancies popping up specifically saying they will fix tour slop code bases. Developers and doctors will never run out of work.

        • jaybone@lemmy.zip
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          They will have to trash a bunch of it and rewrite entire modules and components from scratch.

          I’ve seen as AI keeps iterating over enhancements and bug fixes, the spaghetti code gets worse and worse over time. At some point only the AI understands its own code, as it is too much garbled nonsense for a human to trace through. Eventually that becomes too much garbage for the ai to trace through. And then that’s where you end up.

          The idea that this can be some kind of non-deterministic abstraction layer between pseudo code and actual code is absurd.

      • Goodeye8@piefed.social
        link
        fedilink
        English
        arrow-up
        0
        ·
        8 days ago

        Of course but the cost can be mitigated. I’ve seen an AI built project and the outcome is that you pretty much have to continue using AI to continue development because it’s borderline incomprehensible for humans. When AI fails to continue development you scrap the entire project and start from scratch.

        I imagine all companies that allowed AI to go wild in their codebase have a lot of components that need to be rebuilt from the ground up.

        • SabinStargem@lemmy.today
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          In theory, completely rewriting legacy software with AI could be a great thing - doing so every 3 or 4 years, allowing newer and better AI to tackle the task, optimizing for every development made in technology or standards.

          However, this still requires human minds to define, guide, and verify these projects. AI opens up possibilities for better development, but executives seem determined to fritter away such potential by axing the human element.

          It is like a certain story…

          • Axolotl@feddit.it
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            I don’t know how much AIs can be useful on big ass projects, but it def was useful for me when i had to look at the code of a project i made 1 year ago, i was so much worse at writing code and it was such a mess that ultimately i used an AI agent to rewrite it
            Do i feel dirty? Yep
            Has it saved time? YES

          • Valmond@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            0
            ·
            8 days ago

            You forgot that AI cannot “rewrite legacy software”.

            Otherwise it’s a nice thing to fantasize about 😁

      • ilinamorato@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        8 days ago

        The tech debt always gets paid one way or another. Either preemptively, as part of ongoing maintenance; or after a data breach in the subsequent lawsuit and settlement; or in the slow, inexorable trickle of increased infrastructure costs and lost business from slow dependencies and ineffectual bandaid solutions.

        • Windex007@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          8 days ago

          Another payment option is not tackling it at all and just “paying the interest” by having a larger engineering team to wrangle the beast than you would otherwise have needed.

  • BarneyPiccolo@lemmy.today
    link
    fedilink
    English
    arrow-up
    0
    ·
    8 days ago

    They intended to use AI to rape their employees and the American public, only to find out that the real money is in the AI companies raping THEM!

    • GreenBeard@lemmy.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      8 days ago

      4/5 actually, if statistics are anything to go by. The remaining 20% are just slightly above median stupidity, with a vanishingly small sliver actually approaching competent.

  • 深夜量化室@lemmy.1095.me
    link
    fedilink
    English
    arrow-up
    0
    ·
    8 days ago

    @FoxtrotDeltaTango’s post glosses over something: the token bill is only 60% of the real cost. Infrastructure to handle latency (caching, batching), human review loops for quality, and retraining pipelines when models drift add another 40-50%. A team that thought they’d replace two engineers with an API often ends up hiring a prompt engineer + ML ops person instead. The margin math gets much uglier when you add those in. Broke down the full cost-of-ownership (tokens + ops + people) here https://cxgo.ai/l/IjOzask — helps separate real savings from accounting fiction.