• chunes@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    Using an LLM to parse stuff is like using a rocket launcher to kill an ant.

    You can accomplish the same thing using a million times fewer resources with a purpose-built program.

    • jmp242@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Well, if your KPI is how much you use an LLM like in some reports - this is an easy way to get those good indicators. Also, LLMs are super easy to use to parse things, whereas many special programs like IDK grep isn’t exactly user friendly. Not to mention not finding patterns really. Though here I’m thinking things like looking at various logs on computers.

      • NotAnonymousAtAll@feddit.org
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        Maybe we could at least nudge the LLMs in the direction of suggesting appropriate tools and giving hints how to actually do that when applicable instead of blindly brute forcing every task. Of course that does not solve the issue of stupid corporate incentives, but I feel like by now most companies have realized that burning as much money as possible is not a good goal.

    • BradleyUffner@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Will, that’s what happens when employers tell employees that they should “use ai first”, track their token use on a dashboard, and tell them they’ll get fired if they are too low on the monthly ranking.

      • jj4211@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        Yeah, my manager expressed satisfication with me being one of the people using my quota of tokens.

        I have generated so much throwaway content that never gets used and only gets deleted to burn the tokens to avoid getting the “you aren’t using AI enough” talk. The fact they can see my actual productive output and believe AI is involved shows how utterly disconnected the metric is from reality.

        • frongt@lemmy.zip
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          Damn how can I get a job whose primary KPI is just burning tokens?

          Edit: actually the answer is “Amazon consultant” based on the experience I had observing one of them “working”. He just repeatedly prompted their LLM and went around in circles instead of actually doing anything useful.

    • Rooster326@programming.dev
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Yes but you’re in an open office and all you have available in your open office hell are: rocket launcher, your sanity, Debra’s snappy attitude.