JensSpahnpasta@feddit.org to Technology@lemmy.worldEnglish · 2 months agoSilicon Valley is buzzing about this new idea: AI compute as compensationwww.businessinsider.comexternal-linkmessage-square89fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkSilicon Valley is buzzing about this new idea: AI compute as compensationwww.businessinsider.comJensSpahnpasta@feddit.org to Technology@lemmy.worldEnglish · 2 months agomessage-square89fedilink
minus-squareunnamed1@feddit.orglinkfedilinkEnglisharrow-up0·2 months agolol inference is already cheap af. Might as well pay money. Dipshits.
minus-squareXLE@piefed.sociallinkfedilinkEnglisharrow-up0·2 months agoPer-token costs are down, but you need more tokens; overall costs are up.
minus-squareJacob_Mandarin@lemmy.worldlinkfedilinkEnglisharrow-up0·2 months agoYeah they are trying to add more and more context and allow bigger and bigger requests. Cost per request is probably still going up. On top of there being more and more requests.
lol inference is already cheap af. Might as well pay money. Dipshits.
Per-token costs are down, but you need more tokens; overall costs are up.
Yeah they are trying to add more and more context and allow bigger and bigger requests.
Cost per request is probably still going up. On top of there being more and more requests.