Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe, and that the true power of this technical domain lies in more targeted and bespoke ML model generation and usage.
ML is good and enables - and has enabled - some genuine generational leaps in science and technology. But LLMs are such a fucking waste of the technology’s potential. Not to mention, in extremely irritated that (largely due to Nvidia cornering the market) everyone is super gung-ho about a digital approach which amounts to brute-forcing neural nets digitally with shitloads of memory and highly-parallel compute, when it’s obvious to anyone with more than a passing familiarity with electrical engineering that an analog approach is going to be FAR more efficient in terms of resource and energy usage.
Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe
Funny, but it’s actually a bit worse. People are literally falling in love with it and generally go nuts. This is not even getting into the whole “it’s conscious”. You’re essentially living in a bubble and don’t really know how bad it is. Don’t look up how many use character.ai
EDIT: On a related note, it’s slightly annoying that Lemmy converts links like.it, without me providing https://
Yeah, for 4 and 8 bit quantization at least analog charge buckets or memristor-likes and analog multipliers would dramatically reduce substrate size, reduce power burn and speed up inference. Even better killer drones, here they come. Yay.
I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”.
Maybe optimize the LLM to run on less compute?
If I was king they would have to run on 100% on-site solar and air cooling.
would be based
Don’t worry, Chinese LLM vendors without access to the newest hardware will take care of that.
based,hopefully they use this to optimize local LLMS so i have higher tokens per second.
But everything’s computer!
Stop talking sense when has good sense ever been the solution of choice.
Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe, and that the true power of this technical domain lies in more targeted and bespoke ML model generation and usage.
ML is good and enables - and has enabled - some genuine generational leaps in science and technology. But LLMs are such a fucking waste of the technology’s potential. Not to mention, in extremely irritated that (largely due to Nvidia cornering the market) everyone is super gung-ho about a digital approach which amounts to brute-forcing neural nets digitally with shitloads of memory and highly-parallel compute, when it’s obvious to anyone with more than a passing familiarity with electrical engineering that an analog approach is going to be FAR more efficient in terms of resource and energy usage.
Funny, but it’s actually a bit worse. People are literally falling in love with it and generally go nuts. This is not even getting into the whole “it’s conscious”. You’re essentially living in a bubble and don’t really know how bad it is. Don’t look up how many use character.ai
EDIT: On a related note, it’s slightly annoying that Lemmy converts links like.it, without me providing https://
maybe this is personal preference
?
Analog meaning think for yourself or what?
Yeah, for 4 and 8 bit quantization at least analog charge buckets or memristor-likes and analog multipliers would dramatically reduce substrate size, reduce power burn and speed up inference. Even better killer drones, here they come. Yay.
I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”.