If an LLM was something you could train on your GitHub repo or an internal knowledge base, and ask it natural language questions about that, AND it didn’t need an 800 acre datacenter to do it, I wouldn’t have so many hang-ups about it. Or maybe even train a model in a programming language and have a model that’s tailor made for writing C, or LISP, or Brainfuck or something.
But that’s not what they are. They only function if you hoover up everything the light touches and feed it to the machine, to the point where rare, irreplaceable literature is being shredded apart for training data. And god help you if you try to take your ball and go play somewhere else as the AI boosters profess you must do, they will follow you there and scrape you anyway
But have you considered that it’s like REALLY good at programming? /s
What’s stupid is, you could even just keep just the programming part, and it would become much more efficient and not ramble on with explanations etc.
If an LLM was something you could train on your GitHub repo or an internal knowledge base, and ask it natural language questions about that, AND it didn’t need an 800 acre datacenter to do it, I wouldn’t have so many hang-ups about it. Or maybe even train a model in a programming language and have a model that’s tailor made for writing C, or LISP, or Brainfuck or something.
But that’s not what they are. They only function if you hoover up everything the light touches and feed it to the machine, to the point where rare, irreplaceable literature is being shredded apart for training data. And god help you if you try to take your ball and go play somewhere else as the AI boosters profess you must do, they will follow you there and scrape you anyway
You are describing local models and they’re getting pretty damn good, especially at coding.