Both Ubuntu and Fedora have made it official: support is coming soon for running local generative AI instances.
An epic and still-growing thread in the Fedora forums states one of the goals for the next version: the Fedora AI Developer Desktop Objective. It is causing some discontent, and at least one Fedora contributor, SUSE’s Fernando Mancera, has resigned.
pretty much anything that is “you build it youself” so Arch, NixOS, Gentoo, etc
but yeah I’m also tempted to finally give BSD a go.
nixos comes with systemd
SystemD does something everyone uses, though. Many may prefer other methods, but systemD still does cover the need for init, logging, and system control, which everyone with a PC does need.
LLMs are useful to only a subset of users, so including it in general distribution is waste, because many people will end up with this software that was downloaded, installed, and maintained by someone, but they never use at all. It may not be actively using their RAM, but it is still using their disk space and has dependencies that may load whether or not it is run.
In a time of grievous constraint on hardware availability, that kind of waste is literally impossible to tolerate for many, and will force users to fewer distro choices, so they do have skin in the game and grounds to make their voices heard.
That’s absolutely untrue in this case.
If you read the article (the headline text is a link to an article) you would see that they specifically address this:
It won’t be included in the general distribution. They’re talking about a new system image that someone would have to choose to install.