I have 128gb of DDR4 RAM, a 4090, and a 3060. While certainly not weak, my computer is some generations behind. People, real people, can run a model inside their homes. Provided you limit the context and get a midrange quantization, you can run a Qwen3.6 35b on a midrange gaming PC.
Given time, we will someday run DOOM Eternal in our pockets, and be able to talk with the demons.
This is exactly the kind of cluelessness I was talking about. Again, training is way more expensive than running models, and very obviously a rig that costs several thousands of dollars is something not many people have access to.
I have 128gb of DDR4 RAM, a 4090, and a 3060. While certainly not weak, my computer is some generations behind. People, real people, can run a model inside their homes. Provided you limit the context and get a midrange quantization, you can run a Qwen3.6 35b on a midrange gaming PC.
Given time, we will someday run DOOM Eternal in our pockets, and be able to talk with the demons.
This is exactly the kind of cluelessness I was talking about. Again, training is way more expensive than running models, and very obviously a rig that costs several thousands of dollars is something not many people have access to.