I bought a datacenter GPU that doesn't fit in a normal motherboard, macgyvered the fan with jumper wires, and now I'm running a model that ties with Claude Sonnet 4.6 on benchmarks, all for £200.
The saving grace of this architecture is that it’s the first to use GSP and is therefore able to be properly implemented by open-source drivers with full feature support. Nouveau supports it and eventually the succeeding Nova driver presumably will too.
The main thing that itches me with the V100 is the fact that given that pascal is about to be EOL, a 2017 card is probably soon next
The ampere class is soon to fall out of relevance as well.
The saving grace of this architecture is that it’s the first to use GSP and is therefore able to be properly implemented by open-source drivers with full feature support. Nouveau supports it and eventually the succeeding Nova driver presumably will too.
About to be? Pascal cards no longer work in TrueNAS scale due to Nvidia dropping driver support