I realize, I need to upgrade my little NUC to something bigger for higher inference of bigger llama models. I want something that you still can have on your living room’s tv bench, so no monster rack please, but that has also the necessary muscle when needed for llama. Budget doesn’t matter right now, want to understand what’s good and what’s out there. Thanks


If you happy with 16g , nothing can beat in speed/cost of AMD RX 9070 XT.
Wouldn’t an AMD RX 9060 XT with 16 GB RAM be nice as well if you’re hunting for good speed/cost options?