chobeat@lemmy.ml to Technology@lemmy.worldEnglish · 22 days agoMeet the AI workers who tell their friends and family to stay away from AIwww.theguardian.comexternal-linkmessage-square16fedilinkarrow-up1209arrow-down13
arrow-up1206arrow-down1external-linkMeet the AI workers who tell their friends and family to stay away from AIwww.theguardian.comchobeat@lemmy.ml to Technology@lemmy.worldEnglish · 22 days agomessage-square16fedilink
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up2·edit-222 days agoBloefz has a great setup. Used Mi50s are cheap. An RTX 3090 + a cheap HEDT/Server CPU is another popular homelab config. Newer models run reasonably quickly on them, with the attention/dense layers on the GPU and sparse parts on the CPU.
Bloefz has a great setup. Used Mi50s are cheap.
An RTX 3090 + a cheap HEDT/Server CPU is another popular homelab config. Newer models run reasonably quickly on them, with the attention/dense layers on the GPU and sparse parts on the CPU.