schizoidman@lemm.ee to Technology@lemmy.worldEnglish · 2 months agoDeepSeek's distilled new R1 AI model can run on a single GPU | TechCrunchtechcrunch.comexternal-linkmessage-square7fedilinkarrow-up1146arrow-down118
arrow-up1128arrow-down1external-linkDeepSeek's distilled new R1 AI model can run on a single GPU | TechCrunchtechcrunch.comschizoidman@lemm.ee to Technology@lemmy.worldEnglish · 2 months agomessage-square7fedilink
minus-squarefogetaboutit@programming.devlinkfedilinkEnglisharrow-up5arrow-down10·2 months agoew probably still censored.
minus-squarefogetaboutit@programming.devlinkfedilinkEnglisharrow-up1·2 months agoif the model is censored… then what, retraining it? Or doing it from scratch like what open-r1 is doing?
minus-squarejaschen@lemm.eelinkfedilinkEnglisharrow-up1arrow-down3·2 months agoThe self hosted model has hard coded censored content.
minus-squareT156@lemmy.worldlinkfedilinkEnglisharrow-up9arrow-down3·2 months agoThe censorship only exists on the version they host, which is fair enough. If they’re running it themselves in China, they can’t just break the law. If you run it yourself, the censorship isn’t there.
minus-squarejaschen@lemm.eelinkfedilinkEnglisharrow-up3arrow-down1·2 months agoUntrue, I downloaded the vanilla version and it’s hardcoded in.
minus-squareMonkderVierte@lemmy.mllinkfedilinkEnglisharrow-up1arrow-down1·edit-22 months agoYeah, i think the censoring in the LLM data itself would be pretty vulnerable to circumvention.
ew probably still censored.
You can self host it right??
if the model is censored… then what, retraining it? Or doing it from scratch like what open-r1 is doing?
The self hosted model has hard coded censored content.
The censorship only exists on the version they host, which is fair enough. If they’re running it themselves in China, they can’t just break the law.
If you run it yourself, the censorship isn’t there.
Untrue, I downloaded the vanilla version and it’s hardcoded in.
Yeah, i think the censoring in the LLM data itself would be pretty vulnerable to circumvention.