• Vlyn@lemmy.zip
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    You have 170+ GB VRAM at home? (:

    I mainly use DeepSeek v4 Flash now, it’s the cheapest around and the quality is high enough for coding. At work we’re throwing tons of money at Claude, but even there I usually stick to Sonnet (as Opus is burning money).

    • De Lancre@lemmy.worlddeleted by creator
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      You don’t need 170+ GB of VRAM. Whole model can be run at around 1 token/second on a modern hardware from an ssd. Which is slow, don’t get me wrong, but it still somewhat useable.

      • placebo@lemmy.zip
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        “Somewhat” is doing a lot of heavy lifting there 😂 How much time does it take to process your average request?