• ZephyrXero@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM