Yeah I need to try those models at some point so I understand them a bit better. Not sure how my laptop will like them though, or if I’ll be functionality limited by compute to the point that they’re less than useful.
To clarify: Jan, Ollama, Alpaca, etc. are frameworks, onto which you can download and chat with different LLMs. They themselves are not LLMs. But yeah, you should probably have, like, a 2080+ or something…
This is why FOSS is the safest way to go, with Ollama, Alpaca, etc. You’d need a beefy rig to run such models, though.
Yeah I need to try those models at some point so I understand them a bit better. Not sure how my laptop will like them though, or if I’ll be functionality limited by compute to the point that they’re less than useful.
To clarify: Jan, Ollama, Alpaca, etc. are frameworks, onto which you can download and chat with different LLMs. They themselves are not LLMs. But yeah, you should probably have, like, a 2080+ or something…