minus-squareteslasdisciple@lemmy.catoSelfhosted@lemmy.world•1U mini PC for AI?linkfedilinkEnglisharrow-up14·2 months agoI’m running ai on an old 1080 ti. You can run ai on almost anything, but the less memory you have the smaller (ie. dumber) your models will have to be. As for the “how”, I use Ollama and Open WebUI. It’s pretty easy to set up. linkfedilink
minus-squareteslasdisciple@lemmy.catoSelfhosted@lemmy.world•1U mini PC for AI?linkfedilinkEnglisharrow-up1arrow-down1·2 months agodeleted by creator linkfedilink
I’m running ai on an old 1080 ti. You can run ai on almost anything, but the less memory you have the smaller (ie. dumber) your models will have to be.
As for the “how”, I use Ollama and Open WebUI. It’s pretty easy to set up.