SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 8 days agoDo you host your own AI?message-squaremessage-square203linkfedilinkarrow-up1176arrow-down141file-text
arrow-up1135arrow-down1message-squareDo you host your own AI?SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 8 days agomessage-square203linkfedilinkfile-text
minus-squarealexcleac@szmer.infolinkfedilinkEnglisharrow-up1·8 days agoI’ve been running ministral on CPU on a home-server: works pretty nicely, not very performant for everyday tasks and the savings were not sufficient for it to make sense. It still was cheaper and faster to just use Mistral API and get better models.
I’ve been running ministral on CPU on a home-server: works pretty nicely, not very performant for everyday tasks and the savings were not sufficient for it to make sense. It still was cheaper and faster to just use Mistral API and get better models.