Comment on Is anyone self-hosting their own AI?

ch00f@lemmy.world ⁨4⁩ ⁨days⁩ ago

I just got qwn3-4b-instruct working on an Intel A750 with 8 gigs of vram.

I use it to power Home Assostant/Voice Assistant on a few M5Stack echos around the house to replace cloud based smart speakers.

source
Sort:hotnewtop