Comment on Is anyone self-hosting their own AI?
ch00f@lemmy.world 4 days ago
I just got qwn3-4b-instruct working on an Intel A750 with 8 gigs of vram.
I use it to power Home Assostant/Voice Assistant on a few M5Stack echos around the house to replace cloud based smart speakers.