Comment on Is anyone self-hosting their own AI?

binaryqueen@programming.dev ⁨4⁩ ⁨days⁩ ago

I don’t want to create an extra post, so I ask here.

Where do you guys get your hardware from, for an affordable price?

I’d like to run at least a 27b model but my hardware is too weak. I’m on a 16GB unified mem, M4. Tried running Bonsai 27b (it’s Qwen architecture) but I had to close all other apps and it is not in a state that I could work with it.

source
Sort:hotnewtop