Comment on Is anyone self-hosting their own AI?
Monument@piefed.world 10 hours ago
I wouldn’t say I ‘run’ it, but I mess around with it
I have a base level Mac Mini I got before the price increase a few years ago, also from when models were smaller and my ambitions were less. I’ve contemplated upgrading it, but I have other things to spend my money on.
M4 processor, 16 gb ram, 256 gb storage, and a 4tb external HDD drive (an old NAS drive).
It’s fine. It’s mostly a docker machine, but I do throw AI tasks at it a few times a week. Mostly stuff that I just let it chew on for 5-10 minutes and come back to.
I run openwebui, and have several models I bounce between. I mostly run Gemma4 (Google) and Granite4.2:8B (IBM).