Comment on Is anyone self-hosting their own AI?
amgine@lemmy.world 4 hours ago
Epyc 7551? 256gb ddr4, r9700 + mi50. Running two models depending on what I’m doing . Llama.cpp + comfyUI or two llama.cpp for model and advisor in OMP. Main model is Qwen 27 abliterated