Comment on Is anyone self-hosting their own AI?

amgine@lemmy.world ⁨4⁩ ⁨hours⁩ ago

Epyc 7551? 256gb ddr4, r9700 + mi50. Running two models depending on what I’m doing . Llama.cpp + comfyUI or two llama.cpp for model and advisor in OMP. Main model is Qwen 27 abliterated

source
Sort:hotnewtop