Comment on Is anyone self-hosting their own AI?
uzername@lemmy.world 4 days ago
24GB GPU Qwen 3.8 ( 2 variants ) Pangolin>OpenWebUI>lama.cpp for general use and available outside the homelab Zoo Code>OpenWebUI>lama.cpp for coding , mostly scripts and html
Qwen 3.8 was a game changer for me.
TheFinn@discuss.tchncs.de 3 days ago
What variants? And why two?
uzername@lemmy.world 2 days ago
For coding with large context: Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf Anything else: Qwen3.8-27B-GGUF:Q5_K_M