uzername

@uzername@lemmy.world

This is a remote user, information on this page may be incomplete. View at Source ↗

⁨Comment⁩ on ⁨Is anyone self-hosting their own AI?⁩ ⁨⁨3⁩ ⁨days⁩ ago⁩:
For coding with large context: Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf Anything else: Qwen3.8-27B-GGUF:Q5_K_M
⁨Comment⁩ on ⁨Is anyone self-hosting their own AI?⁩ ⁨⁨4⁩ ⁨days⁩ ago⁩:
24GB GPU Qwen 3.8 ( 2 variants ) Pangolin>OpenWebUI>lama.cpp for general use and available outside the homelab Zoo Code>OpenWebUI>lama.cpp for coding , mostly scripts and html

Qwen 3.8 was a game changer for me.