Comment on Is anyone self-hosting their own AI?

<- View Parent
JasonDJ@lemmy.zip ⁨3⁩ ⁨days⁩ ago

I tried using zoo with qwen3.6 and 2.5 but it failed horrendously. My card could only handle like a 16k context window with those models, and the prompt alone was like 11k.

Tried opencode and that was fast…but can’t get it to interact with system yet. More playing to do.

source
Sort:hotnewtop