Comment on Is anyone self-hosting their own AI?
ShadowZone@lemmy.world 3 days agoI used Cline as my VSCode chat plugin for models in LMStudio. Worked pretty well but I have moved my local LLM stack to Hermes in the meantime.
Comment on Is anyone self-hosting their own AI?
ShadowZone@lemmy.world 3 days agoI used Cline as my VSCode chat plugin for models in LMStudio. Worked pretty well but I have moved my local LLM stack to Hermes in the meantime.
JasonDJ@lemmy.zip 3 days ago
I tried using zoo with qwen3.6 and 2.5 but it failed horrendously. My card could only handle like a 16k context window with those models, and the prompt alone was like 11k.
Tried opencode and that was fast…but can’t get it to interact with system yet. More playing to do.