Comment on [AIT] what is your selfhosted local LLM stack?

surewhynotlem@lemmy.world ⁨1⁩ ⁨week⁩ ago

Openwebui pointing to llamacpp running on an old ass GPU. It’s good enough for what it is.

source
Sort:hotnewtop