Comment on [AIT] what is your selfhosted local LLM stack?

surewhynotlem@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

Openwebui pointing to llamacpp running on an old ass GPU. It’s good enough for what it is.

source
Sort:hotnewtop