Comment on [AIT] what is your selfhosted local LLM stack?

riskable@programming.dev ⁨5⁩ ⁨hours⁩ ago

The anti-AI sentiment here is ridiculous. They were asking a legitimate question!

I just use ollama locally but I keep meaning to setup OpenRouter because I like to play with larger models that my hardware can’t handle and I’d like to be able to pick the best deals 🤷‍♀️

source
Sort:hotnewtop