Comment on [AIT] what is your selfhosted local LLM stack?
wewbull@feddit.uk 2 weeks ago
- Pi - plain and simple - run inside firejail.
- lamma.cpp w/ vulkan backend
That’s it.
Comment on [AIT] what is your selfhosted local LLM stack?
wewbull@feddit.uk 2 weeks ago
That’s it.