NormDeplume

@NormDeplume@lemmy.world

• ⁨Comment⁩ on ⁨[AIT] what is your selfhosted local LLM stack?⁩ ⁨⁨1⁩ ⁨day⁩ ago⁩:

  Mind elaborating how you route them through obsidian?

• ⁨Comment⁩ on ⁨What else should I do for my home server security?⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  This is an elegant and brilliant idea and I love it. Finding a way to formalize a baseline and then get notified for deviations from that baseline is a fundamental requirement for having things running smoothly.

• ⁨Comment⁩ on ⁨Finally escaping Windows, ironically thanks to AI⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  That article is dated, and a lot of the new improvements specifically offset a lot of the claims being made there which just looking at the tone seem to be more of a hit piece on ollama then an objective look to compare. While llama.cpp does have some minor benefits, a lot of the testing I’ve seen and done shows that they are minimal.

  For me at least olama is easy to use, simple to set up, and gets the job done. Other tools that’s fine, but as I said, I’ve been using it with no issue for a while now, and when I’ve looked at switching it just doesn’t make any sense.

• ⁨Comment⁩ on ⁨Finally escaping Windows, ironically thanks to AI⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  I’ve had zero issues with ollama, and every day I get closer to no longer using the frontier models.