I’ve had zero issues with ollama, and every day I get closer to no longer using the frontier models.
Comment on Finally escaping Windows, ironically thanks to AI
hexagonwin@lemmy.today 1 week ago(i personally haven’t ever used llms personally but) i’ve heard many negative things about ollama from the localllama comm, may be worth searching before using it
NormDeplume@lemmy.world 1 week ago
hexagonwin@lemmy.today 1 week ago
NormDeplume@lemmy.world 1 week ago
That article is dated, and a lot of the new improvements specifically offset a lot of the claims being made there which just looking at the tone seem to be more of a hit piece on ollama then an objective look to compare. While llama.cpp does have some minor benefits, a lot of the testing I’ve seen and done shows that they are minimal.
For me at least olama is easy to use, simple to set up, and gets the job done. Other tools that’s fine, but as I said, I’ve been using it with no issue for a while now, and when I’ve looked at switching it just doesn’t make any sense.
hexagonwin@lemmy.today 1 week ago
i see. thanks for replying
Seralth@piefed.seralth.com 1 week ago
Ollama I find is just a waste of existence. It endlessly seems worse then any other option
AgentSeven@lemmy.zip 1 week ago
Yes, well, my use for Ollama is solely as a plugin for Home Assistant. But you can wrap llama.cpp with whatever you want or use the half-dozen semi-popular competitors! My point is just that there are no tools that are exclusive to Windows, they’re all on Linux.