chaospatterns

@chaospatterns@lemmy.world

• ⁨Comment⁩ on ⁨recommendations for selfhosted trips?⁩ ⁨⁨4⁩ ⁨hours⁩ ago⁩:

  For my trips I use Trek, AirTrail, and Dawarich.

  I picked Trek because it was most similar to Wanderlog which is what I used to use and it supported SSO. It seems to have a strong community and feature delivery, though my challenges with it is that it feels slow to load and its somewhat complicated to navigate.

  Then AirTrail to track flights and see a cool display of everywhere I’ve flown and Dawarich shows my location history. Trek can then pull in my Dawarich and AirTrail history.

• ⁨Comment⁩ on ⁨Is anyone self-hosting their own AI?⁩ ⁨⁨4⁩ ⁨weeks⁩ ago⁩:

  Yes, I run Ollama on a NVIDIA 1080 Ti at home. I run granite4:3b for my Home Assistant assistant for my voice assistant, paperless-ngx, OpenWebUI for chat, and a few other things. For speech to text, I run a custom-built hybrid speech-to-phrase + parakeetTTS (requests that match speech-to-phrase take priority over parakeet.) I run GOModel to route requests to my local Ollama instance, or DeepInfra (cloud-based for larger models), or Tinfoil (cloud-based for encrypted LLM chats.)

  As much as I love to use local-everything, only my smarthome+basic chats go local. Trying to fit both the STT and LLM models on the same GPU at the same time while also using this computer as a media console is challenging. I’ve recently started looking at the Hailo m.2 accelerator board to see if I can shift the STT to it.