StrawberryPigtails

@StrawberryPigtails@discuss.tchncs.de

• ⁨Comment⁩ on ⁨[AIT] what is your selfhosted local LLM stack?⁩ ⁨⁨5⁩ ⁨days⁩ ago⁩:

  My Hermes agent and OpenCode both can see the same Obsidian vault. I just started working with OpenCode and haven’t quite figured it out, however my Hermes agent has learned that everything I work on needs a file in Obsidian and that if it needs to look something up that it should look through Obsidian first. Prompts usually tell them to “look in the vault” or “write up what we’ve been doing in the vault, suitable for another agent to understand what is going on with no prior context”.

  It’s not currently all that reliable, but I’ve only been working with Hermes for a few months and started playing with OpenCode a few weeks ago. I need to work a bit more on orginization, though. Last time I looked in there, I backed out quickly as it was a god awful mess.

• ⁨Comment⁩ on ⁨[AIT] what is your selfhosted local LLM stack?⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  Currently, I’m using Hermes and OpenCode mostly, backed by Ollama running a couple of different models. Usually I’m running the Gemma4 or Gwen3.5 models.

  Memory management is done through Obsidian as every harness seems to have really good skills for it.

• ⁨Comment⁩ on ⁨[AIT] what is your selfhosted local LLM stack?⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  I think you’re thinking of the Llama family of llm models which are owned/made by Meta.

  Ollama is an open source server software and model repository for llm models. I won’t say Meta hasn’t contributed to the project, but as far as I know they don’t own it and didn’t start it.

• ⁨Comment⁩ on ⁨ISP won't set up static IP - Services keep going down⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  Not sure I understand. The VPN (Tailscale) is on the VPS.

  I have several very technically challenged family members that wanted to use a couple of the services that I host. Doing it this way simplifies the setup and the tech support calls. The VPS, or rather a domain name that leads to the VPS, is how they access those services.

  I have Tailscale setup on all my personal devices, so I generally just connect directly to the services.

• ⁨Comment⁩ on ⁨ISP won't set up static IP - Services keep going down⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  I solved it with a cheap VPS running Caddy as a reverse proxy and a Tailscale connection back to my home server.

  I think Tailscale has a service called Tailscale Serve which may work around a frequently changing ip as well. Not sure though as I haven’t looked into it much.

• ⁨Comment⁩ on ⁨What is your self hosted power draw?⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  Currently, 2 servers and 2 3d printers, I’m running just over 200w at idle. Depending on what my printers and servers are doing at any given moment, it could go up to 2000w, total, but I haven’t seen that high a power draw since I stopped contributing to Boinc projects about a year ago. I remember finding it mildly amusing that my graphics cards had a higher power draw then my printers.

• ⁨Comment⁩ on ⁨Found a self-hosting giveaway with free hardware and a bunch of license keys⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  Cool, but I don’t post on Reddit anymore.