melfie

@melfie@lemmy.zip

• ⁨Comment⁩ on ⁨Is anyone self-hosting their own AI?⁩ ⁨⁨3⁩ ⁨days⁩ ago⁩:

  I have nearly the same setup, except OpenCode for the harness. I run 200k context for anything that doesn’t need vision, or 150k otherwise. Typically get about 30 t/s decode, starts at close to 800 t/s for prefill and drops to the 200s for a long context. I’d imagine huger decode speeds are possible with some tinkering, but I haven’t gotten around to it.

• ⁨Comment⁩ on ⁨Recommendations for self hosted recipe manager⁩ ⁨⁨2⁩ ⁨weeks⁩ ago⁩:

  Mealie isn’t bad, but the UI makes it a huge pain to enter recipes. Luckily, the web import often works well, but some websites don’t support the JSON recipe format it requires. I recently setup llama.cpp on my server for the “AI import” feature that closes the gap well enough.

• ⁨Comment⁩ on ⁨Valve is so behind on Steam Controller orders that some won’t ship until 2027⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  I have a Steam Deck and am not sure what the hype is about with the Steam controller. On my SD, the track pads don’t really work that well (mainly use them in desktop mode as a mouse), and $50 Xbox controllers otherwise seem equivalent, except at half the price with support for Linux distros other than SteamOS. Am I overlooking something critical?