hoshikarakitaridia
@hoshikarakitaridia@lemmy.world
- Comment on Is anyone self-hosting their own AI? 4 days ago:
That’s a pretty good way to describe those kinds of models. Somewhere between rubber duck debugging and a really lazy intern. Better than an algorithm, faster than a human, but less trustworthy than an intern. It’s great if you know how and when to use it. Maybe it’ll become an intern soon enough, but for now let’s focus on decompiling adobe into bankruptcy.
- Comment on Is anyone self-hosting their own AI? 4 days ago:
Yeah running in the background type beat. Not gonna trust this with anything important but it’s great to have someone just do shit for you or get a second opinion.
- Comment on Is anyone self-hosting their own AI? 4 days ago:
That’s gonna be quick af with the same models.
- Comment on Is anyone self-hosting their own AI? 4 days ago:
Oh damn what a useful link. Gonna check out those orchestrators, maybe I can replace my janky ass proxy.
- Comment on Is anyone self-hosting their own AI? 4 days ago:
MCP is a really dumb server that just takes requests and sends back data.
Somewhere in your frontend settings (Open-WebUI has it under “integrations” I believe, some backends can set these things too) you see a section called “MCP server”. You need to keep your MCP server running somewhere (it’s very slim, so not a huge deal usually) and then in those settings you put your IP and port for the server, for example “192.168.1.15:8080”. Usually if you did it right (sometimes you can check if it works in the settings), you can ask the model if it has access to the tools and it will tell you.
What’s happening in the background is that every conversation the AI does, it gets a short preamble with some context about what it can do, and if you connect web search, custom skills or an MCP server (it’s just skills but they are run through their own server basically), the AI sees all that in this preamble if it’s set up correctly. And then when it feels like it needs to use those tools, it will check the description on how to do that, and then it uses them.
- Comment on Is anyone self-hosting their own AI? 4 days ago:
1070ti and some hexacore something cpu that’s alright with around 24gb ddr4, I think one of the slower speeds. I also got a faster PC with another llama.cpp instance and I vibe coded a quick and dirty proxy which I can use to switch between the different backends. It’s genuinely useful because I got code editors but also my Open-WebUI using it.
Sounds elaborate but generally it’s all pretty primitive.
- Comment on Is anyone self-hosting their own AI? 4 days ago:
- Qwen3.6 35b a3b Q4_K_M running on llama.cpp
- Open-WebUI as a frontend
- integrations with an embedding model and searxng & crawl4ai
- doing lots of different stuff with it, asking basic stupid questions, recipes, tech stuff, etc
- Comment on My Grafana dashboard for monitoring my self hosted cluster. 1 week ago:
every win should be celebrated
Yeah we could have some more of that here on Lemmy because people tend to be quite negative.
Honestly that’s awesome, I didn’t manage to get grafana working when I tried exactly this, I’ll definitely check out any guides you used ^^
- Comment on Trump dirties up 8-bit classics with cringe revamp 1 month ago:
Please be the onion Please be the onion Please be the onion Please be the onion Please be the onion Please be the onion Please be the onion
- Comment on Nexus Mods acquires the popular community site SteamDB 1 month ago:
I never heard someone else say this but man I have a very strong dislike for nexus mods. Their website has gotten so predatory.
- Comment on Cyberpunk 2077 launched when it did because its devs wanted it "out the door" says CD Projekt Red CEO, but I wonder if he forgot about that reported mandatory crunch 1 month ago:
I believe him it was a lot more complex than just investors pushing him to get it out quickly. I don’t believe the team was part of that push. Either he doesn’t understand the developers or he is lying but I have a suspicion it’s gotta be at most a few team members who were burnt out and not a consensus. I cannot imagine the consensus was to crunch in order to get the game out faster - no way.
- Comment on Ron Gilbert talks the untraditional way he got Thimbleweed Park 2 funded, and his frustrations with modern publishing deals 2 months ago:
Funding by sugar daddy is one hell of a strategy
- Comment on Epic Games CEO says it’s ‘really irresponsible’ of Steam to make studios disclose AI use | VGC 3 months ago:
Let’s get back to that Scarlet letter though.
If you think AI is awesome, what’s the issue with disclosing it? Is because you’re scared people will disagree with your ethical choices?
Such a self own. It should be anyone’s interest to disclose if something has AI in it or nah, no matter whether you like or dislike AI.
- Comment on GOG apologizes for emailing people Nazi symbols 4 months ago:
Oh no
The second comment from the devs is telling - sounds like they sent the message and then GOG just appended some emojis to it, and the devs were unaware.
Now ofc that’s from the devs directly, but considering it’s so oddly specific, it’s hard to imagine they made that up.
- Comment on Amidst ongoing legal proceedings, Rockstar devs have publicly formed a union with the IWGB 4 months ago:
Rockstar always chooses the most unique ways of marketing their games.
- having assets leaked
- pushing back the release date
- pushing back the release date
- having code leaked
- pushing back the release date
- firing a bunch of employees
- union-busting
- Comment on Steam, Minecraft, Roblox and Fortnite risk "becoming onramps to abuse, extremist violence, radicalisation or lifelong harm", claim Australian government 5 months ago:
Dude what
We just found a sex trafficking pedophile ring with ties to the white house, Russia, UAE, UK and many more country leaders and you are concerned about Steam? Fuck you, you’re part of the problem.
- Comment on US operating system age verification bill "Parents Decide Act" gets published 5 months ago:
Ok that means there’s a chance this doesn’t get passed. I hope it doesn’t, this bill is stupid and dangerous in an insidious way.
- Comment on US operating system age verification bill "Parents Decide Act" gets published 5 months ago:
Yeah what is this shit
There currently exists no solution I am aware of that is enforceable enough and privacy preserving for age verification.
We are banking on this being non-enforceable. Great. Why are we doing this again? Fuck the people who wrote this bill and those who voted for it.
- Comment on "There is a new narrative from haters," Off the Grid studio boss says of accusations Gunzilla haven't paid workers on time, claims full-timers' salaries "have never been delayed by more than a week" 6 months ago:
Yeah not great, and confirmed now I guess
- Comment on [TheGamer] Jeff Kaplan Left Blizzard Over Layoff Threats, Unrealistic Overwatch League Targets 7 months ago:
If that’s true I feel bad for jeff
- Comment on Microsoft patents system for AI helpers to finish games for you 7 months ago:
No, let them figure it out. Let’s encourage them to hand over the console win to steam deck.
- Comment on Valve wins lawsuit against Rothschild and associated entities, with a jury agreeing they violated an anti-patent troll protection act 7 months ago:
Steam stomping trolls since Skyrim days
- Comment on Firefox dev clarifies there will be an AI 'kill switch' 9 months ago:
Yeah I’m not touching Firefox. Will stick to Librewolf.
- Comment on Framework greatly expand their open source event and Linux distribution sponsorships 10 months ago:
Actually a great os.
- Comment on Russia bans Roblox, with state censor accusing it of spreading "LGBT propaganda" and "justifying terrorism" 10 months ago:
He a little confused but he got the spirit
- Comment on EA says 98% of Battlefield 6 matches have been cheater free thanks to tough security 10 months ago:
Can we not just dunk on random people who are just enjoying themselves? I don’t like secure boot either for a plethora of reasons but yucking someone’s yum is peak reddit behavior.
- Comment on Krafton CEO admits he did consult ChatGPT about the Subnautica 2 situation, and says he deleted the logs over confidentiality concerns 10 months ago:
Tbh the lying is way worse
- Comment on Fans’ reverse-engineered servers for Sony’s defunct Concord might be in trouble 11 months ago:
Bold move. Let’s forward these curious events to accursedfarms and see how it plays out.
- Comment on Call of Duty: Black Ops 7's launch day patch notes are basically gun speed dating, and its endgame is a big fight in map soup 11 months ago:
Jesus Christ they are scrambling
- Comment on Nexus Mods app adds new context menus, Stardew Valley FOMOD support, and work towards Bethesda games 11 months ago:
Literally building a private stardew valley modpack rn and I hate Nexus mods so much. They make pay for everything, you can only download things with an account, collections are a pain in the ass, exporting mods is impossible, you can only export mod lists, …