Comment on Experiences with using openclaw as a sex/roleplaying chatbot without GPU?
tal@lemmy.today 5 days ago
I’ve already got a 128GB Framework Desktop for AI compute stuff, but if I didn’t…
In 2028, I expect memory prices to start coming down.
The GPU hardware itself isn’t really the limiting factor, but rather available memory.
I just don’t think that I’d be willing to put in massive amounts of effort trying to work around hardware limitations (or spend a bunch of money, which is the other route, outbidding people for the limited supply of memory) to get an AI compute setup going in 2026 or 2027 when the situation should change substantially in the not-so-distant future.
Specifically on generating literary erotica, my own experience is that quality is substantially better with larger models. I’ve read that MoE models, like Qwen, are not very good at it, and my limited experimentation with Qwen supports that, though I haven’t tried to aggressively track the latest versions.
If you look at this thread:
reddit.com/…/qwen_38_27b_is_the_next_stepping_sto…
…while the OP in that thread is talking about using Qwen 3.6 for ERP, other users are not generally all that enthusiastic about Qwen 3.6.
In general, I think that /r/SillyTavernAI favors TheDrummer’s models—which are not merely abliterated base models, but ERP-oriented finetunes—for ERP.