Comment on Experiences with using openclaw as a sex/roleplaying chatbot without GPU?
panda_abyss@lemmy.ca 3 days ago
I don’t have experience nor do I want to get into it, but openclaw is a very token heavy application and you can probably do a lot better performance wise.
The reason it takes so long for first message is the amount of prompt openclaw requires. It’s almost certainly overkill, and with low prompt processing it will spend most of its time reading memory and soul files and config info for all of its tools.
I think you could just install earandil pi, set a prompt, and add a memory plugin and this will be faster. This is what openclaw uses if you strip back all the extras.
Also look for mixture of experts, they’re far less GPU intensive, so you’ll get better mileage. No idea what models are out there, but like even an a3b or a4b will be slow but maybe usable.
Again, I do not want to get into what this use case lacks or doesn’t work for, that’s your business and I don’t want to get into it. I’m just saying openclaw is probably like driving a 12 ton Humvee to the grocery store.