Comment on [help] has anyone managed to run rocm on the deck?
Fubarberry@sopuli.xyz 3 weeks ago
I probably can’t help, I have ROCM acceleration working on my desktop linux PC, but I never had to install the massive rocm files for it to work.
What specifically are you trying to run using ROCM?
brokenlcd@feddit.it 3 weeks ago
I’m mostly trying to run text-generation-webui for fun; what did you install to run image generation if you never installed the rocm binaries? Hopefully i should be able to replicate it in a container
Fubarberry@sopuli.xyz 3 weeks ago
Pytorch includes the necessary ROCm files for image gen as far as I know. My computer does have an /opt/ROCm folder but it’s only a few megabytes in size.
Unfortunately I don’t see any mention of pytorch in your linked program, and it does mention a proper ROCm install as a requirement there.
brokenlcd@feddit.it 3 weeks ago
If that’s the case i’m going to try to run it without installing rocm, since i saw a pytorch rocm package being downloaded by pip. I’m gonna need to reinstall though.
Fubarberry@sopuli.xyz 3 weeks ago
There are different pytorch install commands for cuda/ROCm. Usually the key to getting ROCm to work with AI GitHub projects is to edit a config file/launch option and replace the pytorch command with a ROCm one