Comment on Is anyone self-hosting their own AI?
trougnouf@lemmy.world 2 days agoI get about 45 t/s after some tweaking, getting the thermals under control helped a lot; mainly by reducing the power consumption to 261 W (and downclocking a little bit)