Comment on Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system— up to 9x increase in output lets 213 GPUs perform like 1,192

<- View Parent
BCOVertigo@lemmy.world ⁨5⁩ ⁨days⁩ ago

I mean if short term GPU supply is the bottleneck it will help that, but if it cooks the GPUs even faster and doesn’t result in less overall compute being done it just lets smaller players with less hardware compete with hyperscalers and may not actually be savings in the long term. The unit economics being negative are still the giant elephant in the room preparing to trample them.

source
Sort:hotnewtop