Comment on Researchers upend AI status quo by eliminating matrix multiplication in LLMs
bitfucker@programming.dev 4 months ago
Good
Comment on Researchers upend AI status quo by eliminating matrix multiplication in LLMs
bitfucker@programming.dev 4 months ago
Good
pennomi@lemmy.world 4 months ago
Only for maximum efficiency. LLMs already run tolerably well on normal CPUs and this technique would make it much more efficient there as well.