Comment on Researchers upend AI status quo by eliminating matrix multiplication in LLMs

bitfucker@programming.dev ⁨2⁩ ⁨years⁩ ago

• pennomi@lemmy.world ⁨2⁩ ⁨years⁩ ago

  Only for maximum efficiency. LLMs already run tolerably well on normal CPUs and this technique would make it much more efficient there as well.

  source