Comment on Megrez2: 21B latent, 7.5B on VRAM, 3B active—MoE on single 8GB card

<- View Parent
LiveLM@lemmy.zip ⁨4⁩ ⁨weeks⁩ ago

Awesome, thanks!

source
Sort:hotnewtop