Comment on Megrez2: 21B latent, 7.5B on VRAM, 3B active—MoE on single 8GB card
LiveLM@lemmy.zip 1 week agoAwesome, thanks!
Comment on Megrez2: 21B latent, 7.5B on VRAM, 3B active—MoE on single 8GB card
LiveLM@lemmy.zip 1 week agoAwesome, thanks!