Comment on Megrez2: 21B latent, 7.5B on VRAM, 3B active—MoE on single 8GB card
LiveLM@lemmy.zip 4 weeks agoAwesome, thanks!
Comment on Megrez2: 21B latent, 7.5B on VRAM, 3B active—MoE on single 8GB card
LiveLM@lemmy.zip 4 weeks agoAwesome, thanks!