Quantization-specific throughput and VRAM requirements for deepseek-ai/DeepSeek-Coder-V2-Instruct-0724 running on Apple M3 Max.
Speed values come from the compatibility dataset (`estimatedTokensPerSec`) and are sorted by quantization.
For full verdict logic and alternate GPUs, see the canonical compatibility page.
Open full compatibility report| Quantization | VRAM needed | VRAM available | Speed | Verdict |
|---|---|---|---|---|
| Q4 | 115GB | 128GB | 8 tok/s | ✅ Fits |
| Q8 | 231GB | 128GB | 6 tok/s | ❌ Not recommended |
| FP16 | 461GB | 128GB | 3 tok/s | ❌ Not recommended |