Apple M4 Pro~7 tok/s (Q4)

mistralai/Mistral-Large-Instruct-2411 speed on Apple M4 Pro

Quantization-specific throughput and VRAM requirements for mistralai/Mistral-Large-Instruct-2411 running on Apple M4 Pro.

Speed Snapshot

Topline estimate from compatibility data

Modelmistralai/Mistral-Large-Instruct-2411

GPUApple M4 Pro

Q4 speed7 tok/s

Q4 VRAM required60GB

Data Source

Calculation and benchmark status

Speed values come from the compatibility dataset (`estimatedTokensPerSec`) and are sorted by quantization.

For full verdict logic and alternate GPUs, see the canonical compatibility page.

Quantization Speed Table

Quantization	VRAM needed	VRAM available	Speed	Verdict
Q4	60GB	64GB	7 tok/s	✅ Fits
Q8	120GB	64GB	5 tok/s	❌ Not recommended
FP16	240GB	64GB	3 tok/s	❌ Not recommended