Minimum VRAM
16GB
FP16 (full model) • Q4 option ≈ 4GB
Best Performance
AMD Instinct MI300X
~295 tok/s • FP16
Most Affordable
RX 7900 XTX
Q8 • ~109 tok/s • From $899
Full-model (FP16) requirements are shown by default. Quantized builds like Q4 trade accuracy for lower VRAM usage.
Filter by quantization, price, and VRAM to compare performance estimates.
Showing FP16 compatibility. Switch tabs to explore other quantizations.
| GPU | Speed | VRAM Requirement | Typical price |
|---|---|---|---|
RTX 4090Estimated NVIDIA | No data for FP16 | Requirement pending24GB total on card | $1,599View GPU → |
NVIDIA RTX 6000 AdaEstimated NVIDIA | No data for FP16 | Requirement pending48GB total on card | $7,199View GPU → |
RTX 3090Estimated NVIDIA | No data for FP16 | Requirement pending24GB total on card | $1,099View GPU → |
NVIDIA L40Estimated NVIDIA | No data for FP16 | Requirement pending48GB total on card | $8,199View GPU → |
NVIDIA A6000Estimated NVIDIA | No data for FP16 | Requirement pending48GB total on card | $4,899View GPU → |
RX 7900 XTXEstimated AMD | No data for FP16 | Requirement pending24GB total on card | $899View GPU → |
RX 7900 XTEstimated AMD | No data for FP16 | Requirement pending20GB total on card | $899View GPU → |
NVIDIA A5000Estimated NVIDIA | No data for FP16 | Requirement pending24GB total on card | $2,499View GPU → |
RTX 3080Estimated NVIDIA | No data for FP16 | Requirement pending10GB total on card | $699View GPU → |
RTX 4080Estimated NVIDIA | No data for FP16 | Requirement pending16GB total on card | $1,199View GPU → |
Apple M2 UltraEstimated Apple | No data for FP16 | Requirement pending192GB total on card | $5,999View GPU → |
RTX 4070 TiEstimated NVIDIA | No data for FP16 | Requirement pending12GB total on card | $799View GPU → |
Hardware requirements and model sizes at a glance.
| Component | Minimum | Recommended | Optimal |
|---|---|---|---|
| VRAM | 4GB (Q4) | 8GB (Q8) | 16GB (FP16) |
| RAM | 32GB | 64GB | 64GB |
| Disk | 50GB | 100GB | - |
| Model size | 4GB (Q4) | 8GB (Q8) | 16GB (FP16) |
| CPU | Modern CPU (Ryzen 5/Intel i5 or better) | Modern CPU (Ryzen 5/Intel i5 or better) | Modern CPU (Ryzen 5/Intel i5 or better) |
Note: Performance estimates are calculated. Real results may vary. Methodology · Submit real data
Common questions about running zai-org/GLM-OCR locally
This model delivers strong local performance when paired with modern GPUs. Use the hardware guidance below to choose the right quantization tier for your build.
Use runtimes like llama.cpp, text-generation-webui, or vLLM. Download the quantized weights from Hugging Face, ensure you have enough VRAM for your target quantization, and launch with GPU acceleration (CUDA/ROCm/Metal).
Start with Q4 for wide GPU compatibility. Upgrade to Q8 if you have spare VRAM and want extra quality. FP16 delivers the highest fidelity but demands workstation or multi-GPU setups.
Q4_K_M and Q5_K_M are GGUF quantization formats that balance quality and VRAM usage. Q4_K_M uses ~4GB VRAM with good quality retention. Q5_K_M uses slightly more VRAM but preserves more model accuracy. Q8 (~8GB) offers near-FP16 quality. Standard Q4 is the most memory-efficient option for zai-org/GLM-OCR.
Official weights are available via Hugging Face. Quantized builds (Q4, Q8) can be loaded into runtimes like llama.cpp, text-generation-webui, or vLLM. Always verify the publisher before downloading.
Explore other AI models developed by zai-org.
See how zai-org/GLM-OCR compares to other popular models.