Q41GB VRAM minimum

google-bert/bert-base-uncased Q4 VRAM Requirements

This page answers google-bert/bert-base-uncased q4 quantization queries with explicit calculations from our model requirement dataset and compatibility speed table.

Requirement Snapshot

Current quantization-specific requirement breakdown

Selected quantizationQ4

Minimum VRAM1GB

Q4 baseline1GB

Q8 baseline1GB

FP16 baseline1GB

Methodology

No hand-wavy numbers

Exact Q4 requirement from model requirement data.

Throughput data below uses available compatibility measurements/estimates and is sorted by tokens per second for this model.

Need general guidance? Review full methodology.

Best GPUs for google-bert/bert-base-uncased (Q4)

GPU	VRAM	Quantization	Speed	Compatibility
AMD Instinct MI300X	192GB	Q4	974 tok/s	View full compatibility
NVIDIA H200 SXM 141GB	141GB	Q4	779 tok/s	View full compatibility
NVIDIA H100 SXM5 80GB	80GB	Q4	652 tok/s	View full compatibility
AMD Instinct MI250X	128GB	Q4	600 tok/s	View full compatibility
RTX 5090	32GB	Q4	394 tok/s	View full compatibility
NVIDIA H100 PCIe 80GB	80GB	Q4	341 tok/s	View full compatibility
NVIDIA A100 80GB SXM4	80GB	Q4	328 tok/s	View full compatibility
NVIDIA A100 40GB PCIe	40GB	Q4	292 tok/s	View full compatibility
AMD Instinct MI210	64GB	Q4	276 tok/s	View full compatibility
NVIDIA RTX 6000 Ada	48GB	Q4	234 tok/s	View full compatibility
RTX 4090	24GB	Q4	223 tok/s	View full compatibility
NVIDIA L40S	48GB	Q4	212 tok/s	View full compatibility

Back to google-bert/bert-base-uncased model page Full hardware requirements