NVIDIA A6000 vs RTX 4090

NVIDIA A6000 is $3,300.00 more expensive than RTX 4090, while offering comparable throughput.

NVIDIA A600048GB VRAM

ArchitectureAmpere

Cores10,752

TDP300W

Lowest price$4,899.00

RTX 409024GB VRAM

ArchitectureAda Lovelace

Cores16,384

TDP450W

Lowest price$1,599.00

Winners

speedRTX 409016,384 cores

valueRTX 4090Lowest price $1,599.00

efficiencyNVIDIA A6000300W draw

vramNVIDIA A600048GB VRAM

Model	Quantization	NVIDIA A6000	RTX 4090
deepseek-ai/DeepSeek-OCR	Q4	180.00 tok/s	222.45 tok/s
bigcode/starcoder2-3b	Q4	174.39 tok/s	216.49 tok/s
google/gemma-2b	Q4	173.21 tok/s	228.89 tok/s
Qwen/Qwen2.5-3B	Q4	173.02 tok/s	234.27 tok/s
meta-llama/Llama-3.2-1B-Instruct	Q4	172.90 tok/s	217.03 tok/s