NVIDIA A6000 vs NVIDIA L40

NVIDIA A6000 is $3,300.00 less expensive than NVIDIA L40, while offering comparable throughput.

NVIDIA A600048GB VRAM

ArchitectureAmpere

Cores10,752

TDP300W

Lowest price$4,899.00

NVIDIA L4048GB VRAM

ArchitectureAda Lovelace

Cores18,176

TDP300W

Lowest price$8,199.00

Winners

speedNVIDIA L4018,176 cores

valueNVIDIA A6000Lowest price $4,899.00

efficiencyNVIDIA A6000300W draw

vramNVIDIA A600048GB VRAM

Model	Quantization	NVIDIA A6000	NVIDIA L40
deepseek-ai/DeepSeek-OCR	Q4	180.00 tok/s	206.48 tok/s
bigcode/starcoder2-3b	Q4	174.39 tok/s	214.54 tok/s
google/gemma-2b	Q4	173.21 tok/s	209.54 tok/s
Qwen/Qwen2.5-3B	Q4	173.02 tok/s	214.34 tok/s
meta-llama/Llama-3.2-1B-Instruct	Q4	172.90 tok/s	184.18 tok/s