NVIDIA A6000 is $3,300.00 less expensive than NVIDIA L40, while offering comparable throughput.
| Spec | NVIDIA A6000 | NVIDIA L40 |
|---|---|---|
| VRAM | 48GB | 48GB |
| Cores | 10,752 | 18,176 |
| TDP | 300W | 300W |
| Architecture | Ampere | Ada Lovelace |
| Lowest price | $4,899.00 | $8,199.00 |
| Model | Quantization | NVIDIA A6000 | NVIDIA L40 |
|---|---|---|---|
| apple/OpenELM-1_1B-Instruct | Q4 | 174.68 tok/s | 214.24 tok/s |
| google/gemma-2b | Q4 | 174.56 tok/s | 179.85 tok/s |
| bigcode/starcoder2-3b | Q4 | 173.17 tok/s | 187.09 tok/s |
| deepseek-ai/DeepSeek-OCR | Q4 | 172.91 tok/s | 204.89 tok/s |
| context-labs/meta-llama-Llama-3.2-3B-Instruct-FP16 | Q4 | 170.69 tok/s | 189.25 tok/s |