NVIDIA A6000 is $3,300.00 more expensive than RTX 4090, while offering comparable throughput.
| Spec | NVIDIA A6000 | RTX 4090 |
|---|---|---|
| VRAM | 48GB | 24GB |
| Cores | 10,752 | 16,384 |
| TDP | 300W | 450W |
| Architecture | Ampere | Ada Lovelace |
| Lowest price | $4,899.00 | $1,599.00 |
| Model | Quantization | NVIDIA A6000 | RTX 4090 |
|---|---|---|---|
| apple/OpenELM-1_1B-Instruct | Q4 | 174.68 tok/s | 222.41 tok/s |
| google/gemma-2b | Q4 | 174.56 tok/s | 206.11 tok/s |
| bigcode/starcoder2-3b | Q4 | 173.17 tok/s | 231.78 tok/s |
| deepseek-ai/DeepSeek-OCR | Q4 | 172.91 tok/s | 234.17 tok/s |
| context-labs/meta-llama-Llama-3.2-3B-Instruct-FP16 | Q4 | 170.69 tok/s | 204.34 tok/s |