NVIDIA A6000 is $2,300.00 less expensive than NVIDIA RTX 6000 Ada, while offering comparable throughput.
| Spec | NVIDIA A6000 | NVIDIA RTX 6000 Ada |
|---|---|---|
| VRAM | 48GB | 48GB |
| Cores | 10,752 | 18,176 |
| TDP | 300W | 300W |
| Architecture | Ampere | Ada Lovelace |
| Lowest price | $4,899.00 | $7,199.00 |
| Model | Quantization | NVIDIA A6000 | NVIDIA RTX 6000 Ada |
|---|---|---|---|
| apple/OpenELM-1_1B-Instruct | Q4 | 174.68 tok/s | 216.79 tok/s |
| google/gemma-2b | Q4 | 174.56 tok/s | 217.30 tok/s |
| bigcode/starcoder2-3b | Q4 | 173.17 tok/s | 194.48 tok/s |
| deepseek-ai/DeepSeek-OCR | Q4 | 172.91 tok/s | 220.28 tok/s |
| context-labs/meta-llama-Llama-3.2-3B-Instruct-FP16 | Q4 | 170.69 tok/s | 193.15 tok/s |