NVIDIA RTX 6000 Ada is $1,000.00 less expensive than NVIDIA L40, while offering higher throughput.
| Spec | NVIDIA RTX 6000 Ada | NVIDIA L40 |
|---|---|---|
| VRAM | 48GB | 48GB |
| Cores | 18,176 | 18,176 |
| TDP | 300W | 300W |
| Architecture | Ada Lovelace | Ada Lovelace |
| Lowest price | $7,199.00 | $8,199.00 |
| Model | Quantization | NVIDIA RTX 6000 Ada | NVIDIA L40 |
|---|---|---|---|
| deepseek-ai/DeepSeek-OCR | Q4 | 244.96 tok/s | 197.59 tok/s |
| unsloth/gemma-3-1b-it | Q4 | 234.89 tok/s | 200.51 tok/s |
| google-bert/bert-base-uncased | Q4 | 234.09 tok/s | 183.05 tok/s |
| unsloth/Llama-3.2-3B-Instruct | Q4 | 232.31 tok/s | 192.11 tok/s |
| meta-llama/Llama-3.2-1B-Instruct | Q4 | 229.82 tok/s | 209.40 tok/s |