RTX 3080 is $400.00 less expensive than RTX 3090, while offering comparable throughput.
| Spec | RTX 3080 | RTX 3090 |
|---|---|---|
| VRAM | 10GB | 24GB |
| Cores | 8,704 | 10,496 |
| TDP | 320W | 350W |
| Architecture | Ampere | Ampere |
| Lowest price | $699.00 | $1,099.00 |
| Model | Quantization | RTX 3080 | RTX 3090 |
|---|---|---|---|
| google-bert/bert-base-uncased | Q4 | 165.90 tok/s | 184.49 tok/s |
| context-labs/meta-llama-Llama-3.2-3B-Instruct-FP16 | Q4 | 164.92 tok/s | 168.93 tok/s |
| meta-llama/Llama-3.2-3B-Instruct | Q4 | 164.59 tok/s | 167.42 tok/s |
| ibm-granite/granite-3.3-2b-instruct | Q4 | 162.95 tok/s | 196.55 tok/s |
| deepseek-ai/DeepSeek-OCR | Q4 | 162.84 tok/s | 209.15 tok/s |