RTX 4070 Ti is $300.00 less expensive than RTX 3090, while offering comparable throughput.
| Spec | RTX 4070 Ti | RTX 3090 |
|---|---|---|
| VRAM | 12GB | 24GB |
| Cores | 7,680 | 10,496 |
| TDP | 285W | 350W |
| Architecture | Ada Lovelace | Ampere |
| Lowest price | $799.00 | $1,099.00 |
| Model | Quantization | RTX 4070 Ti | RTX 3090 |
|---|---|---|---|
| google/gemma-2b | Q4 | 116.83 tok/s | 185.33 tok/s |
| unsloth/Llama-3.2-3B-Instruct | Q4 | 116.79 tok/s | 178.80 tok/s |
| tencent/HunyuanOCR | Q4 | 115.40 tok/s | 196.73 tok/s |
| deepseek-ai/DeepSeek-OCR | Q4 | 115.07 tok/s | 209.15 tok/s |
| meta-llama/Llama-3.2-1B-Instruct | Q4 | 114.97 tok/s | 191.64 tok/s |