NVIDIA RTX 4090
Released 2022 · Discrete GPU · multi-GPU capable
NVIDIA RTX 4090: 24 GB VRAM (GDDR6X), 1008 GB/s memory bandwidth, 330 FP16 TFLOPS, 450W TDP. See which LLMs fit, estimated tokens/sec and community benchmarks on slopsome.com.
Specifications
| VRAM | 24 GB GDDR6X |
|---|---|
| Memory bandwidth | 1008 GB/s |
| FP16 compute | 330 TFLOPS |
| INT8 compute | 660 TOPS |
| TDP | 450 W |
| MSRP | $1599 |
| Typical used price | $1500 |