NVIDIA RTX 3090
Released 2020 · Discrete GPU · multi-GPU capable
NVIDIA RTX 3090: 24 GB VRAM (GDDR6X), 936 GB/s memory bandwidth, 142 FP16 TFLOPS, 350W TDP. See which LLMs fit, estimated tokens/sec and community benchmarks on slopsome.com.
Specifications
| VRAM | 24 GB GDDR6X |
|---|---|
| Memory bandwidth | 936 GB/s |
| FP16 compute | 142 TFLOPS |
| INT8 compute | 284 TOPS |
| TDP | 350 W |
| MSRP | $1499 |
| Typical used price | $700 |