NVIDIA RTX A6000
Released 2020 · Discrete GPU · multi-GPU capable
NVIDIA RTX A6000: 48 GB VRAM (GDDR6), 768 GB/s memory bandwidth, 155 FP16 TFLOPS, 300W TDP. See which LLMs fit, estimated tokens/sec and community benchmarks on slopsome.com.
Specifications
| VRAM | 48 GB GDDR6 |
|---|---|
| Memory bandwidth | 768 GB/s |
| FP16 compute | 155 TFLOPS |
| INT8 compute | 310 TOPS |
| TDP | 300 W |
| MSRP | $4650 |
| Typical used price | $3500 |