NVIDIA RTX A4000 16GB
Released 2021 · Discrete GPU · multi-GPU capable
NVIDIA RTX A4000 16GB: 16 GB VRAM (GDDR6), 448 GB/s memory bandwidth, 19 FP16 TFLOPS, 140W TDP. See which LLMs fit, estimated tokens/sec and community benchmarks on slopsome.com.
Specifications
| VRAM | 16 GB GDDR6 |
|---|---|
| Memory bandwidth | 448 GB/s |
| FP16 compute | 19 TFLOPS |
| INT8 compute | 38 TOPS |
| TDP | 140 W |
| MSRP | $1000 |
| Typical used price | $600 |