NVIDIA RTX A5000 24GB

Released 2021 · Discrete GPU · multi-GPU capable

NVIDIA RTX A5000 24GB: 24 GB VRAM (GDDR6), 768 GB/s memory bandwidth, 27 FP16 TFLOPS, 230W TDP. See which LLMs fit, estimated tokens/sec and community benchmarks on slopsome.com.

Specifications

VRAM24 GB GDDR6
Memory bandwidth768 GB/s
FP16 compute27 TFLOPS
INT8 compute54 TOPS
TDP230 W
MSRP$2250
Typical used price$1300