NVIDIA Tesla P40 24GB

Released 2016 · Discrete GPU · multi-GPU capable

NVIDIA Tesla P40 24GB: 24 GB VRAM (GDDR5), 347 GB/s memory bandwidth, 12 FP16 TFLOPS, 250W TDP. See which LLMs fit, estimated tokens/sec and community benchmarks on slopsome.com.

Specifications

VRAM24 GB GDDR5
Memory bandwidth347 GB/s
FP16 compute12 TFLOPS
INT8 compute47 TOPS
TDP250 W
MSRP$5700
Typical used price$300