Nvidia Tesla P40 24GB
24 GB for the price of a mid-range gaming card, which is why everyone bought them. It's slow at FP16, so stick to llama.cpp. Passive, needs an 8-pin EPS lead and a fan, and Nvidia's 580 drivers are its last.
$350–450guide price, used
24GBmemory
346GB/smemory bandwidth
$54power a year at $0.18/kWh
What it runs
| 8B model, 4-bit | Fits on one card | |
|---|---|---|
| 14B model, 4-bit | Fits on one card | |
| 32B model, 4-bit | Fits on one card | |
| 70B model, 4-bit | Needs two of them |
Speed for local models follows memory bandwidth more than anything else, as long as the model fits in memory.
Specs
| Memory | 24 GB, 346 GB/s |
|---|---|
| Power | 10 W idle, 250 W under load |
| Power leads | 1 × 8-pin EPS (CPU) lead |
| Size | 2 slots, full height |
| Cooling | Passive: needs airflow from the case |
| Video encoder | Nvidia NVENC (Pascal): H.264, HEVC |
Listings on eBay
Live eBay listings for this model will show here.
Guide prices are used asking prices on eBay US checked 15 November 2026. Prices for cards with lots of memory have risen quickly this year.