Nvidia Tesla P4
8 GB, 75 W, low profile, passively cooled. It fits an SFF box and runs 7B and 8B models, but it needs a fan blowing through it or it throttles and shuts down. Pascal, so no new CUDA releases.
$90–150guide price, used
8GBmemory
192GB/smemory bandwidth
$22power a year at $0.18/kWh
What it runs
| 8B model, 4-bit | Fits on one card | |
|---|---|---|
| 14B model, 4-bit | Needs two of them | |
| 32B model, 4-bit | Too big | |
| 70B model, 4-bit | Too big |
For Plex or Jellyfin: Nvidia NVENC (Pascal): H.264, HEVC.
Speed for local models follows memory bandwidth more than anything else, as long as the model fits in memory.
Specs
| Memory | 8 GB, 192 GB/s |
|---|---|
| Power | 7 W idle, 75 W under load |
| Power leads | None, runs on slot power |
| Size | 1 slot, low-profile version |
| Cooling | Passive: needs airflow from the case |
| Video encoder | Nvidia NVENC (Pascal): H.264, HEVC |
Listings on eBay
Live eBay listings for this model will show here.
Guide prices are used asking prices on eBay US checked 15 November 2026. Prices for cards with lots of memory have risen quickly this year.