Nvidia Tesla T4
16 GB, 70 W, single-slot, low profile, passive. Turing, so current CUDA still supports it. Needs forced airflow outside a server, and used prices are high.
$700–1,000guide price, used
16GBmemory
320GB/smemory bandwidth
$25power a year at $0.18/kWh
What it runs
| 8B model, 4-bit | Fits on one card | |
|---|---|---|
| 14B model, 4-bit | Fits on one card | |
| 32B model, 4-bit | Needs two of them | |
| 70B model, 4-bit | Too big |
Speed for local models follows memory bandwidth more than anything else, as long as the model fits in memory.
Specs
| Memory | 16 GB, 320 GB/s |
|---|---|
| Power | 10 W idle, 70 W under load |
| Power leads | None, runs on slot power |
| Size | 1 slot, low-profile version |
| Cooling | Passive: needs airflow from the case |
| Video encoder | Nvidia NVENC (Turing): H.264, HEVC, better quality |
Listings on eBay
Live eBay listings for this model will show here.
Guide prices are used asking prices on eBay US checked 15 November 2026. Prices for cards with lots of memory have risen quickly this year.