Nvidia GeForce RTX 3060 12GB
The usual first card for local models. 12 GB holds a 14B model at 4-bit, CUDA runs everything, and it idles low. Watch for the 8 GB version, which has a narrower bus and less memory.
$340–400guide price, used
12GBmemory
360GB/smemory bandwidth
$45power a year at $0.18/kWh
What it runs
| 8B model, 4-bit | Fits on one card | |
|---|---|---|
| 14B model, 4-bit | Fits on one card | |
| 32B model, 4-bit | Needs two of them | |
| 70B model, 4-bit | Too big |
Speed for local models follows memory bandwidth more than anything else, as long as the model fits in memory.
Specs
| Memory | 12 GB, 360 GB/s |
|---|---|
| Power | 13 W idle, 170 W under load |
| Power leads | 1 × 8-pin PCIe |
| Size | 2 slots, full height |
| Cooling | Own fans |
| Video encoder | Nvidia NVENC (Turing-class) and AV1 decode |
Listings on eBay
Live eBay listings for this model will show here.
Guide prices are used asking prices on eBay US checked 15 November 2026. Prices for cards with lots of memory have risen quickly this year.