labdeals

Nvidia GeForce RTX 3060 12GB

The usual first card for local models. 12 GB holds a 14B model at 4-bit, CUDA runs everything, and it idles low. Watch for the 8 GB version, which has a narrower bus and less memory.

$340–400guide price, used
12GBmemory
360GB/smemory bandwidth
$45power a year at $0.18/kWh

What it runs

8B model, 4-bitFits on one card
14B model, 4-bitFits on one card
32B model, 4-bitNeeds two of them
70B model, 4-bitToo big

Speed for local models follows memory bandwidth more than anything else, as long as the model fits in memory.

Specs

Memory12 GB, 360 GB/s
Power13 W idle, 170 W under load
Power leads1 × 8-pin PCIe
Size2 slots, full height
CoolingOwn fans
Video encoderNvidia NVENC (Turing-class) and AV1 decode

Listings on eBay

Live eBay listings for this model will show here.

Guide prices are used asking prices on eBay US checked 15 November 2026. Prices for cards with lots of memory have risen quickly this year.