AMD Radeon RX 7900 XTX
24 GB with close to 3090 bandwidth, and new enough for ROCm. llama.cpp and Ollama run well on it. 355 W, three slots, two 8-pin leads.
$1,120–1,310guide price, used
24GBmemory
960GB/smemory bandwidth
$77power a year at $0.18/kWh
What it runs
| 8B model, 4-bit | Fits on one card | |
|---|---|---|
| 14B model, 4-bit | Fits on one card | |
| 32B model, 4-bit | Fits on one card | |
| 70B model, 4-bit | Needs two of them |
Speed for local models follows memory bandwidth more than anything else, as long as the model fits in memory.
Specs
| Memory | 24 GB, 960 GB/s |
|---|---|
| Power | 15 W idle, 355 W under load |
| Power leads | 2 × 8-pin PCIe |
| Size | 3 slots, full height |
| Cooling | Own fans |
| Video encoder | AMD VCN 4: AV1 encode |
Listings on eBay
Live eBay listings for this model will show here.
Guide prices are used asking prices on eBay US checked 15 November 2026. Prices for cards with lots of memory have risen quickly this year.