What can I run with 24 GB of VRAM?

8 models in our registry fit at 24 GB, at quantizations ranging from Q4 up depending on the model. See the table below for the exact quant and verdict per model.

Which GPUs come with 24 GB of VRAM?

RTX 4090, RX 7900 XTX ship with 24 GB of VRAM in our reference list.

What runs with 24 GB of VRAM

Every model in the registry that fits at 24 GB, the GPUs that ship with exactly this much VRAM, and where to go if you need more.

What runs here

Llama 3.1 8B

FP16Fits comfortably

DeepSeek-R1-Distill-Qwen-32B

Q4_K_MTight — reduced context

Qwen3 32B

Q4_K_MTight — reduced context

Gemma 3 27B

Q5_K_MTight — reduced context

Mistral Small 3

Q5_K_MFits comfortably

GPUs delivering this tier

RTX 4090RX 7900 XTX

Browse AI-scored prebuilts →Open in Builder

Upgrade path

Stepping up to 32 GB typically unlocks a higher-quality quant of the same models, longer context windows, or the next parameter-count class up entirely.

← Back to AI hub How the fit math works →