What runs with 24 GB of VRAM
Every model in the registry that fits at 24 GB, the GPUs that ship with exactly this much VRAM, and where to go if you need more.
What runs here
Llama 3.1 8B
FP16Fits comfortably
DeepSeek-R1-Distill-Qwen-32BQ4_K_MTight — reduced context
Qwen3 32BQ4_K_MTight — reduced context
Gemma 3 27BQ5_K_MTight — reduced context
Mistral Small 3Q5_K_MFits comfortably
Phi-4Q8_0Fits comfortably
FLUX.1 [dev]fullFits comfortably
Stable Diffusion XLfullFits comfortably
GPUs delivering this tier
RTX 4090RX 7900 XTX
Upgrade path
Stepping up to 32 GB typically unlocks a higher-quality quant of the same models, longer context windows, or the next parameter-count class up entirely.