Can I run gpt-oss-20b on an RTX 4080 SUPER (16GB)?
Computed with the open FitLLM engine — accurate per-layer KV-cache modeling, not a naive estimate. Updated 2026-07-10.
Memory breakdown (Q4_K_M, F16 KV, 33K context)
| Model weights | 12.0 GB |
| KV cache | 0.8 GB |
| Runtime overhead + reserve | 4.5 GB |
| Total used | 17.3 / 16 GB |
| Short by | 1.3 GB |
Max context that fits at Q4_K_M: does not fit.
Every quantization on the RTX 4080 SUPER
| Weight quant | Weights | Fits (KV F16) | Used @32K |
|---|---|---|---|
| Q4_K_M | 12.0 GB | ❌ won't fit | 17.3 / 16.0 GB |
| Q5_K_M | 13.9 GB | ❌ won't fit | 19.5 / 16.0 GB |
| Q6_K | 16.0 GB | ❌ won't fit | 21.8 / 16.0 GB |
| Q8_0 | 20.8 GB | ❌ won't fit | 27.1 / 16.0 GB |
| FP16 | 39.1 GB | ❌ won't fit | 47.7 / 16.0 GB |
Lower weight quants free memory at some output-quality cost — Q4 is the common sweet spot; below that quality drops faster.
KV cache is F16 here (llama.cpp default). Drop it to Q8/Q4 (-ctk/-ctv) for more context.
Embed this verdict
Live badge for your README or model card — recomputed by the engine, never stale:
[](https://fitllm.run/can-i-run/gpt-oss-20b-on-rtx-4080-super)
Or from your terminal (exit 0/1 — works as a pre-download guard):
npx fitllm "gpt-oss-20b" --gpu "RTX 4080 SUPER"Why most VRAM calculators get this wrong
gpt-oss-20b interleaves sliding-window (local) and global attention 5:1. The local layers cap their KV cache at the 128-token window, and the global layers use a different head shape (head_dim 64 vs 64). A naive "all layers × full context × one head_dim" formula over-counts KV cache by several times.
What fits on the RTX 4080 SUPER instead
same GPU Models that fit on the RTX 4080 SUPER: Gemma 4 e2b, Gemma 4 e4b, Gemma 4 12b, Llama-3.2-3B-Instruct, Llama-3.1-8B-Instruct, Qwen3-0.6B, Qwen3-1.7B, Llama-3.2-1B-Instruct, Gemma-3-1B-it.
same model GPUs that run gpt-oss-20b: RTX 5090 (32GB), RTX 4090 (24GB), RTX 3090 (24GB), RTX 3090 Ti (24GB), RTX 6000 Ada (48GB), RTX PRO 6000 Blackwell (96GB), RX 7900 XTX (24GB), RX 7900 XT (20GB), Radeon PRO W7900 (48GB), 2× RTX 3090 (48GB), 2× RTX 4090 (48GB), 4× RTX 3090 (96GB), A100 40GB (40GB), A100 80GB (80GB), H100 80GB (80GB), H200 141GB (141GB), B200 (192GB).
Reproduce it
gpt-oss-20b = 21B (3.6B active, MoE), 24 layers. The RTX 4080 SUPER has 16GB / 736GB/s. Same math, open source: fitllm-engine. GGUF bpw from llama.cpp.
All numbers are computed by the open-source fitllm-engine (MIT) from official model config.json values — reproduce or audit them yourself. Estimates; real usage varies with runtime (llama.cpp / MLX / Ollama), driver and display. Found a mismatch? Report it. · FitLLM home