● FitLLM — fit receipt · Q4_K_M · 8K tokens ctx · KV F16 · engine 2.16.0 · revision f1e3678550d69a40971615209e14e399144b2272 · release manifest
WON'T FIT ✗
| weights | KV cache | overhead | reserve | total | short by |
|---|---|---|---|---|---|
| 66.6 GB | 0.3 GB | 8.3 GB | 2.0 GB | 77.1 / 32 GB | 45.1 GB |
→ A100 80GB would fit.
Replay: npx fitllm-engine "gpt-oss-120b" --gpu "RTX 5090" · JSON · interactive
— embed:

Computed by the open fitllm-engine (MIT) from official config.json values — estimates; runtime varies. Ran it for real? Challenge this prediction — measured reports calibrate the engine for everyone.