● FitLLM — fit receipt · Q4_K_M · 8K tokens ctx · KV F16 · engine 2.8.1
WON'T FIT ✗
| weights | KV cache | linear state | overhead | reserve | total | short by |
|---|---|---|---|---|---|---|
| 15.8 GB | 0.5 GB | 0.1 GB | 2.2 GB | 2.0 GB | 20.7 / 12 GB | 8.7 GB |
→ RTX 4090 (24GB) would fit.
Replay: npx fitllm-engine "Qwen 3.8 27B" --gpu "RTX 3060 12GB" · JSON · interactive
— embed:

Computed by the open fitllm-engine (MIT) from official config.json values — estimates; runtime varies. Ran it for real? Challenge this prediction — measured reports calibrate the engine for everyone.