● FitLLM — fit receipt · Q4_K_M · 8K tokens ctx · KV F16 · engine 2.8.1
FITS ✓
| weights | KV cache | overhead | reserve | total | free |
|---|---|---|---|---|---|
| 17.1 GB | 0.4 GB | 2.4 GB | 2.0 GB | 21.9 / 24 GB | 2.1 GB |
Max context at this quant: ~19K tokens
Replay: npx fitllm-engine "GLM-4.7-Flash" --gpu "RTX 3090" · JSON · interactive
— embed:

Computed by the open fitllm-engine (MIT) from official config.json values — estimates; runtime varies. Ran it for real? Challenge this prediction — measured reports calibrate the engine for everyone.