INFERENCE LAB / INFERENCE

vLLM

Deploy, serve and optimize. Practical notes on the engines behind LLM inference.

Inference

Understand what KV cache quantization changes and build a compatibility and quality check before enabling it.

Sep 7, 2026 · 2 min read

Reference guide · awaiting lab validation

Inference

Distinguish the attention state stored during generation from reuse of that state across requests.

Sep 7, 2026 · 2 min read

Reference guide · awaiting lab validation

Inference

Choose an inference engine using workload compatibility, reproducibility and operational requirements—not an unqualified leaderboard.

Sep 7, 2026 · 2 min read

Reference guide · awaiting lab validation