INFERENCE LAB / TAGS

vLLM

Technical notes organized around a shared topic.

Inference

Understand what KV cache quantization changes and build a compatibility and quality check before enabling it.

Sep 7, 2026 · 2 min read

Reference guide · awaiting lab validation

Inference

Distinguish the attention state stored during generation from reuse of that state across requests.

Sep 7, 2026 · 2 min read

Reference guide · awaiting lab validation

Inference

Choose an inference engine using workload compatibility, reproducibility and operational requirements—not an unqualified leaderboard.

Sep 7, 2026 · 2 min read

Reference guide · awaiting lab validation