https://zhangchitc.github.io/tags/vllm/Recent content in Vllm on Chi's BlogHugoen-usTue, 03 Nov 2026 01:00:00 +0800https://zhangchitc.github.io/posts/paged-attention/Tue, 03 Nov 2026 01:00:00 +0800https://zhangchitc.github.io/posts/paged-attention/Why serving LLMs fragments GPU memory, and how vLLM’s PagedAttention fixes it with OS-style paging: physical blocks, a block table, chained block hashes, and a walkthrough of how blocks are allocated, shared, freed and evicted.