https://zhangchitc.github.io/tags/prefix-caching/Recent content in Prefix-Caching on Chi's BlogHugoen-usThu, 05 Nov 2026 13:00:00 +0800https://zhangchitc.github.io/posts/radix-attention/Thu, 05 Nov 2026 13:00:00 +0800https://zhangchitc.github.io/posts/radix-attention/SGLang keeps the KV cache in a radix tree: edges hold runs of tokens, nodes hold the GPU slot indices where their KV lives. We walk through the slot pool, TreeNode, inserting and splitting nodes, LRU eviction, and four requests that fill the pool and force an eviction.