KV Cache on Apple Silicon: Why Memory Fragments and How PagedAttention Helps — Part 2 of NanoServe, a tiny LLM inference engine build series. This article covers how KV cache implemented with PagedAttention reduces GPU memory fragmentation, the CUDA-based design behind it, and the block-based cache built for Apple Silicon instead.