# Why KV Cache Stores K and V Vectors But Never Q?

DevFeed: [Why KV Cache Stores K and V Vectors But Never Q?](<https://devfeed.tech/articles/why-kv-cache-stores-k-and-v-vectors-but-never-q-18247.md>)

Original publisher: [Read original article](<https://blog.dailydoseofds.com/p/why-kv-cache-stores-k-and-v-vectors>)

Author: Avi Chawla

Published: 2026-08-30T20:15:33Z

Content type: article

Language: en

Sources: [Daily Dose of Data Science](<https://devfeed.tech/sources/daily-dose-of-data-science.md>)

Topics: [LLMs](<https://devfeed.tech/topics/llms.md>), [Parsing](<https://devfeed.tech/topics/parsing.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [gpu](<https://devfeed.tech/tags/gpu.md>), [interview](<https://devfeed.tech/tags/interview.md>), [llms](<https://devfeed.tech/tags/llms.md>), [parsing](<https://devfeed.tech/tags/parsing.md>), [pdf](<https://devfeed.tech/tags/pdf.md>), [technical](<https://devfeed.tech/tags/technical.md>)

## AI overview

The document discusses Marker v2, an open-source PDF parsing pipeline that uses shared inference serving and batching to improve GPU utilization. It also begins explaining autoregressive LLMs and why their forward pass is relevant to KV-cache behavior, but the supplied text ends before the explanation is complete.

## Source excerpt

A popular technical LLM interview question.