# Faster Agents with Automatic Prompt Caching

DevFeed: [Faster Agents with Automatic Prompt Caching](<https://devfeed.tech/articles/faster-agents-with-automatic-prompt-caching-26402.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/faster-agents-automatic-prompt-caching/>)

Author: Anush DSouza

Published: 2025-12-04T16:00:24Z

Content type: article

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [Prompt Engineering](<https://devfeed.tech/topics/prompt-engineering.md>), [Security](<https://devfeed.tech/topics/security.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [caching](<https://devfeed.tech/tags/caching.md>), [cryptographic](<https://devfeed.tech/tags/cryptographic.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [inference](<https://devfeed.tech/tags/inference.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [memory](<https://devfeed.tech/tags/memory.md>), [news](<https://devfeed.tech/tags/news.md>), [performance](<https://devfeed.tech/tags/performance.md>), [prompt](<https://devfeed.tech/tags/prompt.md>), [security](<https://devfeed.tech/tags/security.md>)

## AI overview

Heroku describes automatic prompt caching for Managed Inference and Agents. Enabled by default, it caches system prompts and tool definitions, reuses processed components for similar requests, and expires cached data after five minutes of inactivity. User messages and conversation history are not cached.

## Source excerpt

Since its launch, automatic prompt caching has been delivering a notable, zero-effort performance increase for Heroku Managed Inference and Agents. Enabled by default, this feature is designed to deliver significantly faster responses for common workloads. We took a pragmatic approach and currently only enabled this to cache system prompts and tool definitions, not user messages [...] The post Faster Agents with Automatic Prompt Caching appeared first on Heroku.