# Managed Inference and Agents

Published articles for Managed Inference and Agents.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Heroku AI adds a flexible standard plan and expands its managed model catalog

DevFeed: [Heroku AI adds a flexible standard plan and expands its managed model catalog](<https://devfeed.tech/articles/whats-new-in-heroku-ai-new-models-and-a-flexible-standard-plan-26473.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/new-models-and-flexible-standard-plan/>)

Author: Anush DSouza

Published: 2026-02-19T17:08:20Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku AI](<https://devfeed.tech/topics/heroku-ai.md>), [Heroku](<https://devfeed.tech/topics/heroku.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>), [cohere](<https://devfeed.tech/topics/cohere.md>)

Tags: [claude](<https://devfeed.tech/tags/claude.md>), [cohere](<https://devfeed.tech/tags/cohere.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [inference](<https://devfeed.tech/tags/inference.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [models](<https://devfeed.tech/tags/models.md>), [news](<https://devfeed.tech/tags/news.md>), [updates](<https://devfeed.tech/tags/updates.md>)

### AI overview

Heroku introduces a standard plan for Managed Inference and Agents that lets developers access supported models through one add-on and API key, while adding Claude 4.6, new open-weight models, and Cohere Embed V4.

### Source excerpt

Heroku is introducing significant updates to Managed Inference and Agents. These changes focus on reducing developer friction, expanding model catalogue, and streamlining deployment workflows. More flexibility with the new standard plan Until now, Heroku's model-based plans required developers to provision a specific add-on for a specific model. This created significant operational overhead. If you wanted [...] The post Whats New in Heroku AI: New Models and a Flexible Standard Plan appeared first on Heroku.

## Code Execution Sandbox for Agents on Heroku

DevFeed: [Code Execution Sandbox for Agents on Heroku](<https://devfeed.tech/articles/code-execution-sandbox-for-agents-on-heroku-26388.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/code-execution-sandbox-for-agents-on-heroku/>)

Author: Anush DSouza

Published: 2026-02-17T20:34:33Z

Content type: tutorial

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Code](<https://devfeed.tech/topics/code.md>), [container](<https://devfeed.tech/topics/container.md>), [Model Context Protocol (MCP)](<https://devfeed.tech/topics/model-context-protocol-mcp.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [claude](<https://devfeed.tech/tags/claude.md>), [code](<https://devfeed.tech/tags/code.md>), [container](<https://devfeed.tech/tags/container.md>), [execution](<https://devfeed.tech/tags/execution.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-on-heroku](<https://devfeed.tech/tags/mcp-on-heroku.md>), [news](<https://devfeed.tech/tags/news.md>), [sandbox](<https://devfeed.tech/tags/sandbox.md>)

### AI overview

Heroku describes code execution sandboxes for AI agents, using ephemeral one-off dynos to isolate untrusted code. The article explains built-in and MCP-based integrations and how programmatic tool calling can reduce context usage.

### Source excerpt

Large language models are good at writing code. Data from Anthropic shows that allowing Claude to execute scripts, rather than relying on sequential tool calls, reduces token consumption by an average of 37%, with some use cases seeing reductions as high as 98%. Untrusted code needs a secure and isolated place to execute. We solved [...] The post Code Execution Sandbox for Agents on Heroku appeared first on Heroku.

## Building AI-Powered Observability with Heroku Managed Inference and Agents

DevFeed: [Building AI-Powered Observability with Heroku Managed Inference and Agents](<https://devfeed.tech/articles/building-ai-powered-observability-with-heroku-managed-inference-and-agents-26381.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/building-ai-powered-observability-with-managed-inference-and-agents/>)

Author: Karunasri (Karuna) Garigipati

Published: 2026-02-13T19:36:30Z

Content type: tutorial

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [observability](<https://devfeed.tech/topics/observability.md>), [telemetry](<https://devfeed.tech/topics/telemetry.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [ide](<https://devfeed.tech/topics/ide.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [ide](<https://devfeed.tech/tags/ide.md>), [incident](<https://devfeed.tech/tags/incident.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mcp-on-heroku](<https://devfeed.tech/tags/mcp-on-heroku.md>), [model-context-protocol](<https://devfeed.tech/tags/model-context-protocol.md>), [observability](<https://devfeed.tech/tags/observability.md>)

### AI overview

This tutorial explains how to connect AI coding assistants in an IDE to observability platforms such as Splunk, Honeycomb, and Sentry through the Model Context Protocol and Heroku Managed Inference and Agents. It describes exposing platform APIs as MCP tools so engineers can query production telemetry in plain English and correlate issues across platforms.

### Source excerpt

If you've ever debugged a production incident, you know the drill: IDE on one screen, Splunk on another, Sentry open in a third tab, frantically copying error messages between windows while your PagerDuty keeps buzzing. You ask "What errors spiked in the last hour?" but instead of an answer, you have to context-switch, recall complex [...] The post Building AI-Powered Observability with Heroku Managed Inference and Agents appeared first on Heroku.

## Building AI Search on Heroku

DevFeed: [Building AI Search on Heroku](<https://devfeed.tech/articles/building-ai-search-on-heroku-26382.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/building-ai-search-on-heroku/>)

Author: Anush DSouza

Published: 2026-01-29T17:50:08Z

Content type: tutorial

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [AI search](<https://devfeed.tech/topics/ai-search.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-search](<https://devfeed.tech/tags/ai-search.md>), [building](<https://devfeed.tech/tags/building.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [news](<https://devfeed.tech/tags/news.md>), [pgvector](<https://devfeed.tech/tags/pgvector.md>), [rag](<https://devfeed.tech/tags/rag.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [retrieval-augmented-generation](<https://devfeed.tech/tags/retrieval-augmented-generation.md>), [search](<https://devfeed.tech/tags/search.md>), [vector-search](<https://devfeed.tech/tags/vector-search.md>)

### AI overview

This article presents a Heroku reference architecture for production-grade enterprise AI search using two-stage retrieval. It combines vector search with semantic reranking so documents are scored for whether they answer the query, then uses Claude to generate an answer.

### Source excerpt

If you've built a RAG (Retrieval Augmented Generation) system, you've probably hit this wall: your vector search returns 20 documents that are semantically similar to the query, but half of them don't actually answer it. A user asks "how do I handle authentication errors?" and gets back documentation about authentication, errors, and error handling in [...] The post Building AI Search on Heroku appeared first on Heroku.

## Optimize Search Precision with Reranking on Heroku AI

DevFeed: [Optimize Search Precision with Reranking on Heroku AI](<https://devfeed.tech/articles/optimize-search-precision-with-reranking-on-heroku-ai-26479.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/optimize-search-precision-reranking-heroku-ai/>)

Author: Anush DSouza

Published: 2026-01-15T16:00:48Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [amazon](<https://devfeed.tech/topics/amazon.md>), [cohere](<https://devfeed.tech/topics/cohere.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [api](<https://devfeed.tech/tags/api.md>), [availability](<https://devfeed.tech/tags/availability.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [inference](<https://devfeed.tech/tags/inference.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [news](<https://devfeed.tech/tags/news.md>), [rag](<https://devfeed.tech/tags/rag.md>), [retrieval-augmented-generation](<https://devfeed.tech/tags/retrieval-augmented-generation.md>)

### AI overview

Heroku announces general availability of reranking models in Heroku Managed Inference and Agents, with support for Cohere Rerank 3.5 and Amazon Rerank 1.0. The article explains how semantic reranking can improve RAG pipelines by filtering documents for query relevance and reducing noise and token costs.

### Source excerpt

Today, we are announcing the general availability of reranking models on Heroku Managed Inference and Agents, featuring support for Cohere Rerank 3.5 and Amazon Rerank 1.0. Semantic reranking models score documents based on their relevance to a specific query. Unlike keyword search or vector similarity, rerank models understand nuanced semantic relationships to identify the most [...] The post Optimize Search Precision with Reranking on Heroku AI appeared first on Heroku.

## Heroku AI: Accelerating AI Development With New Models, Performance Improvements, and Messages API

DevFeed: [Heroku AI: Accelerating AI Development With New Models, Performance Improvements, and Messages API](<https://devfeed.tech/articles/heroku-ai-accelerating-ai-development-with-new-models-performance-improvements-and-messages-api-26362.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/accelerating-ai-dev-new-models-performance-improvements-messages-api/>)

Author: Anush DSouza

Published: 2025-12-18T19:42:30Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [API](<https://devfeed.tech/topics/api.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [api](<https://devfeed.tech/tags/api.md>), [aws](<https://devfeed.tech/tags/aws.md>), [claude](<https://devfeed.tech/tags/claude.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [inference](<https://devfeed.tech/tags/inference.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [news](<https://devfeed.tech/tags/news.md>)

### AI overview

Heroku announces an expanded Managed Inference and Agents model catalog, including Claude Opus 4.5, Nova 2, Kimi K2 Thinking, MiniMax M2, and Qwen3. The release also describes updated model generations, regional availability, security and data-handling claims, and preview support for Anthropic's Messages API, which aligns with Claude SDKs and enables integration with Claude Code and the Claude Agents SDK.

### Source excerpt

This month marks significant expansion for Heroku Managed Inference and Agents, directly accelerating our AI PaaS framework. We're announcing a substantial addition to our model catalog, providing access to leading proprietary AI models such as Claude Opus 4.5, Nova 2, and open-weight models such as Kimi K2 thinking, MiniMax M2, and Qwen3. These resources are [...] The post Heroku AI: Accelerating AI Development With New Models, Performance Improvements, and Messages API appeared first on Heroku.

## Faster Agents with Automatic Prompt Caching

DevFeed: [Faster Agents with Automatic Prompt Caching](<https://devfeed.tech/articles/faster-agents-with-automatic-prompt-caching-26402.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/faster-agents-automatic-prompt-caching/>)

Author: Anush DSouza

Published: 2025-12-04T16:00:24Z

Content type: article

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [Prompt Engineering](<https://devfeed.tech/topics/prompt-engineering.md>), [Security](<https://devfeed.tech/topics/security.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [caching](<https://devfeed.tech/tags/caching.md>), [cryptographic](<https://devfeed.tech/tags/cryptographic.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [inference](<https://devfeed.tech/tags/inference.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [memory](<https://devfeed.tech/tags/memory.md>), [news](<https://devfeed.tech/tags/news.md>), [performance](<https://devfeed.tech/tags/performance.md>), [prompt](<https://devfeed.tech/tags/prompt.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

Heroku describes automatic prompt caching for Managed Inference and Agents. Enabled by default, it caches system prompts and tool definitions, reuses processed components for similar requests, and expires cached data after five minutes of inactivity. User messages and conversation history are not cached.

### Source excerpt

Since its launch, automatic prompt caching has been delivering a notable, zero-effort performance increase for Heroku Managed Inference and Agents. Enabled by default, this feature is designed to deliver significantly faster responses for common workloads. We took a pragmatic approach and currently only enabled this to cache system prompts and tool definitions, not user messages [...] The post Faster Agents with Automatic Prompt Caching appeared first on Heroku.

## Heroku AI Studio for Managed Inference and Agents

DevFeed: [Heroku AI Studio for Managed Inference and Agents](<https://devfeed.tech/articles/heroku-ai-studio-is-your-workspace-for-smarter-faster-ai-apps-26417.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/heroku-ai-studio-workspace-for-smarter-faster-ai-apps/>)

Author: Anush DSouza

Published: 2025-09-17T15:00:12Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku AI](<https://devfeed.tech/topics/heroku-ai.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>), [Heroku](<https://devfeed.tech/topics/heroku.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-studio](<https://devfeed.tech/tags/ai-studio.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [news](<https://devfeed.tech/tags/news.md>), [product-features](<https://devfeed.tech/tags/product-features.md>)

### AI overview

Heroku introduces AI Studio, an interactive workspace for its Managed Inference and Agents add-on. It lets developers experiment with provisioned models and tools, refine prompts, and use code-integration guidance.

### Source excerpt

Ever found yourself in the endless loop of tweaking a prompt, running your code, and waiting to see if you finally got the output you wanted? That slow, frustrating feedback cycle is a common headache for AI developers. What if you could speed that up and get back to what you do best? Let's focus on building amazing applications. We're excited to introduce Heroku AI Studio, a new set of tools designed to streamline your generative AI development from prompt to production. We've focused on creating a more intuitive and efficient workflow, so you can focus on innovation instead of wrestling with your development environment. When using the Heroku Managed Inference and Agents add-on, this new tool is about to become an essential part of your workflow. The post Heroku AI Studio is Your Workspace for Smarter, Faster AI Apps appeared first on Heroku.

## Heroku AI PaaS capabilities and customer examples featured at Dreamforce 2025

DevFeed: [Heroku AI PaaS capabilities and customer examples featured at Dreamforce 2025](<https://devfeed.tech/articles/discover-how-heroku-s-ai-paas-delivers-real-world-results-at-dreamforce-26416.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/heroku-ai-paas-dreamforce-2025/>)

Author: Lauren Groccia

Published: 2025-09-04T15:00:12Z

Content type: article

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Heroku AI](<https://devfeed.tech/topics/heroku-ai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [MCP](<https://devfeed.tech/topics/mcp.md>), [Automation](<https://devfeed.tech/topics/automation.md>), [Model Context Protocol (MCP)](<https://devfeed.tech/topics/model-context-protocol-mcp.md>)

Tags: [2025](<https://devfeed.tech/tags/2025.md>), [agentforce](<https://devfeed.tech/tags/agentforce.md>), [ai](<https://devfeed.tech/tags/ai.md>), [applink](<https://devfeed.tech/tags/applink.md>), [automation](<https://devfeed.tech/tags/automation.md>), [development](<https://devfeed.tech/tags/development.md>), [events](<https://devfeed.tech/tags/events.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mcp-on-heroku](<https://devfeed.tech/tags/mcp-on-heroku.md>), [news](<https://devfeed.tech/tags/news.md>), [platform-updates](<https://devfeed.tech/tags/platform-updates.md>)

### AI overview

This promotional Dreamforce 2025 guide presents Heroku's evolution from a traditional PaaS to an AI PaaS. It highlights AppLink, Managed Inference and Agents, and MCP on Heroku, along with customer examples involving automation, support, lead delivery, Slack apps, and DevOps.

### Source excerpt

The AI revolution presents a critical challenge: moving from experimentation to production. This year, Heroku has evolved beyond a traditional PaaS to become an AI PaaS, a fully managed platform designed to solve this problem and accelerate the delivery of AI-powered apps. With new capabilities like AppLink, Managed Inference and Agents, and MCP on Heroku, Heroku now provides a fully managed platform designed for the AI era. This evolution accelerates the delivery of AI-powered apps and intelligent agents, bringing a new level of speed and simplicity to your development process. Dreamforce 2025 is your chance to see firsthand how the Heroku AI PaaS is delivering business value faster and with less complexity. The post Discover How Heroku's AI PaaS Delivers Real-World Results at Dreamforce appeared first on Heroku.

## Amazon Nova Models: Now Available on Heroku

DevFeed: [Amazon Nova Models: Now Available on Heroku](<https://devfeed.tech/articles/amazon-nova-models-now-available-on-heroku-26366.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/amazon-nova-models-now-available/>)

Author: Anush DSouza

Published: 2025-08-26T15:00:16Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Nova](<https://devfeed.tech/topics/nova.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>)

Tags: [ai-machine-learning](<https://devfeed.tech/tags/ai-machine-learning.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [function-calling](<https://devfeed.tech/tags/function-calling.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [inference](<https://devfeed.tech/tags/inference.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [models](<https://devfeed.tech/tags/models.md>), [nova](<https://devfeed.tech/tags/nova.md>), [product-features](<https://devfeed.tech/tags/product-features.md>), [release](<https://devfeed.tech/tags/release.md>)

### AI overview

Heroku announces that Amazon Nova models, including nova-pro and nova-lite, are available through Heroku Managed Inference and Agents. The integration initially supports text-to-text use, with multimodal support planned for a future release.

### Source excerpt

Building intelligent applications requires powerful, cost-effective AI. Today, we're simplifying that process by making Amazon's cutting-edge Nova models directly available via Heroku Managed Inference and Agents. Provisioning these models is as simple as attaching the add-on to your Heroku application, providing a direct, managed path for developers and businesses to leverage a new class of [...] The post Amazon Nova Models: Now Available on Heroku appeared first on Heroku.

## Heroku AI Expands Model Offering with OpenAI's gpt-oss-120b

DevFeed: [Heroku AI Expands Model Offering with OpenAI's gpt-oss-120b](<https://devfeed.tech/articles/heroku-ai-expands-model-offering-with-openai-s-gpt-oss-120b-26415.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/heroku-ai-openai-gpt-oss-120b-model-now-available/>)

Author: Anush DSouza

Published: 2025-08-20T15:00:14Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku AI](<https://devfeed.tech/topics/heroku-ai.md>), [gpt-oss](<https://devfeed.tech/topics/gpt-oss.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [Heroku](<https://devfeed.tech/topics/heroku.md>), [API](<https://devfeed.tech/topics/api.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-machine-learning](<https://devfeed.tech/tags/ai-machine-learning.md>), [api](<https://devfeed.tech/tags/api.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [function-calling](<https://devfeed.tech/tags/function-calling.md>), [gpt-oss](<https://devfeed.tech/tags/gpt-oss.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [openai](<https://devfeed.tech/tags/openai.md>), [python](<https://devfeed.tech/tags/python.md>), [sdk](<https://devfeed.tech/tags/sdk.md>)

### AI overview

Heroku announces that OpenAI's open-weight gpt-oss-120b model is available through Heroku Managed Inference and Agents. Developers can access it through an OpenAI-compatible chat completions API and use it to build and deploy AI applications and agentic workflows.

### Source excerpt

Start building with OpenAI's new open-weight model, gpt-oss-120b, now available on Heroku Managed Inference and Agents. This gives developers a powerful, transparent, and flexible way to build and deploy AI applications on the platform they already trust. Access gpt-oss-120b with our OpenAI-compatible chat completions API, which you can drop into any OpenAI-compatible SDK or framework. [...] The post Heroku AI Expands Model Offering with OpenAI's gpt-oss-120b appeared first on Heroku.

## Building Data-Aware AI Applications with Heroku AI and LlamaIndex

DevFeed: [Building Data-Aware AI Applications with Heroku AI and LlamaIndex](<https://devfeed.tech/articles/building-data-aware-ai-applications-with-heroku-ai-and-llamaindex-26384.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/building-data-aware-ai-applications-with-heroku-ai-llamaindex/>)

Author: Anush DSouza

Published: 2025-08-19T15:00:00Z

Content type: tutorial

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [llamaindex](<https://devfeed.tech/topics/llamaindex.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Model Context Protocol (MCP)](<https://devfeed.tech/topics/model-context-protocol-mcp.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [building](<https://devfeed.tech/tags/building.md>), [data](<https://devfeed.tech/tags/data.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [llamaindex](<https://devfeed.tech/tags/llamaindex.md>), [llm-applications](<https://devfeed.tech/tags/llm-applications.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [product-features](<https://devfeed.tech/tags/product-features.md>), [rag](<https://devfeed.tech/tags/rag.md>)

### AI overview

This tutorial explains how to build retrieval-augmented generation applications that use private data with Heroku AI and LlamaIndex. It describes LlamaIndex's role in orchestrating data ingestion, indexing, retrieval, and LLM context, along with Heroku AI capabilities including managed inference, embeddings, vector search through pgvector, and connections via Model Context Protocol and AppLink.

### Source excerpt

Building AI applications that can interact with private data is a common goal for many organizations. The challenge often lies in connecting large language models (LLMs) with proprietary datasets. A combination of Heroku Managed Inference and Agents and LlamaIndex provides an elegant stack for this purpose. This post explores how to use these tools to [...] The post Building Data-Aware AI Applications with Heroku AI and LlamaIndex appeared first on Heroku.

## Building Agents With Heroku AI and Pydantic AI

DevFeed: [Building Agents With Heroku AI and Pydantic AI](<https://devfeed.tech/articles/building-agents-with-heroku-ai-and-pydantic-ai-26380.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/building-agents-with-heroku-ai-and-pydantic-ai/>)

Author: Anush DSouza

Published: 2025-08-08T16:33:37Z

Content type: tutorial

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Pydantic](<https://devfeed.tech/topics/pydantic.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Agent Framework](<https://devfeed.tech/topics/agent-framework.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [A2A protocol](<https://devfeed.tech/topics/a2a-protocol.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [a2a](<https://devfeed.tech/tags/a2a.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [claude](<https://devfeed.tech/tags/claude.md>), [fastapi](<https://devfeed.tech/tags/fastapi.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mcp-on-heroku](<https://devfeed.tech/tags/mcp-on-heroku.md>), [model-context-protocol](<https://devfeed.tech/tags/model-context-protocol.md>), [model-context-protocol-mcp](<https://devfeed.tech/tags/model-context-protocol-mcp.md>), [news](<https://devfeed.tech/tags/news.md>), [product-features](<https://devfeed.tech/tags/product-features.md>), [python](<https://devfeed.tech/tags/python.md>)

### AI overview

This tutorial explains how to build production-grade AI agents with Heroku Managed Inference and Agents and the Pydantic AI Python framework. It covers Claude model integration, secure code execution, OpenAI-compatible APIs, environment-variable configuration, MCP client and server support, and exposing agents through the A2A protocol.

### Source excerpt

Building production-grade AI applications can be complex, but with Heroku and Pydantic AI, developers gain a powerful and reliable solution for integrating advanced AI capabilities. Heroku makes it easy to integrate AI into your applications with Heroku Managed Inference and Agents. With a single click, you can attach powerful Large Language Models like Anthropic's Claude [...] The post Building Agents With Heroku AI and Pydantic AI appeared first on Heroku.

## Introducing the Heroku AI Platform as a Service (AI PaaS)

DevFeed: [Introducing the Heroku AI Platform as a Service (AI PaaS)](<https://devfeed.tech/articles/introducing-the-heroku-ai-platform-as-a-service-ai-paas-26457.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/introducing-the-heroku-ai-platform-as-a-service/>)

Author: Betty Junod

Published: 2025-06-26T15:00:05Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku AI](<https://devfeed.tech/topics/heroku-ai.md>), [Heroku](<https://devfeed.tech/topics/heroku.md>), [AI Platform](<https://devfeed.tech/topics/ai-platform.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [MCP](<https://devfeed.tech/topics/mcp.md>), [cursor](<https://devfeed.tech/topics/cursor.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [cursor](<https://devfeed.tech/tags/cursor.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [llms](<https://devfeed.tech/tags/llms.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-on-heroku](<https://devfeed.tech/tags/mcp-on-heroku.md>), [mcp-server](<https://devfeed.tech/tags/mcp-server.md>), [news](<https://devfeed.tech/tags/news.md>), [partners](<https://devfeed.tech/tags/partners.md>), [platform](<https://devfeed.tech/tags/platform.md>), [platform-updates](<https://devfeed.tech/tags/platform-updates.md>)

### AI overview

Heroku announces its evolution into an AI Platform as a Service, adding AI capabilities to its cloud platform. The announcement describes Heroku AppLink, integrations with Cursor, Windsurf, and Claude Code, and tools for building and running MCP servers.

### Source excerpt

Today, we are pleased to announce the evolution of Heroku to an AI Platform as a Service (AI PaaS). GenAI has changed how we build software (vibe coding), the kind of technology we use (Cursor, LLMs), the type of software we make (agents), and redefined what it means to be a developer in this new [...] The post Introducing the Heroku AI Platform as a Service (AI PaaS) appeared first on Heroku.

## Heroku AI: Claude 4 Sonnet is now available

DevFeed: [Heroku AI: Claude 4 Sonnet is now available](<https://devfeed.tech/articles/heroku-ai-claude-4-sonnet-is-now-available-26413.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/heroku-ai-claude-4-sonnet-now-available/>)

Author: Anush DSouza

Published: 2025-05-29T14:28:22Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [anthropic](<https://devfeed.tech/topics/anthropic.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [JavaScript](<https://devfeed.tech/topics/javascript.md>), [Python](<https://devfeed.tech/topics/python.md>), [Ruby](<https://devfeed.tech/topics/ruby.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-machine-learning](<https://devfeed.tech/tags/ai-machine-learning.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [api](<https://devfeed.tech/tags/api.md>), [claude](<https://devfeed.tech/tags/claude.md>), [cli](<https://devfeed.tech/tags/cli.md>), [environment-variables](<https://devfeed.tech/tags/environment-variables.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [javascript](<https://devfeed.tech/tags/javascript.md>), [llm](<https://devfeed.tech/tags/llm.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [news](<https://devfeed.tech/tags/news.md>), [pgvector](<https://devfeed.tech/tags/pgvector.md>), [python](<https://devfeed.tech/tags/python.md>), [rag](<https://devfeed.tech/tags/rag.md>), [ruby](<https://devfeed.tech/tags/ruby.md>), [services](<https://devfeed.tech/tags/services.md>)

### AI overview

Heroku announces that Anthropic's Claude 4 Sonnet is available through Heroku Managed Inference and Agents. The article describes support for coding, advanced reasoning, AI agents, MCP integrations, and API access from Heroku applications.

### Source excerpt

Anthropic's Claude 4 Sonnet, part of the next generation of Claude models, is now available on Heroku Managed Inference and Agents. This gives developers immediate access to a model designed for coding, advanced reasoning, and the support of capable AI agents. Heroku Managed Inference and Agents expands your AI choices, offering the freedom to build [...] The post Heroku AI: Claude 4 Sonnet is now available appeared first on Heroku.

## Heroku AI: Managed Inference and Agents is now Generally Available

DevFeed: [Heroku AI: Managed Inference and Agents is now Generally Available](<https://devfeed.tech/articles/heroku-ai-managed-inference-and-agents-is-now-generally-available-26464.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/managed-inference-and-agents-now-generally-available/>)

Author: Anush DSouza

Published: 2025-05-15T16:00:48Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku AI](<https://devfeed.tech/topics/heroku-ai.md>), [Heroku](<https://devfeed.tech/topics/heroku.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [inference](<https://devfeed.tech/tags/inference.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mcp-on-heroku](<https://devfeed.tech/tags/mcp-on-heroku.md>), [model-context-protocol](<https://devfeed.tech/tags/model-context-protocol.md>), [news](<https://devfeed.tech/tags/news.md>)

### AI overview

Heroku AI: Managed Inference and Agents is generally available. The release provides ready-to-use access to curated AI models and primitives for building agents that can reason, act, call tools, and support AI-powered features in Heroku applications.

### Source excerpt

Many of the most exciting experiences we're beginning to rely on every day are powered by AI; whether it's conversational assistants, personalized recommendations or code generation, these experiences are powered by inference systems and intelligent agents. Behind the scenes, developers offload complex decisions, automate tasks, and compose intelligent applications using large language models and tool [...] The post Heroku AI: Managed Inference and Agents is now Generally Available appeared first on Heroku.

## Heroku AI: Build and Deploy Enterprise Grade MCP Servers

DevFeed: [Heroku AI: Build and Deploy Enterprise Grade MCP Servers](<https://devfeed.tech/articles/heroku-ai-build-and-deploy-enterprise-grade-mcp-servers-26386.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/building-mcp-servers-on-heroku/>)

Author: Gautam Rangarajan

Published: 2025-05-15T15:58:21Z

Content type: tutorial

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [MCP Server](<https://devfeed.tech/topics/mcp-server.md>), [interoperability](<https://devfeed.tech/topics/interoperability.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [interoperability](<https://devfeed.tech/tags/interoperability.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-on-heroku](<https://devfeed.tech/tags/mcp-on-heroku.md>), [mcp-server](<https://devfeed.tech/tags/mcp-server.md>), [news](<https://devfeed.tech/tags/news.md>), [product-features](<https://devfeed.tech/tags/product-features.md>)

### AI overview

This guide explains how to build and deploy MCP servers on Heroku using Heroku Managed Inference and Agents. It describes MCP as a standardized way for AI applications to provide context to large language models and connect them with data sources and tools. The guide covers SDK support, server registration, unified access through the MCP Toolkit, external client access, on-demand scaling, and code isolation.

### Source excerpt

Agents hold immense power, but their true potential shines when they connect to the real world, fetching data, triggering actions, or leveraging external tools. The Model Context Protocol (MCP) offers a standardized way for AI agents to do this. MCP is an open protocol that standardizes how applications provide context to LLMs. Think of MCP [...] The post Heroku AI: Build and Deploy Enterprise Grade MCP Servers appeared first on Heroku.

## Jupyter Notebooks on Heroku with Persistent Storage

DevFeed: [Jupyter Notebooks on Heroku with Persistent Storage](<https://devfeed.tech/articles/jupyter-notebooks-on-heroku-with-persistent-storage-26461.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/jupyter-notebooks-heroku-persistent-storage/>)

Author: Anush DSouza

Published: 2025-04-02T06:54:00Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [jupyter](<https://devfeed.tech/topics/jupyter.md>), [Disk image](<https://devfeed.tech/topics/disk-image.md>), [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [Security](<https://devfeed.tech/topics/security.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-infrastructure](<https://devfeed.tech/tags/cloud-infrastructure.md>), [data-analytics](<https://devfeed.tech/tags/data-analytics.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [jupyter](<https://devfeed.tech/tags/jupyter.md>), [jupyter-notebooks](<https://devfeed.tech/tags/jupyter-notebooks.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [news](<https://devfeed.tech/tags/news.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [pgvector](<https://devfeed.tech/tags/pgvector.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [python](<https://devfeed.tech/tags/python.md>), [rag](<https://devfeed.tech/tags/rag.md>), [security](<https://devfeed.tech/tags/security.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

Heroku introduces Heroku-Jupyter, an open-source solution for running Jupyter Notebooks with persistent PostgreSQL storage, deployment support, password protection, and customizable environments. The article also describes using Heroku-Jupyter with pgvector and Heroku Managed Inference and Agents for retrieval-augmented generation applications.

### Source excerpt

We're excited to introduce Heroku-Jupyter, an open-source, production-ready solution for running Jupyter Notebooks on Heroku with persistent storage, seamless deployment, and built-in security. Whether you're a data scientist, educator, or developer, you can now spin up a cloud-based Jupyter environment in minutes. Why Jupyter on Heroku? Jupyter Notebooks provide an interactive computing environment ideal for [...] The post Jupyter Notebooks on Heroku with Persistent Storage appeared first on Heroku.

## Heroku AI | Managed Inference and Agents

DevFeed: [Heroku AI | Managed Inference and Agents](<https://devfeed.tech/articles/heroku-ai-managed-inference-and-agents-26414.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/heroku-ai-managed-inference-agents/>)

Author: Rand Arete

Published: 2024-12-02T14:00:00Z

Content type: release

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>), [Environment Variables](<https://devfeed.tech/topics/environment-variables.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [cli](<https://devfeed.tech/tags/cli.md>), [environment-variables](<https://devfeed.tech/tags/environment-variables.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [news](<https://devfeed.tech/tags/news.md>), [nextgen](<https://devfeed.tech/tags/nextgen.md>), [rag](<https://devfeed.tech/tags/rag.md>)

### AI overview

Heroku announces the pilot of Managed Inference and Agents, the initial offering of Heroku AI. It provides access to selected AI models and supports adding model access to Heroku applications through the Heroku CLI and environment variables.

### Source excerpt

Over the last couple of years, we've repeatedly heard the question "who will build the Heroku of AI?". The answer to that question is that Heroku will, of course. We are excited to bring AI to the Heroku platform with the pilot of Managed Inference and Agents, delivered with the graceful developer and operational experience [...] The post Heroku AI | Managed Inference and Agents appeared first on Heroku.