# Building AI Search on Heroku

DevFeed: [Building AI Search on Heroku](<https://devfeed.tech/articles/building-ai-search-on-heroku-26382.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/building-ai-search-on-heroku/>)

Author: Anush DSouza

Published: 2026-01-29T17:50:08Z

Content type: tutorial

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Heroku](<https://devfeed.tech/topics/heroku.md>), [AI search](<https://devfeed.tech/topics/ai-search.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-search](<https://devfeed.tech/tags/ai-search.md>), [building](<https://devfeed.tech/tags/building.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [heroku-ai](<https://devfeed.tech/tags/heroku-ai.md>), [managed-inference-and-agents](<https://devfeed.tech/tags/managed-inference-and-agents.md>), [news](<https://devfeed.tech/tags/news.md>), [pgvector](<https://devfeed.tech/tags/pgvector.md>), [rag](<https://devfeed.tech/tags/rag.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [retrieval-augmented-generation](<https://devfeed.tech/tags/retrieval-augmented-generation.md>), [search](<https://devfeed.tech/tags/search.md>), [vector-search](<https://devfeed.tech/tags/vector-search.md>)

## AI overview

This article presents a Heroku reference architecture for production-grade enterprise AI search using two-stage retrieval. It combines vector search with semantic reranking so documents are scored for whether they answer the query, then uses Claude to generate an answer.

## Source excerpt

If you've built a RAG (Retrieval Augmented Generation) system, you've probably hit this wall: your vector search returns 20 documents that are semantically similar to the query, but half of them don't actually answer it. A user asks "how do I handle authentication errors?" and gets back documentation about authentication, errors, and error handling in [...] The post Building AI Search on Heroku appeared first on Heroku.