# Deploying a RAG Chatbot with Shared State and Storage Across Replicas

DevFeed: [Deploying a RAG Chatbot with Shared State and Storage Across Replicas](<https://devfeed.tech/articles/static-vs-dynamic-vs-continuous-batching-in-llms-clearly-explained-18242.md>)

Original publisher: [Read original article](<https://blog.dailydoseofds.com/p/static-vs-dynamic-vs-continuous-batching>)

Author: Avi Chawla

Published: 2026-09-01T21:11:23Z

Content type: tutorial

Language: en

Sources: [Daily Dose of Data Science](<https://devfeed.tech/sources/daily-dose-of-data-science.md>)

Topics: [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Terraform](<https://devfeed.tech/topics/terraform.md>), [FastAPI](<https://devfeed.tech/topics/fastapi.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [fastapi](<https://devfeed.tech/tags/fastapi.md>), [github](<https://devfeed.tech/tags/github.md>), [persistence](<https://devfeed.tech/tags/persistence.md>), [pgvector](<https://devfeed.tech/tags/pgvector.md>), [python](<https://devfeed.tech/tags/python.md>), [rag](<https://devfeed.tech/tags/rag.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [terraform](<https://devfeed.tech/tags/terraform.md>)

## AI overview

The article explains why a RAG chatbot that works locally can lose vector indexes, conversation history, and documents when deployed across multiple replicas. It recommends shared persistence for embeddings, checkpointed conversation state, and shared object storage, with examples using Postgres, pgvector, LangGraph, and object storage.

## Source excerpt

+ a popular LLM interview question.