# How Instacart Uses LLMs to Make People Buy More

DevFeed: [How Instacart Uses LLMs to Make People Buy More](<https://devfeed.tech/articles/how-instacart-uses-llms-to-make-people-buy-more-136317.md>)

Original publisher: [Read original article](<https://blog.bytebytego.com/p/how-instacart-uses-llms-to-make-people>)

Author: ByteByteGo

Published: 2026-11-16T16:30:56Z

Content type: article

Language: en

Sources: [ByteByteGo](<https://devfeed.tech/sources/bytebytego.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>), [Representation learning](<https://devfeed.tech/topics/representation-learning.md>)

Tags: [a-b-testing](<https://devfeed.tech/tags/a-b-testing.md>), [a100](<https://devfeed.tech/tags/a100.md>), [adapter](<https://devfeed.tech/tags/adapter.md>), [advertising](<https://devfeed.tech/tags/advertising.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-software](<https://devfeed.tech/tags/agentic-software.md>), [agents](<https://devfeed.tech/tags/agents.md>), [api](<https://devfeed.tech/tags/api.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [behaviour](<https://devfeed.tech/tags/behaviour.md>), [brand](<https://devfeed.tech/tags/brand.md>), [business-context](<https://devfeed.tech/tags/business-context.md>), [cache](<https://devfeed.tech/tags/cache.md>), [instacart](<https://devfeed.tech/tags/instacart.md>), [llms](<https://devfeed.tech/tags/llms.md>), [product-search](<https://devfeed.tech/tags/product-search.md>), [search](<https://devfeed.tech/tags/search.md>), [shopping](<https://devfeed.tech/tags/shopping.md>)

## AI overview

Instacart combines purchase-history candidates, LLM interpretation, and embedding-based relevance checks to map shopping queries to catalog categories. For rewrites, it separates synonyms, broader terms, and substitutes; the article reports coverage above 95% and precision above 90%. For semantic tags, an offline LLM teacher creates validated examples and cached results, while a LoRA-fine-tuned Llama-3 8B handles uncached live queries. Merging the adapter and moving from A100 to H100 reduced reported serving latency from nearly 700 ms to a 300 ms target. FP8 offered another 10% latency reduction but slightly lowered recall, so Instacart deployed the unquantized model. Caching meant only 2% of queries needed live inference. The article reports A/B test results for tail queries: 6% lower average scroll depth, 50% fewer related complaints, and marginal latency increase.

## Source excerpt

In this article, we'll look at how Instacart used LLMs to build a product search that could accurately understand a user's shopping intention.