# Streaming AI responses and the incomplete JSON problem

DevFeed: [Streaming AI responses and the incomplete JSON problem](<https://devfeed.tech/articles/streaming-ai-responses-and-the-incomplete-json-problem-33532.md>)

Original publisher: [Read original article](<https://www.aha.io/engineering/articles/streaming-ai-responses-incomplete-json>)

Published: 2025-10-22T00:00:00Z

Content type: article

Language: en

Sources: [Aha! Engineering Blog](<https://devfeed.tech/sources/aha-engineering-blog.md>)

Topics: [Streaming](<https://devfeed.tech/topics/streaming.md>), [JSON](<https://devfeed.tech/topics/json.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Tool](<https://devfeed.tech/topics/tool.md>), [Parser](<https://devfeed.tech/topics/parser.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [json](<https://devfeed.tech/tags/json.md>), [llm](<https://devfeed.tech/tags/llm.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [search](<https://devfeed.tech/tags/search.md>), [streaming](<https://devfeed.tech/tags/streaming.md>), [tools](<https://devfeed.tech/tags/tools.md>)

## AI overview

The article examines the incomplete JSON problem that occurs when LLMs stream tool arguments character by character. It explains why waiting for complete JSON creates poor user feedback and discusses attempts to produce parseable partial JSON in real time, including performance issues with longer responses.

## Source excerpt

Modern LLM providers can stream their responses. This is great for user experience -- instead of a loading spinner, users see the response being generated in real time. They can also call external functions (also called "tools"): search your database