# Plan, divide, and conquer: How weak models excel at long context tasks

DevFeed: [Plan, divide, and conquer: How weak models excel at long context tasks](<https://devfeed.tech/articles/plan-divide-and-conquer-how-weak-models-excel-at-long-context-tasks-80209.md>)

Original publisher: [Read original article](<https://www.together.ai/blog/plan-divide-conquer>)

Author: Zhen Xu, Shang Zhu, Jue Wang, Junlin Wang, Ben Athiwaratkun, Chi Wang, James Zou, Ce Zhang

Published: 2026-03-26T00:00:00Z

Content type: article

Language: en

Sources: [Together.ai](<https://devfeed.tech/sources/together-ai.md>)

Topics: [agentic-coding](<https://devfeed.tech/topics/agentic-coding.md>), [scaling laws](<https://devfeed.tech/topics/scaling-laws.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [divide-and-conquer](<https://devfeed.tech/tags/divide-and-conquer.md>), [llama](<https://devfeed.tech/tags/llama.md>), [long-context](<https://devfeed.tech/tags/long-context.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [qwen](<https://devfeed.tech/tags/qwen.md>)

## AI overview

The article presents research on dividing long-context tasks across a planner, parallel workers, and a manager. It reports that smaller models can outperform GPT-4o on some long-context tasks, while noting that the method can fail when important information spans distant chunks.

## Source excerpt

As context windows grow, LLM performance degrades in unexpected ways. We show how a "Divide & Conquer" framework -- breaking long documents into parallel chunks with a planner, workers, and manager -- lets smaller models like Llama-3-70B and Qwen-72B outperform GPT-4o single-shot.