# context window

A context window is the amount or range of tokenized text an AI or large language model can consider when generating a response.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Why AI Agents Leave You More Tired, Not More Rested

DevFeed: [Why AI Agents Leave You More Tired, Not More Rested](<https://devfeed.tech/articles/why-ai-agents-leave-you-more-tired-not-more-rested-146457.md>)

Original publisher: [Read original article](<https://hackernoon.com/why-ai-agents-leave-you-more-tired-not-more-rested?source=rss>)

Author: Dmitry Mishunin

Published: 2026-11-20T12:02:01Z

Content type: article

Language: en

Sources: [HackerNoon](<https://devfeed.tech/sources/hackernoon.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [agentic workflows](<https://devfeed.tech/topics/agentic-workflows.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [attention](<https://devfeed.tech/tags/attention.md>), [burnout](<https://devfeed.tech/tags/burnout.md>), [compaction](<https://devfeed.tech/tags/compaction.md>), [context-switching](<https://devfeed.tech/tags/context-switching.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [deep](<https://devfeed.tech/tags/deep.md>), [developer-productivity](<https://devfeed.tech/tags/developer-productivity.md>), [domains](<https://devfeed.tech/tags/domains.md>), [focus](<https://devfeed.tech/tags/focus.md>), [mental-health](<https://devfeed.tech/tags/mental-health.md>), [productivity](<https://devfeed.tech/tags/productivity.md>), [switching](<https://devfeed.tech/tags/switching.md>), [work-life-balance](<https://devfeed.tech/tags/work-life-balance.md>)

### AI overview

The article argues that AI agents can leave people more tired because they expand one person's work across unfamiliar domains, increase task switching, and raise expectations for faster delivery. It cites research on switching costs and attention residue, plus a survey in which 77% of AI-using employees said AI added to their workload; it notes the survey came from Upwork, which sells freelance work. The article compares human recovery to an agent's context compaction: people need sleep and breaks to recover and retain information, but have no instant reset. It recommends focus blocks with genuine breaks, grouping work by domain, attention-restoring activities such as walks, adequate sleep, and deadlines that account for review and decisions. Its central caution is that faster tools can create more work rather than saved time, so sustained use requires recovery.

### Source excerpt

Why working with AI agents drains people by lunch: domain switching, deadlines measured in hours, and the myth of an infinite human context window.

## Beam Model Technical Report

DevFeed: [Beam Model Technical Report](<https://devfeed.tech/articles/beam-model-technical-report-145663.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26358>)

Author: Reflection Team, Adam Abdulhamid, Osama Abuelsorour, Yasmin Alameddine, Carlo Alfano, Duarte Alves, Brandon Amos, Selvaraj Anandaraj, Arseni Anisimovich, George Antoniadis, Ioannis Antonoglou, Sheila

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [post-training](<https://devfeed.tech/topics/post-training.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [distributed-training](<https://devfeed.tech/topics/distributed-training.md>), [Model Optimizer](<https://devfeed.tech/topics/model-optimizer.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>)

Tags: [agentic-workloads](<https://devfeed.tech/tags/agentic-workloads.md>), [asynchronous](<https://devfeed.tech/tags/asynchronous.md>), [beam](<https://devfeed.tech/tags/beam.md>), [co-design](<https://devfeed.tech/tags/co-design.md>), [coding](<https://devfeed.tech/tags/coding.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [fp8](<https://devfeed.tech/tags/fp8.md>), [gb300](<https://devfeed.tech/tags/gb300.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [open](<https://devfeed.tech/tags/open.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [speculative-decoding](<https://devfeed.tech/tags/speculative-decoding.md>), [throughput](<https://devfeed.tech/tags/throughput.md>)

### AI overview

Beam is a 501.3B-parameter sparse MoE model with 23.4B active parameters, designed for coding, reasoning, and agentic workloads. The abstract reports a 1M-token context window enabled by two-stage midtraining on verifiable, correctness-anchored data, following pretraining on 23.8T tokens. Post-training used asynchronous RL on 10.5K GB300 GPUs, producing over 100M rollouts in four weeks; measured capabilities continued to improve as RL compute increased, with no plateau reported. Hardware-model co-design, FP8/NVFP4 quantization, and a 1.93B-parameter DFlash 2 speculative decoding drafter target serving throughput. The report claims 3-4x less inference compute than many comparable models. On its safety evaluation, Beam refused or pivoted on 88.9% of harmful requests while complying with 81.5% of harmless requests; the text says its harmful-request refusal/pivot rate was highest among open-weight models on the Pareto frontier.

### Source excerpt

arXiv:2611.26358v1 Announce Type: cross Abstract: Beam is a sparse Mixture-of-Experts (MoE) model with 501.3B total parameters and 23.4B active parameters, specifically built and optimized for coding, reasoning, and agentic workloads. Beam delivers frontier level reasoning, while requiring 3-4x less inference compute than many models of its class. Pretrained on 23.8T diverse, curated, high-quality tokens, Beam features a 1M-token context window achieved through a novel two-stage midtraining phase, built on verifiable, correctness-anchored data. Post-training leveraged a large-scale, fully asynchronous reinforcement learning (RL) campaign across 10.5K GB300 GPUs, generating over 100M rollouts over 4 weeks of training. We believe this is one of the largest scale RL runs conducted by any open lab to date. Across our evaluation suite, capabilities continued to improve as we increased RL compute, with no sign of a plateau. Supported by deep hardware-model co-design, FP8/NVFP4 quantization, and a 1.93B-parameter speculative decoding drafter (DFlash 2), Beam maximizes serving throughput with efficient, flexible deployment. Averaged across conversation turns and harm categories, Beam refuses or pivots on 88.9% of harmful requests while complying with 81.5% of harmless requests, achieving the highest refusal/pivot rate on harmful requests among open-weight models on the Pareto frontier.

## DTS: Delta-Based Tile Scoring for Efficient Long-Context Sparse Attention

DevFeed: [DTS: Delta-Based Tile Scoring for Efficient Long-Context Sparse Attention](<https://devfeed.tech/articles/dts-delta-based-tile-scoring-for-efficient-long-context-sparse-attention-145120.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25938>)

Author: Emre U\\u{g}ur, Jiawen Qi, Qinyu Chen

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>)

Tags: [adaptive](<https://devfeed.tech/tags/adaptive.md>), [anchor](<https://devfeed.tech/tags/anchor.md>), [attention](<https://devfeed.tech/tags/attention.md>), [bottleneck](<https://devfeed.tech/tags/bottleneck.md>), [bounded](<https://devfeed.tech/tags/bounded.md>), [concurrently](<https://devfeed.tech/tags/concurrently.md>), [content](<https://devfeed.tech/tags/content.md>), [context](<https://devfeed.tech/tags/context.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [delta](<https://devfeed.tech/tags/delta.md>), [flashattention](<https://devfeed.tech/tags/flashattention.md>), [free](<https://devfeed.tech/tags/free.md>), [full](<https://devfeed.tech/tags/full.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [h100](<https://devfeed.tech/tags/h100.md>), [language](<https://devfeed.tech/tags/language.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large](<https://devfeed.tech/tags/large.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [long-context](<https://devfeed.tech/tags/long-context.md>), [sparse-attention](<https://devfeed.tech/tags/sparse-attention.md>)

### AI overview

DTS reduces the cost of scoring blocks for sparse long-context attention by choosing query and key anchors based on local vector changes: it uses fewer anchors in redundant regions and more in heterogeneous ones. Parallel delta packing speeds selection by scanning tile-aligned chunks concurrently; selected tiles are computed with the original query, key, and value vectors. The method is training-free. On LLaMA-3.1-8B-Instruct, average RULER and LongBench scores were within 0.10 percentage points of full attention, with RULER tested up to 128K tokens. At 128K, scoring-pipeline latency was 38% lower than XAttention; at 512K, prefill was 3.3x faster than a PyTorch full-attention baseline using FlashAttention-2 on four NVIDIA H100 GPUs.

### Source excerpt

arXiv:2611.25938v1 Announce Type: new Abstract: Large language models (LLMs) increasingly need to process long documents and codebases, making long-context attention a major prefill bottleneck. Block sparse attention reduces computation by skipping unimportant blocks of the attention matrix, but scoring blocks accurately can itself be expensive. We propose Delta-Based Tile Scoring (DTS), a training-free, content-adaptive tile scoring method for sparse block attention. DTS selects query and key anchors according to local vector changes, using fewer representatives in redundant regions while retaining more detail in heterogeneous regions. To accelerate anchor selection, parallel delta packing partitions the query and key sequences into tile-aligned chunks and performs bounded local scans over these chunks concurrently. The selected tiles are then computed using the original query, key, and value vectors. On LLaMA-3.1-8B-Instruct, DTS keeps average RULER and LongBench scores within 0.10 percentage points of full attention, with RULER evaluated up to 128K tokens. At 128K tokens, DTS reduces measured scoring-pipeline latency by 38% compared with XAttention. On four NVIDIA H100 GPUs, it achieves a 3.3$\times$ prefill speedup over a PyTorch full-attention baseline using FlashAttention-2 at 512K tokens.

## Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality

DevFeed: [Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality](<https://devfeed.tech/articles/physics-of-language-models-part-4-2-canon-layers-at-scale-where-synthetic-pretraining-resonates-in-reality-145447.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24963>)

Author: Zeyuan Allen-Zhu

Published: 2026-11-20T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [model architecture](<https://devfeed.tech/topics/model-architecture.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Neural Network](<https://devfeed.tech/topics/neural-network.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [canon](<https://devfeed.tech/tags/canon.md>), [context](<https://devfeed.tech/tags/context.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [deltanet](<https://devfeed.tech/tags/deltanet.md>), [gated-linear-attention](<https://devfeed.tech/tags/gated-linear-attention.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [linear](<https://devfeed.tech/tags/linear.md>), [playgrounds](<https://devfeed.tech/tags/playgrounds.md>), [pretraining](<https://devfeed.tech/tags/pretraining.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [research](<https://devfeed.tech/tags/research.md>), [scale](<https://devfeed.tech/tags/scale.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

Across 64 pretraining runs at 1.3-8B parameters, architectural differences that nearly disappeared in carefully tuned 1.3B models trained on 100B tokens became measurable at 1-2T tokens. At 8B, adding Canon local token mixing to Transformers cut the tokens needed to reach the same MMLU accuracy by about 30%. With Canon, gated linear attention matched Gated DeltaNet and outperformed Mamba2 at 8B/1T; the authors suggest the latter models' additional machinery may mainly mix neighboring tokens. Yet benchmark scores obscured basic in-context weaknesses: linear models could not reliably retrieve information from a 500-token context, and no tested model reliably beat chance on a simple two-hop question. The abstract argues that small synthetic experiments can expose differences standard benchmarks miss and recommends including in-context reasoning examples early in pretraining.

### Source excerpt

arXiv:2611.24963v1 Announce Type: cross Abstract: Do standard benchmarks see the architectural differences that matter? We study it with 64 from-scratch pretraining runs of Transformers and three linear-model families at 1.3-8B parameters on 1-2T Nemotron-CC tokens, at a cost of roughly 100k USD per 8B run. In academic-scale pretraining (1.3B parameters, 100B tokens), architectural differences can all but disappear when the models are carefully tuned. Instead, at 1-2T tokens they become measurable: Canon layers, which add local token mixing, consistently improve Transformers, saving about 30% of pretraining tokens for the same MMLU accuracy at 8B. We also introduce GLA5 and GDN2, which improve gated linear attention and Gated DeltaNet with low-rank output gates. Surprisingly, with Canon, the simplest linear model, gated linear attention, matches Gated DeltaNet and outperforms Mamba2 even at 8B/1T. Therefore, the extra machinery of Gated DeltaNet and Mamba2 may do little more than mix neighboring tokens. Even at 8B/1T, however, high scores on standard benchmarks can hide weaknesses in basic in-context skills. In particular, linear models that match or beat Transformers on these benchmarks cannot, in fact, reliably retrieve information from a short 500-token context. Moreover, no model, Transformer or linear, reliably beats random guessing on arguably the simplest two-hop question, stated in a few short sentences, even at this scale. These findings $\textbf{challenge traditional architecture research}$ based primarily on standard benchmark scores. In contrast, small synthetic playgrounds, which predicted the architectural differences above at <100M parameters, can reveal what these benchmarks miss. For practitioners, one lesson is to include in-context reasoning examples in pretraining data from an early stage, rather than reserve them for later mid-training, let alone post-training.

## What Is an LLM? Large Language Models Explained

DevFeed: [What Is an LLM? Large Language Models Explained](<https://devfeed.tech/articles/what-is-an-llm-large-language-models-explained-145885.md>)

Original publisher: [Read original article](<https://montecarlo.ai/blog-what-is-an-llm-large-language-models-explained>)

Author: Virna Sekuj

Published: 2026-11-19T16:43:33Z

Content type: article

Language: en

Sources: [Monte Carlo](<https://devfeed.tech/sources/monte-carlo.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [LLM observability](<https://devfeed.tech/topics/llm-observability.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [knowledge cutoff](<https://devfeed.tech/topics/knowledge-cutoff.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [agent-trust](<https://devfeed.tech/tags/agent-trust.md>), [agent-trust-glossary](<https://devfeed.tech/tags/agent-trust-glossary.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [attention](<https://devfeed.tech/tags/attention.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [claude](<https://devfeed.tech/tags/claude.md>), [code-generation](<https://devfeed.tech/tags/code-generation.md>), [coding-assistants](<https://devfeed.tech/tags/coding-assistants.md>), [context](<https://devfeed.tech/tags/context.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [glossary](<https://devfeed.tech/tags/glossary.md>), [how-do-llms-work](<https://devfeed.tech/tags/how-do-llms-work.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-examples](<https://devfeed.tech/tags/llm-examples.md>), [llm-limitations](<https://devfeed.tech/tags/llm-limitations.md>), [llm-meaning](<https://devfeed.tech/tags/llm-meaning.md>), [llm-vs-ai-agent](<https://devfeed.tech/tags/llm-vs-ai-agent.md>), [neural-network](<https://devfeed.tech/tags/neural-network.md>)

### AI overview

LLMs generate text by predicting one token at a time, and their answers depend heavily on the context supplied at runtime. In production, fluent output can still be wrong because of hallucinations, stale or incomplete context, incorrect tool use, or provider model changes; failures may not show up in uptime or error rates. The excerpt recommends recording traces of prompts, retrieved data, tool calls, outputs, latency, token counts, and model versions; evaluating accuracy, relevance, and groundedness; checking context freshness and completeness; and tracking cost and performance. Comparing traces and data lineage can help distinguish a context problem from a model change. The excerpt does not cover full training stages in detail.

### Source excerpt

A large language model (LLM) is a neural network trained on large amounts of text to understand and generate human language. LLMs predict the most likely next piece of text, one token at a time, which lets them answer questions, write and summarize documents, generate code, and power AI agents that take actions.

## Google DeepMind Releases Gemini 4 Neon: 1M Context, #1 on AA Coding Agent Index

DevFeed: [Google DeepMind Releases Gemini 4 Neon: 1M Context, #1 on AA Coding Agent Index](<https://devfeed.tech/articles/google-deepmind-releases-gemini-4-neon-1m-context-1-on-aa-coding-agent-index-142243.md>)

Original publisher: [Read original article](<https://www.marktechpost.com/2026/11/18/google-gemini-4-neon-release/>)

Author: Asif Razzaq

Published: 2026-11-19T06:52:26Z

Content type: release

Language: en

Sources: [MarkTechPost](<https://devfeed.tech/sources/marktechpost.md>)

Topics: [agentic-coding](<https://devfeed.tech/topics/agentic-coding.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Google](<https://devfeed.tech/topics/google.md>), [google-antigravity](<https://devfeed.tech/topics/google-antigravity.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [supervisor agent pattern](<https://devfeed.tech/topics/supervisor-agent-pattern.md>), [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>)

Tags: [agent-workflows](<https://devfeed.tech/tags/agent-workflows.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agentic-coding](<https://devfeed.tech/tags/agentic-coding.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-shorts](<https://devfeed.tech/tags/ai-shorts.md>), [api](<https://devfeed.tech/tags/api.md>), [applications](<https://devfeed.tech/tags/applications.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [context](<https://devfeed.tech/tags/context.md>), [context-engineering](<https://devfeed.tech/tags/context-engineering.md>), [editors-pick](<https://devfeed.tech/tags/editors-pick.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [for-devs](<https://devfeed.tech/tags/for-devs.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [gemini-4](<https://devfeed.tech/tags/gemini-4.md>), [gemini-4-neon](<https://devfeed.tech/tags/gemini-4-neon.md>), [google-deepmind](<https://devfeed.tech/tags/google-deepmind.md>), [harness](<https://devfeed.tech/tags/harness.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [new-releases](<https://devfeed.tech/tags/new-releases.md>), [python](<https://devfeed.tech/tags/python.md>), [software-engineering](<https://devfeed.tech/tags/software-engineering.md>), [staff](<https://devfeed.tech/tags/staff.md>), [tech-news](<https://devfeed.tech/tags/tech-news.md>), [technology](<https://devfeed.tech/tags/technology.md>)

### AI overview

Gemini 4 Neon is a hosted, closed-weight reasoning model positioned between Gemini 4 Carbon and Hydrogen for coding agents, knowledge work, and science. It offers a 1M-token context and costs $3 per million input tokens and $15 per million output tokens; Google says it costs less per task than Carbon and some rivals, though GPT-6.2 Sol has lower listed token prices. In Google-reported benchmarks, Neon scores 61 on the AA Intelligence Index and ranks first on the AA Coding Agent Index, with a notable 95.2% on GraphWalks. It does not lead every comparison: Claude Opus 5.5 scores higher on Terminal-bench 4.1 and FrontierCode 2.0, while GPT-6.2 Sol leads Chartography. Results are self-reported and not independently reproduced in the excerpt. Neon supports multimodal inputs and agent workflows, including context compaction and Antigravity orchestration of Gemini 4 Hydrogen subagents, but is Google-hosted only, with no local or edge builds.

### Source excerpt

Google released Gemini 4 Neon, a 1M-context Gemini 4 model priced at $3/$15 per million tokens. It scores 61 on the AA Intelligence Index and ranks #1 on AA's Coding Agent Index. The post Google DeepMind Releases Gemini 4 Neon: 1M Context, #1 on AA Coding Agent Index appeared first on MarkTechPost.

## When Do Decision Models Help LLM-Driven Network Discovery?

DevFeed: [When Do Decision Models Help LLM-Driven Network Discovery?](<https://devfeed.tech/articles/when-do-decision-models-help-llm-driven-network-discovery-143140.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23947>)

Author: Alperen \\"Orsdemir, Rochelle Xenia Mendoza Santos, Wen Shei Ong, Matthew Caesar, Ertem Esiner

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [network security](<https://devfeed.tech/topics/network-security.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [context window](<https://devfeed.tech/topics/context-window.md>)

Tags: [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [decision-models](<https://devfeed.tech/tags/decision-models.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [dispatch](<https://devfeed.tech/tags/dispatch.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [network](<https://devfeed.tech/tags/network.md>)

### AI overview

In a simulation calibrated on a 30-node containerized testbed, chunked batch dispatch recovered 92% to 100% of open ports at network scales of 100 and 1,000, while single-host dispatch recovered under 6%, attributed to context saturation and scan latency. At the measured proposal quality of the local model, decision gating raised port recall from 75.5% to 89.0% on small networks and intercepted costly decoy tarpits. It also added latency for frontier models during early host discovery. These findings are reported from simulation, not as results across all real-world networks.

### Source excerpt

arXiv:2611.23947v1 Announce Type: new Abstract: Network discovery, the identification of live hosts and their exposed services, is the first phase of every penetration test, and it is increasingly automated by harnesses driven by large language models (LLMs). To mitigate hallucinated or unsafe commands, recent work proposes inserting fast, non-generative decision models to validate actions prior to execution. This paper quantifies whether such validation improves discovery across three network scales (n = 10, 100, and 1,000) in a simulation calibrated on a 30-node containerized testbed. Our findings show that chunked batch dispatch recovers 92% to 100% of open ports in large-scale networks, whereas single-host dispatch collapses to under 6% due to context saturation and scan latency. Furthermore, at the measured proposal quality of the local model, decision gating increases its port recall from 75.5% to 89.0% on small networks and intercepts costly decoy tarpits, but it imposes additional latency on frontier models during early host discovery.

## Mixtures of In-Context Learners

DevFeed: [Mixtures of In-Context Learners](<https://devfeed.tech/articles/mixtures-of-in-context-learners-142491.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2411.02830>)

Author: Giwon Hong, Emile van Krieken, Edoardo Ponti, Esmeralda S. Whitammer, Pasquale Minervini

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>)

Tags: [classification](<https://devfeed.tech/tags/classification.md>), [complexity](<https://devfeed.tech/tags/complexity.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [distributions](<https://devfeed.tech/tags/distributions.md>), [domain](<https://devfeed.tech/tags/domain.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [experts](<https://devfeed.tech/tags/experts.md>), [fewer](<https://devfeed.tech/tags/fewer.md>), [filter](<https://devfeed.tech/tags/filter.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [frontier](<https://devfeed.tech/tags/frontier.md>), [function](<https://devfeed.tech/tags/function.md>), [improvements](<https://devfeed.tech/tags/improvements.md>), [in-context-learning](<https://devfeed.tech/tags/in-context-learning.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llms](<https://devfeed.tech/tags/llms.md>), [memory](<https://devfeed.tech/tags/memory.md>), [merge](<https://devfeed.tech/tags/merge.md>), [model](<https://devfeed.tech/tags/model.md>)

### AI overview

Mixtures of In-Context Learners (MoICL) treats subsets of demonstrations as experts and learns to weight and merge their output distributions using a training set. The authors report improved performance over strong baselines on 5 of 7 classification datasets, with gains up to 13% over ICL and LENS. They also report reaching comparable performance with fewer demonstrations and less inference time, and greater robustness to out-of-domain, imbalanced, or noisy demonstrations, with reported gains up to 11%, 49%, and 38%, respectively. These findings are from the reported experiments; the supplied text does not provide further methodological details.

### Source excerpt

arXiv:2411.02830v2 Announce Type: replace-cross Abstract: In-context learning (ICL) adapts LLMs by providing demonstrations without fine-tuning the model parameters; however, it does not differentiate between demonstrations and quadratically increases the complexity of Transformer LLMs, exhausting the memory. As a solution, we propose Mixtures of In-Context Learners (MoICL), a novel approach to treat subsets of demonstrations as experts and learn a weighting function to merge their output distributions based on a training set. In our experiments, we show performance improvements on 5 out of 7 classification datasets compared to a set of strong baselines (up to +13\% compared to ICL and LENS). Moreover, we enhance the Pareto frontier of ICL by reducing the inference time needed to achieve the same performance with fewer demonstrations. Finally, MoICL is more robust to out-of-domain (up to +11\%), imbalanced (up to +49\%), or noisy demonstrations (up to +38\%) or can filter these out from datasets. Overall, MoICL is a more expressive approach to learning from demonstrations without exhausting the context window or memory.

## Semantic Context Handoff with On-Demand Evidence for Long-Horizon Agents

DevFeed: [Semantic Context Handoff with On-Demand Evidence for Long-Horizon Agents](<https://devfeed.tech/articles/semantic-context-handoff-with-on-demand-evidence-for-long-horizon-agents-142784.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24357>)

Author: Guolong Zheng, Chen Hou, Xu Yang, Jianshan Zhang, Tao Huang

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [context](<https://devfeed.tech/tags/context.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [execution](<https://devfeed.tech/tags/execution.md>), [horizon](<https://devfeed.tech/tags/horizon.md>), [inference](<https://devfeed.tech/tags/inference.md>), [interaction](<https://devfeed.tech/tags/interaction.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [pass](<https://devfeed.tech/tags/pass.md>), [performance](<https://devfeed.tech/tags/performance.md>), [prompting](<https://devfeed.tech/tags/prompting.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [semantic](<https://devfeed.tech/tags/semantic.md>), [swe-bench](<https://devfeed.tech/tags/swe-bench.md>), [system](<https://devfeed.tech/tags/system.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

Semantic Context Handoff (SCH) separates an agent's compact interpretation of its current state from the action-observation evidence supporting it. Earlier evidence remains addressable and can re-enter context when relevant, without separate summarization or retrieval-model calls. In a controlled 150-task SWE-bench study, evidence recovery raised Pass@1 from 80.0% to 86.9% with essentially unchanged token use and execution time. In a complete-system comparison, SCH reached 86.9% Pass@1 using 43% fewer tokens and 41% less wall-clock time than the strongest baseline by task performance. Across evaluated models and benchmarks, it reduced token use versus full-history prompting while remaining competitive with or improving on the other evaluated baselines. Trajectory analysis found recovery of evidence from much earlier interactions, beyond a recent-context window.

### Source excerpt

arXiv:2611.24357v1 Announce Type: new Abstract: Traditional long-horizon LLM agents often hand off context through full-history prompting, retaining all previous action--observation interactions. As execution proceeds, this history keeps growing, increasing inference cost and potentially degrading accuracy. Existing methods control this growth by preserving compact conclusions while removing earlier observations, but doing so can discard evidence that later becomes relevant. We introduce Semantic Context Handoff (SCH), whose central abstraction is state--evidence separation: a compact semantic state carries the agent's current interpretation, while supporting action--observation evidence remains separately addressable and can re-enter context when later execution makes it relevant, without separate summarization or retrieval-model calls. Empirically, SCH improves long-horizon agent performance while substantially reducing context cost. In a controlled 150-task SWE-bench study, SCH's evidence recovery improves Pass@1 from $80.0\%$ to $86.9\%$ at essentially unchanged token use and execution time. In the complete-system comparison, SCH achieves 86.9% Pass@1 while using 43% fewer tokens and 41% less wall-clock time than the strongest baseline by task performance. Across models and benchmarks, SCH consistently reduces token use relative to full-history prompting while remaining competitive with or improving upon the evaluated baselines. Trajectory analysis confirms that SCH recovers evidence from substantially earlier parts of the interaction history rather than merely preserving a recent context window.

## Tether solves the memory challenge for AI builders who don't want to rely on the cloud

DevFeed: [Tether solves the memory challenge for AI builders who don't want to rely on the cloud](<https://devfeed.tech/articles/tether-solves-the-memory-challenge-for-ai-builders-who-don-t-want-to-rely-on-the-cloud-141204.md>)

Original publisher: [Read original article](<https://www.cio.com/article/4250405/tether-solves-the-memory-challenge-for-ai-builders-who-dont-want-to-rely-on-the-cloud.html>)

Author: tether

Published: 2026-11-18T20:54:28Z

Content type: article

Language: en

Sources: [CIO](<https://devfeed.tech/sources/cio.md>)

Topics: [Local AI](<https://devfeed.tech/topics/local-ai.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [context window](<https://devfeed.tech/topics/context-window.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [artificial-intelligence-machine-learning](<https://devfeed.tech/tags/artificial-intelligence-machine-learning.md>), [cache](<https://devfeed.tech/tags/cache.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [compression](<https://devfeed.tech/tags/compression.md>), [context](<https://devfeed.tech/tags/context.md>), [database](<https://devfeed.tech/tags/database.md>), [development-kit](<https://devfeed.tech/tags/development-kit.md>), [device](<https://devfeed.tech/tags/device.md>), [edition-us](<https://devfeed.tech/tags/edition-us.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kv-cache](<https://devfeed.tech/tags/kv-cache.md>), [language-en](<https://devfeed.tech/tags/language-en.md>), [local-ai](<https://devfeed.tech/tags/local-ai.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [memory](<https://devfeed.tech/tags/memory.md>), [model](<https://devfeed.tech/tags/model.md>), [model-weights](<https://devfeed.tech/tags/model-weights.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [on-device-ai](<https://devfeed.tech/tags/on-device-ai.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [phone](<https://devfeed.tech/tags/phone.md>), [qwen3-5](<https://devfeed.tech/tags/qwen3-5.md>), [qwen3-5-4b](<https://devfeed.tech/tags/qwen3-5-4b.md>), [storytype-brandpost](<https://devfeed.tech/tags/storytype-brandpost.md>)

### AI overview

Tether's QVAC SDK uses two quantization tools to reduce memory demands in local AI: TurboQuant compresses a model's KV cache during inference, while TurboVec compresses the vector index used for retrieval-augmented generation (RAG). The excerpt reports TurboQuant can cut context memory by up to five times; for Qwen3.5-4B at 262,000 tokens, it gives a comparison of about 8 GB for a standard 16-bit cache versus 1.6 GB with TurboQuant. TurboVec reportedly reduces ten million typical embedding vectors from roughly 61 GB to about 8 GB. TurboQuant was integrated in QVAC SDK v0.12.0 for Windows and Linux systems with NVIDIA, AMD, or Intel GPUs. The article presents these savings as enabling longer contexts and document search on consumer hardware, potentially supporting private-data RAG without cloud uploads. The provided text ends partway through the KV-cache example, so it does not show the full discussion.

### Source excerpt

Thanks to the rise of a new generation of highly capable small AI models, on-device or local inference has become increasingly viable for a greater range of applications. However, limited memory capacity often prevents local AI from reaching its full potential. A model that fits comfortably on a laptop or phone can hit a wall the moment it has to hold a long conversation or search a large database. To advance on-device AI capabilities, Tether's QVAC SDK tackles the memory challenge from two directions. By integrating TurboQuant and TurboVec, the software development kit shrinks two of the biggest memory costs in a local AI pipeline: the model's working memory during inference, and the index it searches when answering questions from your own documents. Compressing what AI remembers Modern language models generate text through a process called self-attention, in which each token (the basic units of text) gets encoded into three vectors: a query, a key, and a value. The query is what the current token is "looking for"; the key is what each earlier token offers up to be matched against that query; and the value is the actual content pulled forward once a match is found. AI models don't reprocess the whole conversation for every new word. They keep a running store of key and value projections for every token already seen: the KV cache. Originally developed by Google researchers, TurboQuant is an open-source compression algorithm for this KV cache that transforms 16- or 32-bit vectors into smaller ones, without losing too much accuracy. The result is up to a five times reduction in the amount of memory used to store context during inference. Reducing the size of a model's KV cache enables AI running on consumer hardware to process longer context prompts that would otherwise exceed local memory capacity. Consider a four billion parameter model like Qwen3.5-4B running at 262,000 tokens of context. While the model weights alone are small enough to fit on a smartphone's VRAM,

## What Is Context Engineering? Giving AI Agents the Right Information

DevFeed: [What Is Context Engineering? Giving AI Agents the Right Information](<https://devfeed.tech/articles/what-is-context-engineering-giving-ai-agents-the-right-information-141931.md>)

Original publisher: [Read original article](<https://montecarlo.ai/blog-context-engineering>)

Author: Ruslan Sultanov

Published: 2026-11-18T18:46:57Z

Content type: article

Language: en

Sources: [Monte Carlo](<https://devfeed.tech/sources/monte-carlo.md>)

Topics: [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [Prompt Engineering](<https://devfeed.tech/topics/prompt-engineering.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [LLM observability](<https://devfeed.tech/topics/llm-observability.md>), [context](<https://devfeed.tech/topics/context.md>)

Tags: [agent-memory](<https://devfeed.tech/tags/agent-memory.md>), [agent-trust](<https://devfeed.tech/tags/agent-trust.md>), [agent-trust-glossary](<https://devfeed.tech/tags/agent-trust-glossary.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [context-engineering](<https://devfeed.tech/tags/context-engineering.md>), [context-engineering-for-ai-agents](<https://devfeed.tech/tags/context-engineering-for-ai-agents.md>), [context-engineering-vs-prompt-engineering](<https://devfeed.tech/tags/context-engineering-vs-prompt-engineering.md>), [context-engineering-vs-rag](<https://devfeed.tech/tags/context-engineering-vs-rag.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [context-window-management](<https://devfeed.tech/tags/context-window-management.md>), [data](<https://devfeed.tech/tags/data.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [glossary](<https://devfeed.tech/tags/glossary.md>), [llm-context](<https://devfeed.tech/tags/llm-context.md>), [prompts](<https://devfeed.tech/tags/prompts.md>), [what-is-context-engineering](<https://devfeed.tech/tags/what-is-context-engineering.md>)

### AI overview

Context engineering shapes everything an agent receives--instructions, retrieved data, tool results, and memory--so it has a small, relevant set of information at each step. Prompt engineering focuses on instruction wording; RAG fetches documents for the prompt; context engineering encompasses both, along with tool design, memory, and what to omit. Techniques include just-in-time retrieval, reranking and filtering, compressing long outputs, using sub-agents with separate context, storing notes externally, and structuring inputs. These cannot correct stale or faulty source data. The excerpt recommends monitoring freshness and volume, tracing outputs to source documents and versions, recording retrievals, and evaluating groundedness and correctness. It notes that larger context windows do not remove the need to select and manage information.

### Source excerpt

Two teams build the same support agent on the same model with nearly identical prompts. One answers correctly nine times out of ten. The other confidently quotes a shipping policy that changed in the spring. The difference isn't the model or the wording. It's what each agent was given to read before it answered. That's ...

## Lumi-4B AI Model: Everything You Need to Know

DevFeed: [Lumi-4B AI Model: Everything You Need to Know](<https://devfeed.tech/articles/lumi-4b-ai-model-everything-you-need-to-know-140476.md>)

Original publisher: [Read original article](<https://hackernoon.com/lumi-4b-ai-model-everything-you-need-to-know?source=rss>)

Author: aimodels44

Published: 2026-11-18T06:07:46Z

Content type: article

Language: en

Sources: [HackerNoon](<https://devfeed.tech/sources/hackernoon.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [post-training](<https://devfeed.tech/topics/post-training.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [context window](<https://devfeed.tech/topics/context-window.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-model](<https://devfeed.tech/tags/ai-model.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [base](<https://devfeed.tech/tags/base.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [chat](<https://devfeed.tech/tags/chat.md>), [coding](<https://devfeed.tech/tags/coding.md>), [content-creation](<https://devfeed.tech/tags/content-creation.md>), [context](<https://devfeed.tech/tags/context.md>), [customer-success](<https://devfeed.tech/tags/customer-success.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [distillation](<https://devfeed.tech/tags/distillation.md>), [english](<https://devfeed.tech/tags/english.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [knowledge-distillation](<https://devfeed.tech/tags/knowledge-distillation.md>), [language](<https://devfeed.tech/tags/language.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [languages](<https://devfeed.tech/tags/languages.md>), [lumi-4b-explained](<https://devfeed.tech/tags/lumi-4b-explained.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [parameter](<https://devfeed.tech/tags/parameter.md>), [programming](<https://devfeed.tech/tags/programming.md>), [specifications](<https://devfeed.tech/tags/specifications.md>), [supervised-fine-tuning](<https://devfeed.tech/tags/supervised-fine-tuning.md>), [training](<https://devfeed.tech/tags/training.md>), [use-cases](<https://devfeed.tech/tags/use-cases.md>)

### AI overview

Lumi-4B is a 4B-parameter instruct model focused on Brazilian Portuguese, with English also intended. CEIA/UFG's NLP team started from Nemotron 3 Nano 4B and used continual pre-training with distillation (50 billion tokens, 8,192-token training context), followed by supervised fine-tuning. It targets conversational and instruction-following text; mathematics and coding capabilities were intended to be retained but should be evaluated for each use. Keep thinking disabled. This release has no additional RL/RLVR or dedicated identity training, and tool use is undocumented and unvalidated. Accuracy, bias, unsupported content, specialized-domain performance, and use beyond Brazilian Portuguese require evaluation. The text gives no numerical benchmark results or validated inference context length. Its vLLM template uses a placeholder repository ID and requires checking against the released checkpoint. Related-model descriptions identify GAIA Gemma-3 Gaia PT-BR 4B as based on Gemma 3 and Manacá-1B as a base model, but provide no comparative quality evidence. Claims about v0.2 should not be applied to this release.

### Source excerpt

Explore Lumi-4B, a 4B-parameter AI model focused on Brazilian Portuguese. Learn about its training, use cases, specifications, and limitations.

## Long-Context Generation Is a Sampling Problem (When You Turn Up the Heat)

DevFeed: [Long-Context Generation Is a Sampling Problem (When You Turn Up the Heat)](<https://devfeed.tech/articles/long-context-generation-is-a-sampling-problem-when-you-turn-up-the-heat-139971.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22148>)

Author: Allen G. Roush, Minh Nhat Nguyen, Ravid Shwartz-Ziv, Judah Goldfeder, Sanjay Basu

Published: 2026-11-18T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Language models](<https://devfeed.tech/topics/language-models.md>), [Temperature settings in AI](<https://devfeed.tech/topics/temperature-settings-in-ai.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agents](<https://devfeed.tech/tags/agents.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [chain-of-thought](<https://devfeed.tech/tags/chain-of-thought.md>), [code](<https://devfeed.tech/tags/code.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [correlation](<https://devfeed.tech/tags/correlation.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [data](<https://devfeed.tech/tags/data.md>), [generation](<https://devfeed.tech/tags/generation.md>), [github](<https://devfeed.tech/tags/github.md>), [github-issues](<https://devfeed.tech/tags/github-issues.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llama-3-1](<https://devfeed.tech/tags/llama-3-1.md>), [long-context](<https://devfeed.tech/tags/long-context.md>), [open-weight-models](<https://devfeed.tech/tags/open-weight-models.md>), [qwen3-5](<https://devfeed.tech/tags/qwen3-5.md>), [reading](<https://devfeed.tech/tags/reading.md>), [sampling](<https://devfeed.tech/tags/sampling.md>)

### AI overview

The study reports that sampler behavior as temperature rises can strongly affect long-generation quality in open-weight models. Across 29 models and ten benchmarks plus retrieval up to one million tokens, top-nsigma retained a median 100% of its temperature-1 score at temperature 2, while top-p retained 26%. On three Qwen3.5 models, coding agents using top-p, top-k, or Top-H resolved none of 100 GitHub issues at temperature 2; top-nsigma resolved 46 to 62. The authors associate quality loss with growth in the candidate-token pool: for one Llama-3.1-8B example, top-p expanded from 4 tokens at temperature 1 to 51,845 at 2, while top-nsigma stayed at 3. They report that fixing the pool at temperature 1 also prevented Top-H, min-p, and p-less from collapsing. Most samplers performed similarly at temperature 1.

### Source excerpt

arXiv:2611.22148v1 Announce Type: new Abstract: Open-weight language models are widely observed to get worse the longer they generate. Often, attempts to fix this involve more training. At high temperature, The sampler, i.e. the rule that picks the next token out of the model's probabilities, decides whether long and agentic generation survives and/or thrives. We test 29 open-weight models from 1B to 122B parameters on ten established benchmarks plus needle retrieval out to one million tokens, covering SWE-bench Verified coding agents, long chain-of-thought reasoning, long-form writing, long structured output and long-context reading. Samplers that keep their pool of candidate tokens small and steady as temperature rises don't lose accuracy. Samplers that let in low-probability tokens fall apart. At temperature 2, coding agents running top-p, top-k or Top-H resolve 0 of 100 GitHub issues, while the same agents running top-nsigma resolve 46 to 62 and win every issue the two samplers disagree on, on three Qwen3.5 models. Over all benchmarks top-nsigma keeps a median 100% of its temperature-1 score where top-p keeps 26%. Counting how many tokens each sampler lets through explains why. In one Llama-3.1-8B story, going from temperature 1 to 2 grows top-p's pool from 4 tokens to 51,845 while top-nsigma stays at 3. Across 133 combinations of sampler setting and temperature, the typical pool size predicts judged quality (Spearman correlation of -0.77), and when we pick the pool at temperature 1 and only apply temperature afterwards, Top-H, min-p and p-less stop collapsing. At the default temperature of 1 most samplers perform about the same, We release all code and data to the public.

## Gemini 4 Neon now available on AI Gateway

DevFeed: [Gemini 4 Neon now available on AI Gateway](<https://devfeed.tech/articles/gemini-4-neon-now-available-on-ai-gateway-141387.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/gemini-4-neon-now-available-on-ai-gateway>)

Author: Zachary Chen

Published: 2026-11-18T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [Multi-step AI processes](<https://devfeed.tech/topics/multi-step-ai-processes.md>), [context window](<https://devfeed.tech/topics/context-window.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-workflows](<https://devfeed.tech/tags/agent-workflows.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [codex](<https://devfeed.tech/tags/codex.md>), [coding](<https://devfeed.tech/tags/coding.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cursor](<https://devfeed.tech/tags/cursor.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [gemini-4-neon](<https://devfeed.tech/tags/gemini-4-neon.md>), [google](<https://devfeed.tech/tags/google.md>), [google-maps](<https://devfeed.tech/tags/google-maps.md>), [google-search](<https://devfeed.tech/tags/google-search.md>), [grounding](<https://devfeed.tech/tags/grounding.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [structured-outputs](<https://devfeed.tech/tags/structured-outputs.md>), [text](<https://devfeed.tech/tags/text.md>), [tool-calling](<https://devfeed.tech/tags/tool-calling.md>), [video](<https://devfeed.tech/tags/video.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

Google's Gemini 4 Neon is available on AI Gateway under model ID `google/gemini-4-neon`. The source describes it as faster than the earlier, lighter Gemini 4 while delivering output quality close to Google's larger Gemini 4 models, for coding, agent workflows, and multi-step tasks. It accepts text, images, video, and documents with a 1M-token context window, and supports tool calling, structured outputs, Google Search and Maps grounding, and four reasoning levels: low, medium, high, and xhigh.

### Source excerpt

Gemini 4 Neon from Google is now available on AI Gateway. Gemini 4 Neon is a major upgrade over the earlier, lighter Gemini 4 model, delivering output quality close to Google's larger Gemini 4 models with faster responses. It's built for coding, agent workflows, and multi-step tasks. The model accepts text, images, video, and documents, with a 1M-token context window. It supports tool calling, structured outputs, grounding with Google Search and Google Maps, and four reasoning levels: low, medium, high, and xhigh. Use google/gemini-4-neon as the model ID: To use Gemini 4 Neon in Codex, Cursor, or another supported agent, see the coding agents guide. Try Gemini 4 Neon in the model playground, or explore all language models. Read more

## Agents Cannot Hand Over What They Have Not Yet Understood

DevFeed: [Agents Cannot Hand Over What They Have Not Yet Understood](<https://devfeed.tech/articles/agents-cannot-hand-over-what-they-have-not-yet-understood-137315.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.18642>)

Author: Yibo Liu

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [agent to agent communication](<https://devfeed.tech/topics/agent-to-agent-communication.md>), [context window](<https://devfeed.tech/topics/context-window.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [hidden](<https://devfeed.tech/tags/hidden.md>), [interactive](<https://devfeed.tech/tags/interactive.md>), [learn](<https://devfeed.tech/tags/learn.md>), [models](<https://devfeed.tech/tags/models.md>), [note](<https://devfeed.tech/tags/note.md>), [structured](<https://devfeed.tech/tags/structured.md>), [summary](<https://devfeed.tech/tags/summary.md>), [teams](<https://devfeed.tech/tags/teams.md>)

### AI overview

Across 56 interactive worlds with hidden rules, all six tested models learned less when knowledge passed through a chain of eight agents, each inheriting a 300-character note, than when one agent retained its full history for eight lives. After eight generations, the chain reached roughly the learning level of the single agent after four lives. The reported handoff loss came mainly from repeatedly compressing notes; switching agents contributed none, and one-time compression contributed less. Writing each note from the full record of earlier lives recovered 70%-82% of the loss. Recording evidence, revising the inherited note, or using a structured ledger did not alleviate it. These findings are reported for the study's tested models and worlds.

### Source excerpt

arXiv:2611.18642v1 Announce Type: new Abstract: Agents that work beyond a single context window, or in teams, hand their work to a successor as a short written summary. Evaluation has focused on whether an agent can solve a task, and relatively little is known about how much of what an agent has learned survives being written down. We study this in 56 interactive worlds with hidden rules, where an agent that is told nothing fails and an agent given a 300-character statement of the rules succeeds. We compare one agent that plays eight lives and keeps its whole history with a chain of eight agents that each play one life and inherit a 300-character note. All six models we test learn less in the chain: after eight generations it stands where the single agent stood after about four lives. Controlled variants of the chain decompose this handoff loss into three components: none from changing the agent, a smaller loss from compressing to 300 characters, and a larger loss from compressing repeatedly. When each note is written from the full record of earlier lives instead of from the previous note, the same 300 characters recover 70% to 82% of the loss. The loss is robust across model sizes and is not alleviated by instructing the writer to record evidence, to revise the inherited note, or to keep a structured ledger. In simpler terms, an agent cannot hand over what it has not yet understood: a note holds what its writer has worked out, and a rule that takes several lives to see is lost with the lives that were not passed on.

## When Facts Change, Which Decisions Break? Dependency-Aware Context Graphs for Agents

DevFeed: [When Facts Change, Which Decisions Break? Dependency-Aware Context Graphs for Agents](<https://devfeed.tech/articles/when-facts-change-which-decisions-break-dependency-aware-context-graphs-for-agents-137503.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.19859>)

Author: Paul Deepakraj Retinraj

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [agentic workflows](<https://devfeed.tech/topics/agentic-workflows.md>), [graph theory](<https://devfeed.tech/topics/graph-theory.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [agent-memory](<https://devfeed.tech/tags/agent-memory.md>), [agents](<https://devfeed.tech/tags/agents.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [context-graphs](<https://devfeed.tech/tags/context-graphs.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [dependencies](<https://devfeed.tech/tags/dependencies.md>), [dependency](<https://devfeed.tech/tags/dependency.md>), [directory](<https://devfeed.tech/tags/directory.md>), [domains](<https://devfeed.tech/tags/domains.md>), [effects](<https://devfeed.tech/tags/effects.md>), [enhancement](<https://devfeed.tech/tags/enhancement.md>), [expression](<https://devfeed.tech/tags/expression.md>), [field](<https://devfeed.tech/tags/field.md>), [gpt](<https://devfeed.tech/tags/gpt.md>), [gpt-6-1-sol](<https://devfeed.tech/tags/gpt-6-1-sol.md>), [gpt-6-luna](<https://devfeed.tech/tags/gpt-6-luna.md>), [graph](<https://devfeed.tech/tags/graph.md>), [graphs](<https://devfeed.tech/tags/graphs.md>), [impact](<https://devfeed.tech/tags/impact.md>), [imperative](<https://devfeed.tech/tags/imperative.md>)

### AI overview

In controlled executable workflows, field-level dependency graphs extracted from agent read traces reduce the decisions reviewed and estimated total cost, but can miss alternative supports or repair context and thereby lower complete-plan correctness. Across 120 workflows, the study compares these graphs with full recomputation, rolling summaries, lexical retrieval, and verified dependency upper bounds; it also tests edge and context ablations. In a fresh set of 60 workflows, adding a record ID/field directory during graph extraction--without exposing unread values or reference edges--matched full-context correctness for gpt-6.1-sol (100%) with an estimated 4.0% cost reduction, while gpt-6-luna reached 84.8% versus 99.6%. The authors distinguish potential dependency impact from actual decision invalidity and caution that results on explicit procedural workflows do not establish generalization to real-world agent memory.

### Source excerpt

arXiv:2611.19859v1 Announce Type: new Abstract: When an observed fact changes, an agent must identify and repair the decisions that depend on it while preserving unaffected outputs. We investigate the reliability-cost trade-off of field-level dependency graphs extracted from actual agent read traces. A controlled benchmark spans three executable workflow domains and four successive updates, with independent imperative and expression-based references. Across 120 workflows, two models and two repeated runs, we compare full recomputation, rolling summary memory, lexical retrieval, trace-extracted dependencies and verified dependency upper bounds. Trace-derived graphs reduce reviewed decisions and estimated total cost, but omitted alternative supports and missing repair context can reduce complete-plan correctness. Paired ablations isolate the effects of edge deletion, spurious edges, transitive propagation and context scope. An exploratory enhancement supplies the existing record ID/field directory during extraction without revealing unread values or reference edges. We evaluate this enhancement on 60 fresh workflows with two repeats per model. On this fresh set, the directory-aware graph matches observed full-context complete-plan correctness for gpt-6.1-sol (100%) with an estimated 4.0% total-cost reduction, but reaches only 84.8% versus 99.6% for gpt-6-luna. The results distinguish potential dependency impact from actual decision invalidity and show why selective repair must be evaluated with both executable correctness and full memory-processing cost. The evidence concerns explicit procedural workflows; broad real-world agent-memory generalization remains untested.

## Editable Video Context: Mid-Context KV-Cache Reuse for Context-Managing Video LLMs

DevFeed: [Editable Video Context: Mid-Context KV-Cache Reuse for Context-Managing Video LLMs](<https://devfeed.tech/articles/editable-video-context-mid-context-kv-cache-reuse-for-context-managing-video-llms-137331.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.18718>)

Author: Dayu Wang, Shasha Xu

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Cache](<https://devfeed.tech/topics/cache.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [context window](<https://devfeed.tech/topics/context-window.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [context](<https://devfeed.tech/tags/context.md>), [context-language-models](<https://devfeed.tech/tags/context-language-models.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [kv-cache](<https://devfeed.tech/tags/kv-cache.md>), [llms](<https://devfeed.tech/tags/llms.md>), [reuse](<https://devfeed.tech/tags/reuse.md>), [video](<https://devfeed.tech/tags/video.md>)

### AI overview

The method speeds up rebuilding a video LLM's context after selecting segments for closer inspection. It represents long videos as timestamped segments, samples them sparsely, then decodes selected segments at 4x frame rate and removes the rest. For Qwen2.5-VL, it reuses surviving segments' KV cache by rotating keys with one shared offset across M-RoPE's temporal, height, and width components; a content-hashed cache also avoids repeating vision-encoder work. Preliminary Qwen2.5-VL-7B tests on synthetic questions over public-domain films found fewer prefill tokens and lower rebuild latency than full recomputation, usually with the same answer. Densifying a known answer segment improved accuracy, but model-selected densification did not: the model rarely found details missing from its sparse sample. These results are preliminary and limited to the described setup.

### Source excerpt

arXiv:2611.18718v1 Announce Type: cross Abstract: Context Language Models let a model edit its own context, while Suffix Cache Reuse makes edits to text efficient by adjusting the positions of cached keys for surviving tokens. We extend these ideas to video language models with multimodal rotary position embeddings (M-RoPE). We represent a long video as timestamped segments. After viewing a sparsely sampled version, the model selects segments for decoding at 4x the frame rate, and the remaining segments are removed from its context. Our rebuild method reuses the KV cache of surviving segments by rotating their keys with a single offset shared by the temporal, height, and width components of Qwen2.5-VL's M-RoPE. A content-hashed cache also avoids repeating vision-encoder computation for those segments. In preliminary experiments with Qwen2.5-VL-7B on synthetic needle-in-a-video-haystack questions over public-domain films, the method reduces prefill tokens and end-to-end rebuild latency relative to full recomputation while usually producing the same answer. Densifying the segment containing the answer improves accuracy when that segment is known. When the model selects segments itself, accuracy does not improve: it rarely identifies a needle that was absent from the sparse sample. We release the code, raw logs, and scripts used to reproduce the paper's results.

## Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context

DevFeed: [Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context](<https://devfeed.tech/articles/alibaba-releases-qwen4-max-2-4t-moe-71b-active-1m-context-136412.md>)

Original publisher: [Read original article](<https://www.marktechpost.com/2026/11/16/alibaba-qwen4-max-release/>)

Author: Asif Razzaq

Published: 2026-11-16T09:44:17Z

Content type: release

Language: en

Sources: [MarkTechPost](<https://devfeed.tech/sources/marktechpost.md>)

Topics: [qwen](<https://devfeed.tech/topics/qwen.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>)

Tags: [1-5](<https://devfeed.tech/tags/1-5.md>), [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [about](<https://devfeed.tech/tags/about.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-shorts](<https://devfeed.tech/tags/ai-shorts.md>), [alibaba](<https://devfeed.tech/tags/alibaba.md>), [applications](<https://devfeed.tech/tags/applications.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [context](<https://devfeed.tech/tags/context.md>), [context-engineering](<https://devfeed.tech/tags/context-engineering.md>), [cost](<https://devfeed.tech/tags/cost.md>), [editors-pick](<https://devfeed.tech/tags/editors-pick.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [first](<https://devfeed.tech/tags/first.md>), [for-devs](<https://devfeed.tech/tags/for-devs.md>), [harness](<https://devfeed.tech/tags/harness.md>), [input](<https://devfeed.tech/tags/input.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [max](<https://devfeed.tech/tags/max.md>), [model](<https://devfeed.tech/tags/model.md>), [moe](<https://devfeed.tech/tags/moe.md>), [new-releases](<https://devfeed.tech/tags/new-releases.md>), [parameter](<https://devfeed.tech/tags/parameter.md>), [qwen4-max](<https://devfeed.tech/tags/qwen4-max.md>), [releases](<https://devfeed.tech/tags/releases.md>), [staff](<https://devfeed.tech/tags/staff.md>), [tech-news](<https://devfeed.tech/tags/tech-news.md>), [technology](<https://devfeed.tech/tags/technology.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [vision](<https://devfeed.tech/tags/vision.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Alibaba's Qwen4-Max is a hosted-only proprietary MoE model with a 2.4T-parameter backbone, 71B active parameters per token, multimodal input, and a 1M-token context. Its design pairs Qwen Sparse Attention with Gated DeltaNet layers, adds gated residual branches, and includes 328B N-gram Embedding parameters. In Alibaba's 16-benchmark comparison, it ranks first on four, including legal-agent work, while lagging on coding and vision measures such as ProgramBench and Chartography; scores were not independently reproduced at launch. Alibaba reports a 62% reduction in average Work360 cost per task, from $4.43 to $1.67, alongside lower API prices ($1.50/M input and $4.50/M output). Access is through Alibaba services and API; there are no open weights or self-hosting option.

### Source excerpt

Alibaba released Qwen4-Max, a proprietary 2.4T-parameter MoE model with 71B active parameters, native vision and a 1M-token context. It costs $1.5/M input tokens and cuts Work360 cost per task by 62%. The post Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context appeared first on MarkTechPost.

## Qwen4-Max now available on AI Gateway

DevFeed: [Qwen4-Max now available on AI Gateway](<https://devfeed.tech/articles/qwen4-max-now-available-on-ai-gateway-134730.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/qwen4-max-now-available-on-ai-gateway>)

Author: Zachary Chen

Published: 2026-11-15T20:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [qwen](<https://devfeed.tech/topics/qwen.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [MSP MCP](<https://devfeed.tech/topics/msp-mcp.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [Memory Safety](<https://devfeed.tech/topics/memory-safety.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [access-control](<https://devfeed.tech/tags/access-control.md>), [agent-tasks](<https://devfeed.tech/tags/agent-tasks.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [alibaba](<https://devfeed.tech/tags/alibaba.md>), [animation](<https://devfeed.tech/tags/animation.md>), [blender](<https://devfeed.tech/tags/blender.md>), [bring-your-own-key](<https://devfeed.tech/tags/bring-your-own-key.md>), [build](<https://devfeed.tech/tags/build.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [cli](<https://devfeed.tech/tags/cli.md>), [code](<https://devfeed.tech/tags/code.md>), [codex](<https://devfeed.tech/tags/codex.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [context](<https://devfeed.tech/tags/context.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [qwen4-max](<https://devfeed.tech/tags/qwen4-max.md>)

### AI overview

Alibaba's Qwen4-Max is available through AI Gateway as a reasoning model with native vision and a 1M-token context window. The supplied text says it can use visual feedback to refine Blender scenes and games built in Unity, Unreal Engine, or Godot; call MCP tools and process document and image collections for professional work; and deliver an early version of long-running tasks for review before making successive improvements. Alibaba is open-sourcing a Live Delivery plugin for this workflow. Compared with prior Qwen Max models, it is claimed to use fewer tokens for the same tasks and produce more secure code, with fewer injection, memory safety, and access control vulnerabilities. Use the model name `alibaba/qwen4-max`; setup for Claude Code, Codex, Cursor, and other agents uses the latest Vercel CLI. AI Gateway offers usage and cost tracking, retries, failover, and other routing features, with provider pricing, no markup, and no inference platform fee, including for BYOK requests.

### Source excerpt

Qwen4-Max from Alibaba is now available on AI Gateway. It is the first model in the Qwen4 series: a reasoning model with native vision and a 1M-token context window, built for coding, professional work, and long-running agent tasks. Qwen4-Max is better at working with professional tools. It can build 3D scenes in Blender and playable games in Unity, Unreal Engine, and Godot, running what it builds and using visual feedback to fix camera, animation, and lighting issues. For finance, legal, and healthcare work, it can call many MCP tools, work through large sets of documents and images, and produce spreadsheets, slide decks, and reports that cite their sources. For long-running tasks, the model delivers a usable first version early and then improves it in successive releases, so you can review progress and change direction before the work is finished. Alibaba is open-sourcing a Live Delivery plugin for this workflow. Compared with prior Qwen Max models, Qwen4-Max uses fewer tokens to complete the same tasks and writes more secure code by default, with fewer injection, memory safety, and access control vulnerabilities. Use alibaba/qwen4-max as the model name: To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup: Then select alibaba/qwen4-max in the agent. See the coding agents guide for details. Try Qwen4-Max in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. You can view all language models available on AI Gateway. Read more

## The Other Kind of Context Rot: How Source Rot Corrupts LLM Performance Before Inference Even Begins

DevFeed: [The Other Kind of Context Rot: How Source Rot Corrupts LLM Performance Before Inference Even Begins](<https://devfeed.tech/articles/the-other-kind-of-context-rot-how-source-rot-corrupts-llm-performance-before-inference-even-begins-133883.md>)

Original publisher: [Read original article](<https://montecarlo.ai/blog-the-other-kind-of-context-rot-how-source-rot>)

Author: Barr Moses

Published: 2026-11-14T00:02:53Z

Content type: article

Language: en

Sources: [Monte Carlo](<https://devfeed.tech/sources/monte-carlo.md>)

Topics: [context window](<https://devfeed.tech/topics/context-window.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [LLM observability](<https://devfeed.tech/topics/llm-observability.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [llamaindex](<https://devfeed.tech/topics/llamaindex.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-memory](<https://devfeed.tech/tags/agent-memory.md>), [agent-trust](<https://devfeed.tech/tags/agent-trust.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agents](<https://devfeed.tech/tags/agents.md>), [context-rot](<https://devfeed.tech/tags/context-rot.md>), [failure](<https://devfeed.tech/tags/failure.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [llm](<https://devfeed.tech/tags/llm.md>), [performance](<https://devfeed.tech/tags/performance.md>), [source](<https://devfeed.tech/tags/source.md>)

### AI overview

The article argues that agents can fail before inference when retrieved data is stale, corrupted, schema-drifted, or conflicting ("source rot"); prompt compaction and reranking cannot fix bad upstream inputs. It distinguishes this from context-window decay and describes how source errors can recur across retrievals and persist in long-term memory. It cites examples of conflicting airline policy sources, faulty inputs degrading Unity ad targeting, and an AI Overview repeating an old Reddit joke. Suggested safeguards are to attach freshness timestamps and validation status to retrieved data and enforce freshness SLAs; block downstream execution on schema drift; use TTLs and mark or prune superseded memory; and monitor source-data health and freshness alongside model traces. The article reports that the STALE benchmark's top model scored 55% overall, and presents a 2026 practitioner survey in which 64% named context and data quality as their biggest visibility blind spot.

### Source excerpt

Every developer working with large language models has learned to fear context degradation. This manifests when an agent, which started off sharp, gradually loses the thread as a conversation lengthens, forgetting instructions, fixating on irrelevant details, and eventually hallucinating altogether. The industry has given this failure mode a name many practitioners are now aware of: ...

## The context problem: It's what's really breaking AI agents at scale

DevFeed: [The context problem: It's what's really breaking AI agents at scale](<https://devfeed.tech/articles/the-context-problem-it-s-what-s-really-breaking-ai-agents-at-scale-132591.md>)

Original publisher: [Read original article](<https://thenewstack.io/elastic-ai-context-gap/>)

Author: Alex Wilhelm

Published: 2026-11-13T18:15:22Z

Content type: news

Language: en

Sources: [The New Stack](<https://devfeed.tech/sources/the-new-stack.md>)

Topics: [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Frontier AI](<https://devfeed.tech/topics/frontier-ai.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-context](<https://devfeed.tech/tags/ai-context.md>), [automation](<https://devfeed.tech/tags/automation.md>), [autonomy](<https://devfeed.tech/tags/autonomy.md>), [context](<https://devfeed.tech/tags/context.md>), [data](<https://devfeed.tech/tags/data.md>), [elastic](<https://devfeed.tech/tags/elastic.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [index](<https://devfeed.tech/tags/index.md>), [information](<https://devfeed.tech/tags/information.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-servers](<https://devfeed.tech/tags/mcp-servers.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [model](<https://devfeed.tech/tags/model.md>), [modern](<https://devfeed.tech/tags/modern.md>), [podcast](<https://devfeed.tech/tags/podcast.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [sponsor-elastic](<https://devfeed.tech/tags/sponsor-elastic.md>), [sponsored](<https://devfeed.tech/tags/sponsored.md>), [sponsored-podcast](<https://devfeed.tech/tags/sponsored-podcast.md>), [video](<https://devfeed.tech/tags/video.md>)

### AI overview

The context gap can make enterprise AI agents slow and costly: connecting a company's data through MCP does not ensure useful context, and placing the whole corpus in a model's context window is described as computationally expensive and slow. Elastic executive Sri Desikan proposes pre-conforming enterprise data into an AI index that records where information is stored and how it relates. Agents could then retrieve relevant information faster with lower token use; the index can also help exclude stale information. The excerpt flags privacy and agent autonomy as concerns but does not detail their treatment.

### Source excerpt

AI models are getting smarter, tokens are getting cheaper, and agents are improving. But the context gap sits between the The post The context problem: It's what's really breaking AI agents at scale appeared first on The New Stack.

## Keyword Search Tied an 8B Embedding Model at Picking Agent Tools

DevFeed: [Keyword Search Tied an 8B Embedding Model at Picking Agent Tools](<https://devfeed.tech/articles/keyword-search-tied-an-8b-embedding-model-at-picking-agent-tools-132593.md>)

Original publisher: [Read original article](<https://towardsdatascience.com/keyword-search-tied-an-8b-embedding-model-at-picking-agent-tools/>)

Author: Ankur Tomar

Published: 2026-11-13T16:30:00Z

Content type: article

Language: en

Sources: [Towards Data Science](<https://devfeed.tech/sources/towards-data-science.md>)

Topics: [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [Local AI](<https://devfeed.tech/topics/local-ai.md>), [hybrid-search](<https://devfeed.tech/topics/hybrid-search.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-tools](<https://devfeed.tech/tags/agent-tools.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [bm25](<https://devfeed.tech/tags/bm25.md>), [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-opus](<https://devfeed.tech/tags/claude-opus.md>), [claude-opus-5](<https://devfeed.tech/tags/claude-opus-5.md>), [code](<https://devfeed.tech/tags/code.md>), [code-style](<https://devfeed.tech/tags/code-style.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [embedding-model](<https://devfeed.tech/tags/embedding-model.md>), [information-retrieval](<https://devfeed.tech/tags/information-retrieval.md>), [llm-agents](<https://devfeed.tech/tags/llm-agents.md>), [model](<https://devfeed.tech/tags/model.md>), [rag](<https://devfeed.tech/tags/rag.md>), [search](<https://devfeed.tech/tags/search.md>), [tool](<https://devfeed.tech/tags/tool.md>), [tool-calling](<https://devfeed.tech/tags/tool-calling.md>), [tools](<https://devfeed.tech/tags/tools.md>)

### AI overview

In a 200-question ToolRet experiment using up to 3,794 code-category tools, every retrieval method lost accuracy as the catalogue grew. At the largest size, BM25, BGE-large, Qwen3-Embedding-8B, and a reranking pipeline scored similarly; BM25 was about 40 times faster than BGE-large and needed no GPU. BM25 tokenization must split code-style tool names on underscores and capitals. Using full tool documentation improved BM25 and BGE-large by roughly 0.02-0.04 nDCG; BM25 with full documentation scored 0.533 at about a millisecond per question, though Qwen3-8B and reranking were not tested with full docs. Reranking increased Recall@10 but usually lowered nDCG, suggesting it found more relevant tools without ordering them as well. Prompting with the entire catalogue was too slow to evaluate at scale and exceeded Gemma 3's context window beyond about 2,500 trimmed tool descriptions. Even the best setup included every needed tool in its top ten on only 65% of tasks. Results are limited by 200 questions and a code-focused category that may favor keyword matching.

### Source excerpt

On 200 ToolRet questions and up to 3,794 tools, BM25 ran about 40x faster than BGE-large on just a CPU, and full tool docs made it the best setup tested. The post Keyword Search Tied an 8B Embedding Model at Picking Agent Tools appeared first on Towards Data Science.

## Where in the Input Does a One-Pass Decision Encoder Look?

DevFeed: [Where in the Input Does a One-Pass Decision Encoder Look?](<https://devfeed.tech/articles/where-in-the-input-does-a-one-pass-decision-encoder-look-132241.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.16477>)

Author: Mohammed Nayeem Khan, Allan Kevin T

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [context window](<https://devfeed.tech/topics/context-window.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [checkpoint](<https://devfeed.tech/tags/checkpoint.md>), [confidence](<https://devfeed.tech/tags/confidence.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [flag](<https://devfeed.tech/tags/flag.md>), [laya](<https://devfeed.tech/tags/laya.md>), [model](<https://devfeed.tech/tags/model.md>), [multiple](<https://devfeed.tech/tags/multiple.md>), [name](<https://devfeed.tech/tags/name.md>), [offset](<https://devfeed.tech/tags/offset.md>), [options](<https://devfeed.tech/tags/options.md>), [question](<https://devfeed.tech/tags/question.md>), [sequence](<https://devfeed.tech/tags/sequence.md>), [small](<https://devfeed.tech/tags/small.md>), [tasks](<https://devfeed.tech/tags/tasks.md>), [test](<https://devfeed.tech/tags/test.md>), [text](<https://devfeed.tech/tags/text.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [training](<https://devfeed.tech/tags/training.md>), [window](<https://devfeed.tech/tags/window.md>)

### AI overview

Laya's one-pass decisions are near guessing when the evidence is cut off, and confidence does not reliably signal that it was missed. Even visible evidence is harder to use when distractor text comes first: the released checkpoint scored 38.5% in that setting versus 60% when evidence came first. A larger window alone improved results by 6.2 points; long-document fine-tuning improved visible-evidence accuracy by 27.6 points over short-row fine-tuning, but did not help when evidence was cut off. A training-free scan of 312-token windows gave the released checkpoint an 11.9-point gain at the cost of six to eleven forward passes. Results come from synthetic documents, LLM-made labels, and one model backbone; the fine-tuning gains were smaller with unseen encyclopedic filler and negative with rows from other tasks.

### Source excerpt

arXiv:2611.16477v1 Announce Type: cross Abstract: Laya is a small model that answers a multiple-choice question about a text in one pass: the question, the options (each with a name and a description) and the text form one sequence of at most 512 tokens, the window, in the English release. A longer text is silently cut at the end, and we measure what that costs. Test documents place a held-out row's text, the evidence, at a chosen token offset among distractor text; 177 items, five tasks, three checkpoints (released, short-row fine-tune, long-document fine-tune), four window sizes and 93,275 scored requests. When the evidence lies beyond the window, accuracy falls to 26.4% for the released checkpoint (27.2% for both fine-tunes), near the 27.0% of guessing and below the 35.6% of always giving the commonest label. Confidence gives no warning (AUROC 0.50 to 0.55 for telling cut from read requests; 0.5 = chance), and the runtime's truncation flag also fires on requests whose evidence was visible. The released checkpoint reads visible evidence badly once text precedes it: 38.5% pooled against 60% when the evidence comes first, so a larger window alone gains +6.2 points. Fine-tuning on long documents adds +27.6 points on visible evidence over the short-row fine-tune (95% interval +22.3 to +33.1) and nothing on cut evidence. That is an in-family result: training rows and test documents share generator and question types, and the main filler is of the training kind. With encyclopedic filler never seen in training the gain is +13.2 (+9.9 to +16.6), with rows of other tasks as filler -2.0. Among training-free rearrangements a 312-token window scan helps most (+11.9 points over the default for the released checkpoint) at six to eleven forward passes. Documents are synthetic, labels are LLM-made and one backbone is studied, so these diagnose this model, not long documents in general.

## Folio: Recoverable Multi-Resolution Context Folding for Long-Horizon Language Agents

DevFeed: [Folio: Recoverable Multi-Resolution Context Folding for Long-Horizon Language Agents](<https://devfeed.tech/articles/folio-recoverable-multi-resolution-context-folding-for-long-horizon-language-agents-132262.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.16627>)

Author: Yubo Ruan, Tao Peng, Jiao Zhang, Chuanguo Ma, Lei Xu, Han Zhou, Wenwu Wang, Xiafei Lv, Xingjie Zhou, Guiju Fan, Hao Wang, Fenghui Zhang, Mao Miao, Shuo Li

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Agent Harness](<https://devfeed.tech/topics/agent-harness.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [bench](<https://devfeed.tech/tags/bench.md>), [bounded](<https://devfeed.tech/tags/bounded.md>), [budget](<https://devfeed.tech/tags/budget.md>), [cache](<https://devfeed.tech/tags/cache.md>), [call](<https://devfeed.tech/tags/call.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [code](<https://devfeed.tech/tags/code.md>), [codex](<https://devfeed.tech/tags/codex.md>), [compaction](<https://devfeed.tech/tags/compaction.md>), [compute](<https://devfeed.tech/tags/compute.md>), [context](<https://devfeed.tech/tags/context.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [folding](<https://devfeed.tech/tags/folding.md>), [horizon](<https://devfeed.tech/tags/horizon.md>), [language](<https://devfeed.tech/tags/language.md>)

### AI overview

Folio manages long agent histories by recording three linked views: model-written turn notes (L1), a runtime-written manifest of every call (L2), and captured source records (L3). It folds context programmatically, using coarser views for older turns and printing handles that recovery tools can use to inspect bounded pages, compute over source files, and preserve findings in a dossier. Its trigger estimates an explicit landing point that includes the retained budget. On 75 LOCA-bench tasks, with DeepSeek-V4-Pro behind every system, Folio solved 66 tasks versus 54 for the same runtime using model-written compaction and 49-59 for Claude Code, Codex, and SoL-Pi. The abstract reports about half the working time, 2.4 times lower cost than the same runtime, and a median fold time of 0.6 seconds.

### Source excerpt

arXiv:2611.16627v1 Announce Type: new Abstract: Long-horizon language agents accumulate tool results and replies until the history no longer fits the context window. Current agents shrink this history by having a model summarize it, so each compaction rereads and rewrites the history it replaces, and cache-aware triggers decide when to compact while taking the size of the result as given. We present Folio, a context manager that records, folds, and recovers history through one set of handles. While the agent runs, Folio records three linked levels: a short turn note the model writes as part of its ordinary reply (L1), an event manifest of every call written by the runtime (L2), and the captured source records (L3). Because these views already exist, the runtime folds the context programmatically, selecting coarser views for older turns. The fold prints the handles that index L2 and L3, so recovery tools that read bounded pages, compute over full text in files, and keep findings in a persistent dossier reach the evidence the agent needs with little added input. The fold trigger prices an explicit landing point that includes the retained budget. On 75 LOCA-bench tasks with DeepSeek-V4-Pro behind every system, Folio solves 66 tasks against 54 for the same runtime with model-written compaction and 49-59 for Claude Code, Codex, and SoL-Pi, in about half their working time, at 2.4 times lower cost than that runtime; each fold takes a median of 0.6 seconds.

[Next page](<https://devfeed.tech/topics/context-window.md?cursor=WyIyMDI2LTExLTEzVDA1OjAwOjAwKzAwOjAwIiwgImEyNDMwYjQ5LWI0MmUtNDhmOC04MjY3LWRhZWYwOTFiMTAyMyJd>)