# Routing

Published articles for Routing.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## MCP went stateless: What changed in the 2026-07-28 spec

DevFeed: [MCP went stateless: What changed in the 2026-07-28 spec](<https://devfeed.tech/articles/mcp-went-stateless-what-changed-in-the-2026-07-28-spec-31436.md>)

Original publisher: [Read original article](<https://workos.com/blog/mcp-stateless-spec-2026-07-28>)

Author: WorkOS

Published: 2026-09-16T00:00:00Z

Content type: article

Language: en

Sources: [WorkOS Blog](<https://devfeed.tech/sources/workos-blog.md>)

Topics: [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [migration](<https://devfeed.tech/topics/migration.md>), [HTTP](<https://devfeed.tech/topics/http.md>), [servers](<https://devfeed.tech/topics/servers.md>), [client](<https://devfeed.tech/topics/client.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [client](<https://devfeed.tech/tags/client.md>), [http](<https://devfeed.tech/tags/http.md>), [load-balancer](<https://devfeed.tech/tags/load-balancer.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [replacement](<https://devfeed.tech/tags/replacement.md>), [request](<https://devfeed.tech/tags/request.md>), [routing](<https://devfeed.tech/tags/routing.md>), [server](<https://devfeed.tech/tags/server.md>), [servers](<https://devfeed.tech/tags/servers.md>), [sessions](<https://devfeed.tech/tags/sessions.md>), [stateless](<https://devfeed.tech/tags/stateless.md>), [stream](<https://devfeed.tech/tags/stream.md>)

### AI overview

The 2026-07-28 MCP specification removes protocol-level sessions, the initialize handshake, and stream resumability, making the protocol behave more like an ordinary HTTP API. Most migrations are mechanical, but lost stream requests can cause reliability regressions or duplicated side effects when retried, so side-effecting tools need application-level idempotency keys. The elicitation change also requires architectural rework.

### Source excerpt

Sessions, the initialize handshake, and stream resumability are all gone. Here is what replaced them, and what breaks if you ignore it.

## Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each

DevFeed: [Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each](<https://devfeed.tech/articles/dense-vs-moe-models-active-parameters-throughput-and-when-to-choose-each-26912.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/dense-vs-moe-models-active-parameters-throughput-and-when-to-choose-each/>)

Author: Elizabeth Goodman

Published: 2026-09-15T17:00:11Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [llms](<https://devfeed.tech/tags/llms.md>), [memory](<https://devfeed.tech/tags/memory.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [models](<https://devfeed.tech/tags/models.md>), [moe](<https://devfeed.tech/tags/moe.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [performance](<https://devfeed.tech/tags/performance.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This article explains how dense and Mixture-of-Experts models activate parameters, compares their effects on throughput, memory cost, and serving complexity, and discusses when each architecture fits different deployment constraints. It uses Nemotron 3.5 Lightning as an example of an MoE model.

### Source excerpt

How can a 30B-parameter model activate only 3B parameters per token, and still use the capacity of the larger model? Nemotron 3.5 Lightning illustrates the...

## Replica-aware routing public beta

DevFeed: [Replica-aware routing public beta](<https://devfeed.tech/articles/replica-aware-routing-public-beta-26967.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/replica-aware-routing-public-beta>)

Author: Amy Chen; Jan Mensch

Published: 2026-09-15T13:15:00Z

Content type: release

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [Replication](<https://devfeed.tech/topics/replication.md>), [Caching](<https://devfeed.tech/topics/caching.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [replication](<https://devfeed.tech/tags/replication.md>), [routing](<https://devfeed.tech/tags/routing.md>)

### AI overview

ClickHouse introduces replica-aware routing in Public Beta for Enterprise customers. The feature routes requests to the same replica, allowing continued access to temporary tables and named sessions and supporting read-after-write consistency over HTTP or the native protocol.

### Source excerpt

Temporary tables and named sessions live on a single ClickHouse replica, so a follow-up query routed elsewhere can't see them. Replica-aware routing pins your requests to the same replica over HTTP or the native protocol -- and here's how we built it.

## Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine

DevFeed: [Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine](<https://devfeed.tech/articles/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine-21079.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine/>)

Author: Tanya Lenz

Published: 2026-09-14T16:39:15Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [Network](<https://devfeed.tech/topics/network.md>), [Python](<https://devfeed.tech/topics/python.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>), [mixtral](<https://devfeed.tech/topics/mixtral.md>), [qwen](<https://devfeed.tech/topics/qwen.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [communication](<https://devfeed.tech/tags/communication.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [mixtral](<https://devfeed.tech/tags/mixtral.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [moe](<https://devfeed.tech/tags/moe.md>), [networks](<https://devfeed.tech/tags/networks.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [performance](<https://devfeed.tech/tags/performance.md>), [python](<https://devfeed.tech/tags/python.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tensors](<https://devfeed.tech/tags/tensors.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>)

### AI overview

This article explains how NVIDIA Transformer Engine and JAX kernel optimizations accelerate dropless Mixture of Experts (MoE) training. It describes bottlenecks from token routing, expert dispatch and gathering, all-to-all communication, and ragged expert matrix operations. In DeepSeek-V3 training on NVIDIA GB200, the optimized approach increased performance from 103 to 1,068 TFLOPS per GPU, a 10.4x improvement.

### Source excerpt

Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE...

## Chinese AI models dominate OpenRouter's US token consumption. It can now guarantee that traffic stays entirely in the US.

DevFeed: [Chinese AI models dominate OpenRouter's US token consumption. It can now guarantee that traffic stays entirely in the US.](<https://devfeed.tech/articles/chinese-ai-models-dominate-openrouter-s-us-token-consumption-it-can-now-guarantee-that-traffic-stays-entirely-in-the-us-21599.md>)

Original publisher: [Read original article](<https://thenewstack.io/openrouter-us-region-routing/>)

Author: Paul Sawers

Published: 2026-09-14T13:59:33Z

Content type: news

Language: en

Sources: [The New Stack](<https://devfeed.tech/sources/the-new-stack.md>)

Topics: [AI Models](<https://devfeed.tech/topics/ai-models.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [Security](<https://devfeed.tech/topics/security.md>), [data](<https://devfeed.tech/topics/data.md>), [Availability](<https://devfeed.tech/topics/availability.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [availability](<https://devfeed.tech/tags/availability.md>), [data](<https://devfeed.tech/tags/data.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [models](<https://devfeed.tech/tags/models.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [openai](<https://devfeed.tech/tags/openai.md>), [routing](<https://devfeed.tech/tags/routing.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

OpenRouter has launched US in-region routing for business and enterprise customers. Requests sent through its US endpoint are decrypted, processed, and served entirely inside the United States, or rejected if that cannot be guaranteed. The feature addresses concerns about data location when businesses use open-weight models, including models developed in China.

### Source excerpt

Everyone knows the open-weight model pitch by now: companies can download the weights, customize them, run them on infrastructure of The post Chinese AI models dominate OpenRouter's US token consumption. It can now guarantee that traffic stays entirely in the US. appeared first on The New Stack.

## Solana: Building, Proving and Earning Trust in Public

DevFeed: [Solana: Building, Proving and Earning Trust in Public](<https://devfeed.tech/articles/solana-building-proving-and-earning-trust-in-public-17467.md>)

Original publisher: [Read original article](<https://solana.com/news/solana-building-trust-in-public>)

Author: Jacob Creech

Published: 2026-09-14T11:00:00Z

Content type: article

Language: en

Sources: [Solana News Feed](<https://devfeed.tech/sources/solana-news-feed.md>)

Topics: [Network](<https://devfeed.tech/topics/network.md>), [Critical Infrastructure](<https://devfeed.tech/topics/critical-infrastructure.md>), [incident](<https://devfeed.tech/topics/incident.md>), [networking](<https://devfeed.tech/topics/networking.md>), [Transactions](<https://devfeed.tech/topics/transactions.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [aws](<https://devfeed.tech/tags/aws.md>), [blockchain](<https://devfeed.tech/tags/blockchain.md>), [blockchain-technology](<https://devfeed.tech/tags/blockchain-technology.md>), [building](<https://devfeed.tech/tags/building.md>), [critical-infrastructure](<https://devfeed.tech/tags/critical-infrastructure.md>), [crypto](<https://devfeed.tech/tags/crypto.md>), [crypto-news](<https://devfeed.tech/tags/crypto-news.md>), [cryptocurrency](<https://devfeed.tech/tags/cryptocurrency.md>), [defi](<https://devfeed.tech/tags/defi.md>), [ecosystem](<https://devfeed.tech/tags/ecosystem.md>), [incident](<https://devfeed.tech/tags/incident.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [network](<https://devfeed.tech/tags/network.md>), [nfts](<https://devfeed.tech/tags/nfts.md>), [outages](<https://devfeed.tech/tags/outages.md>), [podcasts](<https://devfeed.tech/tags/podcasts.md>), [routing](<https://devfeed.tech/tags/routing.md>), [solana](<https://devfeed.tech/tags/solana.md>), [solana-ecosystem](<https://devfeed.tech/tags/solana-ecosystem.md>), [technology](<https://devfeed.tech/tags/technology.md>), [transactions](<https://devfeed.tech/tags/transactions.md>), [uptime](<https://devfeed.tech/tags/uptime.md>), [web3](<https://devfeed.tech/tags/web3.md>)

### AI overview

Solana describes how repeated public testing, transparent incident reporting, and corrective engineering have strengthened trust in the network. It highlights a 2026 routing failure that took nearly 29% of network stake offline while blocks and transactions continued, followed by recovery of the infrastructure provider in just over 30 minutes. The article also cites validator capacity improvements, stake-weighted quality of service, and a redesigned transaction scheduler as examples of resilience work.

### Source excerpt

Solana has maintained 100% uptime since February 2024, including when a routing failure took nearly 29% of network stake offline.

## M5Stack Module13.2 LoRa-1262 expansion board integrates 14x10 mm Stamp LoRa-1262 module

DevFeed: [M5Stack Module13.2 LoRa-1262 expansion board integrates 14x10 mm Stamp LoRa-1262 module](<https://devfeed.tech/articles/m5stack-module13-2-lora-1262-expansion-board-integrates-14-10-mm-stamp-lora-1262-module-14042.md>)

Original publisher: [Read original article](<https://www.cnx-software.com/2026/09/13/m5stack-module13-2-lora-1262-expansion-board-integrates-14x10-mm-stamp-lora-1262-module/>)

Author: Debashis Das

Published: 2026-09-13T05:02:54Z

Content type: news

Language: en

Sources: [CNX Software - Embedded Systems News](<https://devfeed.tech/sources/cnx-software-embedded-systems-news.md>)

Topics: [lora](<https://devfeed.tech/topics/lora.md>), [systems](<https://devfeed.tech/topics/systems.md>)

Tags: [connectivity](<https://devfeed.tech/tags/connectivity.md>), [development-board](<https://devfeed.tech/tags/development-board.md>), [embedded-systems](<https://devfeed.tech/tags/embedded-systems.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [i2c](<https://devfeed.tech/tags/i2c.md>), [io](<https://devfeed.tech/tags/io.md>), [iot](<https://devfeed.tech/tags/iot.md>), [lora](<https://devfeed.tech/tags/lora.md>), [lorawan](<https://devfeed.tech/tags/lorawan.md>), [low-power](<https://devfeed.tech/tags/low-power.md>), [lpwan](<https://devfeed.tech/tags/lpwan.md>), [m5stack](<https://devfeed.tech/tags/m5stack.md>), [module](<https://devfeed.tech/tags/module.md>), [news](<https://devfeed.tech/tags/news.md>), [power-management](<https://devfeed.tech/tags/power-management.md>), [routing](<https://devfeed.tech/tags/routing.md>), [series](<https://devfeed.tech/tags/series.md>), [smart-agriculture](<https://devfeed.tech/tags/smart-agriculture.md>), [smart-city](<https://devfeed.tech/tags/smart-city.md>), [spi](<https://devfeed.tech/tags/spi.md>), [wireless](<https://devfeed.tech/tags/wireless.md>)

### AI overview

M5Stack has launched the Stamp LoRa-1262 SMD module and the stackable Module13.2 LoRa-1262 expansion board for M5Stack Core controllers. Based on the Semtech SX1262, the module supports several modulation modes across 868-923 MHz, with up to +22 dBm transmit power and -147 dBm receive sensitivity. Module13.2 adds an RP-SMA antenna interface, M5IOE1 I/O expansion, configurable pin routing, and selectable I2C addresses for multi-module stacking.

### Source excerpt

After launching the SX1262-based M5Stamp C6LoRa tiny module, M5Stack has launched two SX1262-based LoRa add-ons for the 868-923 MHz band: the tiny Stamp LoRa-1262 SMD module for custom PCBs, and the stackable Module13.2 LoRa-1262 module for the M5Stack Core series. The Stamp LoRa-1262 supports LoRa, FSK, GFSK, MSK, GMSK, and OOK modulation, with up to +22 dBm transmit power and -147 dBm receive sensitivity. The Module13.2 adds an RP-SMA antenna interface, an M5IOE1 IO expansion chip for reset and power management, and DIP switches for flexible pin routing and configurable I2C addresses, enabling multi-module stacking. Stamp LoRa-1262 SMD module M5Stack Stamp LoRa-1262 specifications: LoRa Transceiver - Semtech SX1262 Wireless Connectivity (LoRa) Frequency Band - 868 to 923 MHz Modulation Modes - LoRa, FSK, GFSK, MSK, GMSK, OOK Bitrate - Up to 300 kbps (programmable) Transmit power (Tx) - Up to +22 dBm Receive sensitivity (Rx) - Down to -147 dBm [...] The post M5Stack Module13.2 LoRa-1262 expansion board integrates 14x10 mm Stamp LoRa-1262 module appeared first on CNX Software - Embedded Systems News.

## Scaling AI Agent Infrastructure with the MCP Stateless updates

DevFeed: [Scaling AI Agent Infrastructure with the MCP Stateless updates](<https://devfeed.tech/articles/scaling-ai-agent-infrastructure-with-the-mcp-stateless-updates-4216.md>)

Original publisher: [Read original article](<https://developers.googleblog.com/scaling-ai-agent-infrastructure-with-the-mcp-stateless-updates/>)

Author: Kurtis Van Gent; Alan Blount

Published: 2026-09-12T11:04:33.891311Z

Content type: release

Language: en

Sources: [Google Developers Blog](<https://devfeed.tech/sources/google-developers-blog.md>)

Topics: [networking](<https://devfeed.tech/topics/networking.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [c-sharp](<https://devfeed.tech/tags/c-sharp.md>), [go](<https://devfeed.tech/tags/go.md>), [http](<https://devfeed.tech/tags/http.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [python](<https://devfeed.tech/tags/python.md>), [routing](<https://devfeed.tech/tags/routing.md>), [sdks](<https://devfeed.tech/tags/sdks.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [typescript](<https://devfeed.tech/tags/typescript.md>), [updates](<https://devfeed.tech/tags/updates.md>)

### AI overview

The MCP release candidate replaces transport-level session management with a stateless core for HTTP load balancing, cloud-native scaling, and serverless deployments. It also introduces routing headers, caching controls, MRTR, and beta SDKs for Python, TypeScript, Go, and C#.

### Source excerpt

The 2026-07-28 Model Context Protocol (MCP) specification replaces legacy stateful constraints with a fully stateless core, enabling cloud-native horizontal scaling, serverless deployments, and standard round-robin load balancing. This architectural shift introduces standardized HTTP headers for efficient routing without deep packet inspection, caching controls, and Multi Round-Trip Requests (MRTR) to handle interactive and long-running tasks without blocking connections. Developers can immediately begin migrating their agentic applications to this highly scalable infrastructure using the newly available beta SDKs for Python, TypeScript, Go, and C#.

## 4 engineering patterns behind the strongest AI Agents Challenge submissions

DevFeed: [4 engineering patterns behind the strongest AI Agents Challenge submissions](<https://devfeed.tech/articles/4-engineering-patterns-behind-the-strongest-ai-agents-challenge-submissions-4200.md>)

Original publisher: [Read original article](<https://developers.googleblog.com/4-engineering-patterns-behind-the-strongest-ai-agents-challenge-submissions/>)

Author: Sergio Villani

Published: 2026-09-12T11:04:33.891311Z

Content type: article

Language: en

Sources: [Google Developers Blog](<https://devfeed.tech/sources/google-developers-blog.md>)

Topics: [AI Bots](<https://devfeed.tech/topics/ai-bots.md>), [MSP MCP](<https://devfeed.tech/topics/msp-mcp.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [cost](<https://devfeed.tech/tags/cost.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [event](<https://devfeed.tech/tags/event.md>), [inference](<https://devfeed.tech/tags/inference.md>), [latency](<https://devfeed.tech/tags/latency.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-server](<https://devfeed.tech/tags/mcp-server.md>), [routing](<https://devfeed.tech/tags/routing.md>), [validation](<https://devfeed.tech/tags/validation.md>)

### AI overview

An article on engineering patterns found in leading AI Agents Challenge submissions. It highlights bidirectional MCP, asynchronous event buses, unified validation for model fallbacks, and tiered routing to make agentic workflows more resilient, faster, and less costly.

### Source excerpt

The recent Google for Startups AI Agents Challenge revealed that the most successful multi-agent systems rely on foundational software engineering patterns rather than just raw model power. Winning architectures consistently implemented bidirectional MCP for seamless inter-agent communication, async event buses for parallel execution, strict unified validation for model fallbacks, and tiered routing to minimize expensive inference calls. By prioritizing these structural practices over simple linear prompt chains, developers can build more resilient, low-latency, and cost-effective agentic workflows.

## Scaling real-time AI agents with session-aware load balancing

DevFeed: [Scaling real-time AI agents with session-aware load balancing](<https://devfeed.tech/articles/scaling-real-time-ai-agents-with-session-aware-load-balancing-4217.md>)

Original publisher: [Read original article](<https://developers.googleblog.com/scaling-real-time-ai-agents-with-session-aware-load-balancing/>)

Author: Simerus Mahesh

Published: 2026-09-12T11:04:33.891311Z

Content type: article

Language: en

Sources: [Google Developers Blog](<https://devfeed.tech/sources/google-developers-blog.md>)

Topics: [real-time](<https://devfeed.tech/topics/real-time.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [Server](<https://devfeed.tech/topics/server.md>), [gRPC](<https://devfeed.tech/topics/grpc.md>), [WebSocket](<https://devfeed.tech/topics/websocket.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [Concurrent Programming](<https://devfeed.tech/topics/concurrent-programming.md>)

Tags: [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [concurrent](<https://devfeed.tech/tags/concurrent.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [routing](<https://devfeed.tech/tags/routing.md>), [server](<https://devfeed.tech/tags/server.md>), [streaming](<https://devfeed.tech/tags/streaming.md>)

### AI overview

This article explains why real-time AI agents require session-aware load balancing. Long-lived, stateful bidirectional streams make request rates and CPU utilization insufficient measures of backend capacity. The proposed approach tracks active sessions at the application level and combines session counts with CPU metrics to distribute traffic and avoid bottlenecks.

### Source excerpt

Real-time AI agents break traditional request-response load balancing paradigms because they rely on long-lived, stateful bidirectional streams that obscure true server capacity. To solve this, developers must implement application-level session tracking directly within the runtime to accurately measure the committed concurrent workload of active conversations. By feeding these precise session counts alongside standard CPU utilization metrics into a hybrid routing algorithm, infrastructure can effectively distribute stateful AI traffic and prevent individual backend bottlenecks.

## Your built-in router VPN might be more trouble than it's worth

DevFeed: [Your built-in router VPN might be more trouble than it's worth](<https://devfeed.tech/articles/your-built-in-router-vpn-might-be-more-trouble-than-it-s-worth-161.md>)

Original publisher: [Read original article](<https://tailscale.com/blog/built-in-router-nas-vpns>)

Author: Andrew Cunningham

Published: 2026-09-11T16:00:00Z

Content type: opinion

Language: en

Sources: [Blog on Tailscale](<https://devfeed.tech/sources/blog-on-tailscale.md>)

Topics: [networking](<https://devfeed.tech/topics/networking.md>), [Networks](<https://devfeed.tech/topics/networks.md>), [Server](<https://devfeed.tech/topics/server.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>)

Tags: [nas](<https://devfeed.tech/tags/nas.md>), [networks](<https://devfeed.tech/tags/networks.md>), [performance](<https://devfeed.tech/tags/performance.md>), [routing](<https://devfeed.tech/tags/routing.md>), [security](<https://devfeed.tech/tags/security.md>), [server](<https://devfeed.tech/tags/server.md>)

### AI overview

The article argues that built-in VPN servers on routers and NAS devices can be unreliable and difficult to use, especially on restrictive networks. It presents Tailscale as a better option for addressing those connection limitations.

### Source excerpt

Built-in VPNs are easy to start--then harder to live with.

## Reduce LLM latency with prefix-aware routing on Amazon SageMaker Inference

DevFeed: [Reduce LLM latency with prefix-aware routing on Amazon SageMaker Inference](<https://devfeed.tech/articles/reduce-llm-latency-with-prefix-aware-routing-on-amazon-sagemaker-inference-4740.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/reduce-llm-latency-with-prefix-aware-routing-on-amazon-sagemaker-inference/>)

Author: Kareem Syed-Mohammed

Published: 2026-09-10T21:58:09Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Low-Latency Inference](<https://devfeed.tech/topics/low-latency-inference.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [caching](<https://devfeed.tech/tags/caching.md>), [inference](<https://devfeed.tech/tags/inference.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tensorrt-llm](<https://devfeed.tech/tags/tensorrt-llm.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

Amazon SageMaker Inference introduces prefix-aware routing for LLM requests. By consistently sending requests with matching prompt prefixes to the same instance, it improves reuse of cached KV computations and can reduce time to first token.

### Source excerpt

Amazon SageMaker Inference now offers prefix-aware routing, a routing strategy that sends requests sharing the same prompt prefix to the same instance so the KV cache stays warm. In benchmarks on Llama 3.1 70B, it reduced P50 time-to-first-token by up to 77% and raised KV cache hit rates from about 25% to over 80%.

## Agent Gateway: The Next Evolution of the API Gateway

DevFeed: [Agent Gateway: The Next Evolution of the API Gateway](<https://devfeed.tech/articles/agent-gateway-the-next-evolution-of-the-api-gateway-12632.md>)

Original publisher: [Read original article](<https://blog.postman.com/agent-gateway-the-next-evolution-of-the-api-gateway/>)

Author: Gbadebo Bello

Published: 2026-09-10T16:00:00Z

Content type: article

Language: en

Sources: [Postman Blog](<https://devfeed.tech/sources/postman-blog.md>)

Topics: [API](<https://devfeed.tech/topics/api.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Architecture & Design](<https://devfeed.tech/topics/architecture-design.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [Authentication](<https://devfeed.tech/topics/authentication.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [observability](<https://devfeed.tech/topics/observability.md>)

Tags: [agent-gateway](<https://devfeed.tech/tags/agent-gateway.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [api](<https://devfeed.tech/tags/api.md>), [api-101](<https://devfeed.tech/tags/api-101.md>), [api-gateway](<https://devfeed.tech/tags/api-gateway.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [editor-s-picks](<https://devfeed.tech/tags/editor-s-picks.md>), [fabric-gateway](<https://devfeed.tech/tags/fabric-gateway.md>), [general](<https://devfeed.tech/tags/general.md>), [llm-gateway](<https://devfeed.tech/tags/llm-gateway.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-gateway](<https://devfeed.tech/tags/mcp-gateway.md>), [observability](<https://devfeed.tech/tags/observability.md>), [routing](<https://devfeed.tech/tags/routing.md>)

### AI overview

The article explains the emergence of the Agent Gateway as an architectural component for AI agents. It contrasts traditional API Gateways, which authenticate, govern, route, and deliver requests from clients that already know which API to call, with the needs of AI agents, which receive goals and may require broader governance across agentic workflows.

### Source excerpt

API gateways are evolving for AI agents. Learn how the agent gateway governs identity, tools, memory, and policy across agentic workflows. Get early access. The post Agent Gateway: The Next Evolution of the API Gateway appeared first on Postman Blog.

## Introducing Neki

DevFeed: [Introducing Neki](<https://devfeed.tech/articles/introducing-neki-2326.md>)

Original publisher: [Read original article](<https://planetscale.com/blog/introducing-neki>)

Author: Nick Van Wiggeren

Published: 2026-09-10T12:00:00Z

Content type: release

Language: en

Sources: [Blog -- PlanetScale](<https://devfeed.tech/sources/blog-planetscale.md>)

Topics: [Database](<https://devfeed.tech/topics/database.md>), [MySQL](<https://devfeed.tech/topics/mysql.md>)

Tags: [database](<https://devfeed.tech/tags/database.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [neki](<https://devfeed.tech/tags/neki.md>), [platform](<https://devfeed.tech/tags/platform.md>), [postgres](<https://devfeed.tech/tags/postgres.md>), [product](<https://devfeed.tech/tags/product.md>), [routing](<https://devfeed.tech/tags/routing.md>), [scale](<https://devfeed.tech/tags/scale.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

PlanetScale announces Neki in platform preview, a sharded Postgres offering designed to scale a database across multiple machines while retaining Postgres compatibility.

### Source excerpt

Neki, sharded Postgres by PlanetScale, is now available in platform preview.

## How we cut CDN metadata lookup latency by 91%

DevFeed: [How we cut CDN metadata lookup latency by 91%](<https://devfeed.tech/articles/how-we-cut-cdn-metadata-lookup-latency-by-91-755.md>)

Original publisher: [Read original article](<https://vercel.com/blog/how-we-cut-cdn-metadata-lookup-latency-by-91-percent>)

Author: Luba Kravchenko

Published: 2026-09-10T00:00:00Z

Content type: article

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [Latency](<https://devfeed.tech/topics/latency.md>), [Vercel](<https://devfeed.tech/topics/vercel.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [API](<https://devfeed.tech/topics/api.md>), [React Native](<https://devfeed.tech/topics/react-native.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [cache](<https://devfeed.tech/tags/cache.md>), [cdn](<https://devfeed.tech/tags/cdn.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [latency](<https://devfeed.tech/tags/latency.md>), [routing](<https://devfeed.tech/tags/routing.md>), [vercel](<https://devfeed.tech/tags/vercel.md>)

### AI overview

Vercel describes how it reduced P99 CDN metadata lookup latency by 91%. The team replaced per-path metadata fetching with bounded shards that group metadata for many paths, improving cache reuse across routing lookups while controlling data-fetching costs. The article also explains how framework routing rules, Build Output API outputs, Bloom filters, and exact metadata lookups work together to select the correct response.

### Source excerpt

Every request to Vercel passes through our CDN, which executes on average over 80 million routing instructions per second. Part of that work is looking up metadata to determine which paths exist and how to serve them. When that metadata isn't cached, the CDN has to fetch it before it can serve the response. We used to fetch and cache metadata one path at a time, retrieving only what each lookup needed. That seemed efficient at the time, but large deployments can contain hundreds of thousands of paths, each with its own cache entry. Every new deployment introduced fresh metadata, making cache misses a recurring cost for large sites that deployed frequently. Fetching more metadata at once made these lookups faster. By grouping paths together, each fetch could populate the cache for many subsequent lookups. But fetching too much introduced its own costs. Through production experiments, we found a balance that cut P99 metadata lookup latency by 91% and made deployments faster along the way. How the CDN finds the right route The path in a request doesn't always match the path of the content or function that serves it. Framework routing rules connect the two. A request for /blog/hello-world, for example, might resolve to the dynamic route /blog/[slug]. A request for that page's React Server Component payload might resolve to /blog/[slug].rsc. As the CDN applies these rules, it may need to check several target paths to find the right response. The framework describes those routes during a build. With framework-defined infrastructure, application code declares which outputs are static, which need Functions, and which responses can be cached or regenerated. Frameworks translate that intent into Build Output API outputs, and Vercel generates the routing metadata the CDN reads. At request time, the CDN needs to determine which target paths exist and retrieve their metadata. The Bloom filters we added to global routing rule out paths that definitely don't exist. Remaining paths

## The lifecycle of a sharded Postgres query

DevFeed: [The lifecycle of a sharded Postgres query](<https://devfeed.tech/articles/the-lifecycle-of-a-sharded-postgres-query-2338.md>)

Original publisher: [Read original article](<https://planetscale.com/blog/the-lifecycle-of-a-sharded-postgres-query>)

Author: PlanetScale

Published: 2026-09-10T00:00:00Z

Content type: tutorial

Language: en

Sources: [Blog -- PlanetScale](<https://devfeed.tech/sources/blog-planetscale.md>)

Topics: [Database](<https://devfeed.tech/topics/database.md>), [networking](<https://devfeed.tech/topics/networking.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [auth](<https://devfeed.tech/tags/auth.md>), [database](<https://devfeed.tech/tags/database.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [neki](<https://devfeed.tech/tags/neki.md>), [postgres](<https://devfeed.tech/tags/postgres.md>), [routing](<https://devfeed.tech/tags/routing.md>), [scale](<https://devfeed.tech/tags/scale.md>), [server](<https://devfeed.tech/tags/server.md>), [sql](<https://devfeed.tech/tags/sql.md>)

### AI overview

An overview of how a SQL query moves through a sharded Postgres database, from authentication and routing to execution across shards.

### Source excerpt

Follow a SQL query through the router, across four Postgres shards, and back.

## Architecting SASE solutions using AWS Local Zones

DevFeed: [Architecting SASE solutions using AWS Local Zones](<https://devfeed.tech/articles/architecting-sase-solutions-using-aws-local-zones-4657.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/compute/architecting-sase-solutions-using-aws-local-zones/>)

Author: Lakshmi VP

Published: 2026-09-09T20:36:09Z

Content type: tutorial

Language: en

Sources: [AWS Compute Blog](<https://devfeed.tech/sources/aws-compute-blog.md>)

Topics: [networking](<https://devfeed.tech/topics/networking.md>), [Network Services](<https://devfeed.tech/topics/network-services.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-local-zones](<https://devfeed.tech/tags/aws-local-zones.md>), [aws-marketplace](<https://devfeed.tech/tags/aws-marketplace.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [edge](<https://devfeed.tech/tags/edge.md>), [latency](<https://devfeed.tech/tags/latency.md>), [routing](<https://devfeed.tech/tags/routing.md>), [sase](<https://devfeed.tech/tags/sase.md>), [security](<https://devfeed.tech/tags/security.md>), [zero-trust](<https://devfeed.tech/tags/zero-trust.md>)

### AI overview

The article explains how AWS Local Zones can support SASE deployments by placing virtual security appliances closer to distributed users to reduce latency while maintaining security controls.

### Source excerpt

Organizations with geographically distributed workforces face a trade-off between security and low-latency access. This post explores how to use AWS Local Zones and Secure Access Service Edge (SASE) solutions to deploy virtual security appliances closer to end users, covering key design principles, capacity planning, and traffic routing.

## How Smart Model Routing Can Cut LLM Costs by 10X

DevFeed: [How Smart Model Routing Can Cut LLM Costs by 10X](<https://devfeed.tech/articles/how-smart-model-routing-can-cut-llm-costs-by-10x-17990.md>)

Original publisher: [Read original article](<https://blog.bytebytego.com/p/how-smart-model-routing-can-cut-llm>)

Author: ByteByteGo

Published: 2026-09-09T15:30:26Z

Content type: article

Language: en

Sources: [ByteByteGo](<https://devfeed.tech/sources/bytebytego.md>)

Topics: [Model Routing](<https://devfeed.tech/topics/model-routing.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [API](<https://devfeed.tech/topics/api.md>)

Tags: [cost](<https://devfeed.tech/tags/cost.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model-routing](<https://devfeed.tech/tags/model-routing.md>), [models](<https://devfeed.tech/tags/models.md>), [routing](<https://devfeed.tech/tags/routing.md>), [routing-system](<https://devfeed.tech/tags/routing-system.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This article explains how smart model routing can reduce LLM application costs by sending simple requests to less expensive models and difficult requests to more capable models. It notes that savings and response quality depend on request types, model price differences, and routing performance, and discusses router, cascading, semantic, and learned routing approaches.

### Source excerpt

Cost reduction isn't a given. It also depends on the types of requests the application receives, the price difference between models, and how well the routing system performs. In this article, we are going to look at various aspects

## Tailscale Kubernetes Operator 1.102: In-cluster Peer Relays, better IPv6, and optimized certificates

DevFeed: [Tailscale Kubernetes Operator 1.102: In-cluster Peer Relays, better IPv6, and optimized certificates](<https://devfeed.tech/articles/tailscale-kubernetes-operator-1-102-in-cluster-peer-relays-better-ipv6-and-optimized-certificates-165.md>)

Original publisher: [Read original article](<https://tailscale.com/blog/kubernetes-operator-1102>)

Author: Mike Stefaniak

Published: 2026-09-09T14:00:00Z

Content type: release

Language: en

Sources: [Blog on Tailscale](<https://devfeed.tech/sources/blog-on-tailscale.md>)

Topics: [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [networking](<https://devfeed.tech/topics/networking.md>), [VPC](<https://devfeed.tech/topics/vpc.md>)

Tags: [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [networks](<https://devfeed.tech/tags/networks.md>), [release](<https://devfeed.tech/tags/release.md>), [routing](<https://devfeed.tech/tags/routing.md>), [vpc](<https://devfeed.tech/tags/vpc.md>)

### AI overview

Tailscale Kubernetes Operator 1.102 adds in-cluster peer relays, improves IPv6 connectivity support, and reduces certificate-related deployment and connectivity issues.

### Source excerpt

Faster cross-cluster connections, fewer IPv6 dead ends, less certificate churn.

## APNIC and NIXI partner to strengthen routing security and technical capacity in India

DevFeed: [APNIC and NIXI partner to strengthen routing security and technical capacity in India](<https://devfeed.tech/articles/apnic-and-nixi-partner-to-strengthen-routing-security-and-technical-capacity-in-india-10862.md>)

Original publisher: [Read original article](<https://blog.apnic.net/2026/09/09/apnic-and-nixi-partner-to-strengthen-routing-security-and-technical-capacity-in-india/>)

Author: Dan Fidler

Published: 2026-09-09T09:01:06Z

Content type: news

Language: en

Sources: [APNIC Blog](<https://devfeed.tech/sources/apnic-blog.md>)

Topics: [Routing Security](<https://devfeed.tech/topics/routing-security.md>), [Security](<https://devfeed.tech/topics/security.md>), [Internet](<https://devfeed.tech/topics/internet.md>), [Resilience](<https://devfeed.tech/topics/resilience.md>), [networking](<https://devfeed.tech/topics/networking.md>)

Tags: [apnic-62](<https://devfeed.tech/tags/apnic-62.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [development](<https://devfeed.tech/tags/development.md>), [india](<https://devfeed.tech/tags/india.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [internet](<https://devfeed.tech/tags/internet.md>), [ipv6](<https://devfeed.tech/tags/ipv6.md>), [knowledge-sharing](<https://devfeed.tech/tags/knowledge-sharing.md>), [nixi](<https://devfeed.tech/tags/nixi.md>), [partnership](<https://devfeed.tech/tags/partnership.md>), [resilience](<https://devfeed.tech/tags/resilience.md>), [routing](<https://devfeed.tech/tags/routing.md>), [routing-security](<https://devfeed.tech/tags/routing-security.md>), [rpki](<https://devfeed.tech/tags/rpki.md>), [security](<https://devfeed.tech/tags/security.md>), [skills](<https://devfeed.tech/tags/skills.md>), [support](<https://devfeed.tech/tags/support.md>)

### AI overview

APNIC and NIXI have signed an MoU to strengthen routing security and technical capacity in India. The partnership will expand IPv6 and RPKI deployment, pilot an RPKI repository mirror, promote routing security practices, and support technical training and knowledge sharing.

### Source excerpt

The partnership will expand IPv6 and RPKI deployment including piloting an RPKI Repository Mirror to support a more secure and resilient Internet ecosystem.

## Deployment step now 10% faster

DevFeed: [Deployment step now 10% faster](<https://devfeed.tech/articles/deployment-step-now-10-faster-898.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/deployment-step-now-10-faster>)

Author: Javi Velasco

Published: 2026-09-08T22:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [CI/CD](<https://devfeed.tech/topics/cicd.md>)

Tags: [manifest](<https://devfeed.tech/tags/manifest.md>), [routing](<https://devfeed.tech/tags/routing.md>)

### AI overview

Vercel made its deployment step about 10% faster by combining per-function routing metadata into one manifest upload. The improvement applies automatically to all builds.

### Source excerpt

The deployment step is now about 10% faster, saving one second on average. Large applications can save up to 12 seconds. Previously, Vercel uploaded a separate routing metadata file for each function path. That metadata is now combined into a single manifest and uploaded once. This improvement applies automatically to all builds. No changes are required. Learn more about builds in the documentation. Read more

## Vercel Sandbox routing is now 18x faster globally

DevFeed: [Vercel Sandbox routing is now 18x faster globally](<https://devfeed.tech/articles/vercel-sandbox-routing-is-now-18x-faster-globally-1183.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/vercel-sandbox-routing-is-now-18x-faster-globally>)

Author: Andy Waller

Published: 2026-09-08T20:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [networking](<https://devfeed.tech/topics/networking.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>)

Tags: [latency](<https://devfeed.tech/tags/latency.md>), [routing](<https://devfeed.tech/tags/routing.md>), [sandbox](<https://devfeed.tech/tags/sandbox.md>), [vercel](<https://devfeed.tech/tags/vercel.md>)

### AI overview

Vercel Sandbox public-domain routing now resolves domains from the nearest regional replica, reducing median lookup latency from 62 ms to 3.4 ms. The change applies automatically and has no pricing changes.

### Source excerpt

Requests to Vercel Sandbox public domains are now routed 18x faster. Domains created with the sandbox.domain() SDK call are now resolved from the nearest regional replica, instead of a single centralized store. Incoming requests reach the process running in the sandbox with less latency. Median domain lookup latency dropped from 62ms to 3.4ms (18x faster). The improvement is largest in regions farthest from the previous store: lookups are now up to 112x faster in Sydney (syd1) and up to 146x faster in Cape Town (cpt1), at p99. This applies automatically to every request to a sandbox domain. There are no pricing changes. Learn more about Vercel Sandbox in our documentation. Read more

## LLM Routing Can Cost More Than Not Routing

DevFeed: [LLM Routing Can Cost More Than Not Routing](<https://devfeed.tech/articles/llm-routing-can-cost-more-than-not-routing-18239.md>)

Original publisher: [Read original article](<https://blog.dailydoseofds.com/p/llm-routing-can-cost-more-than-not>)

Author: Avi Chawla

Published: 2026-09-07T20:30:58Z

Content type: article

Language: en

Sources: [Daily Dose of Data Science](<https://devfeed.tech/sources/daily-dose-of-data-science.md>)

Topics: [Model Routing](<https://devfeed.tech/topics/model-routing.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Frontier Model](<https://devfeed.tech/topics/frontier-model.md>), [coding](<https://devfeed.tech/topics/coding.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [cost](<https://devfeed.tech/tags/cost.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [routing](<https://devfeed.tech/tags/routing.md>)

### AI overview

The article examines why routing requests among LLMs can cost more than using one model throughout an agent session. Although cheaper models may handle simpler tasks, routing adds overhead and can be counterproductive inside agent loops.

### Source excerpt

...covered with a production-grade router for LLM apps.

## Indian backbones need AS\_PATH filters

DevFeed: [Indian backbones need AS\_PATH filters](<https://devfeed.tech/articles/indian-backbones-need-as-path-filters-39786.md>)

Original publisher: [Read original article](<https://anuragbhatia.com/post/2026/09/india-routing-security/>)

Published: 2026-09-07T20:11:07Z

Content type: opinion

Language: en

Sources: [Personal blog of Anurag Bhatia](<https://devfeed.tech/sources/personal-blog-of-anurag-bhatia.md>)

Topics: [BGP](<https://devfeed.tech/topics/bgp.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [networking](<https://devfeed.tech/topics/networking.md>), [Security](<https://devfeed.tech/topics/security.md>)

Tags: [airtel](<https://devfeed.tech/tags/airtel.md>), [as4755](<https://devfeed.tech/tags/as4755.md>), [as55836](<https://devfeed.tech/tags/as55836.md>), [as9498](<https://devfeed.tech/tags/as9498.md>), [bgp](<https://devfeed.tech/tags/bgp.md>), [india](<https://devfeed.tech/tags/india.md>), [jio](<https://devfeed.tech/tags/jio.md>), [network](<https://devfeed.tech/tags/network.md>), [rcom](<https://devfeed.tech/tags/rcom.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tata-comm](<https://devfeed.tech/tags/tata-comm.md>)

### AI overview

The article argues that route leaks are a longstanding security problem for India's routing infrastructure. It explains limitations of IRR AS-SETs, discusses ASPA and AS_PATH filters or peer lock, and questions whether major Indian backbones can consistently apply those filters because of indirect routing and smaller downstream networks.

### Source excerpt

The security of India's routing infrastructure is something that isn't discussed as much as cybersecurity, software vulnerabilities, etc. Part of the blame for that has to go to our industry, which is relatively closed when it comes to sharing incidents and also lacks good documentation on the deployment side of things. Some of these things came to light after the RCom (AS18101) BGP hijack of Telegram prefixes in June 2026. One silent problem for a long time has been route leaks. BGP route leak Route leaks happen when a network ends up announcing a route to a BGP adjacency where it is not supposed to announce that route. Take, for example, a network "leaking" routes learnt from a peer to transit, or vice versa. One can filter downstreams which are small, but it's very hard to filter large downstream networks which have further downstreams, or if one is far removed from that ASN. IRR AS-SETs exist for this reason, but they have not worked well due to tooling challenges. Furthermore, IRR (Internet Routing Registry) by design is a public register where one "publishes intent" before actually doing that in BGP, and then anyone can match the intent with the state in BGP. New tech ASPA will help address this issue, but it's new, vendor support is still in the development phase and it will take its own adoption time. AS_PATH filters / Peer lock This is older tech which can play a very effective role in controlling leaks. If network A decides to peer with network B, they both can agree to announce all routes to each other over the peering & agree to reject each other's ASN from all other BGP sessions. It's a common practice between large transit-free Tier-1 networks as well as major backbones and is often referred to by the fancy name of "peer lock". In India, I doubt backbones like Airtel, Jio, and Tata Comm can have AS_PATH filters rejecting each other from everywhere except direct sessions because there is some indirect routing visible all the time. It could be because of

[Next page](<https://devfeed.tech/tags/routing.md?cursor=WyIyMDI2LTA5LTA3VDIwOjExOjA3KzAwOjAwIiwgImIyNjYwMTM2LTdkNjItNGU1ZS04Y2M2LWY2MWUwNmY1ZTYxZCJd>)