# tokens

Published articles for tokens.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation

DevFeed: [Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation](<https://devfeed.tech/articles/trajectory-as-the-teacher-few-step-discrete-flow-matching-via-energy-navigated-distillation-31491.md>)

Original publisher: [Read original article](<https://machinelearning.apple.com/research/trajectory-teacher-flow-matching>)

Published: 2026-09-16T00:00:00Z

Content type: article

Language: en

Sources: [Apple Machine Learning Research](<https://devfeed.tech/sources/apple-machine-learning-research.md>)

Topics: [text-generation](<https://devfeed.tech/topics/text-generation.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [inference](<https://devfeed.tech/tags/inference.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [performance](<https://devfeed.tech/tags/performance.md>), [perplexity](<https://devfeed.tech/tags/perplexity.md>), [research](<https://devfeed.tech/tags/research.md>), [text-generation](<https://devfeed.tech/tags/text-generation.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

The article introduces Trajectory-Shaped Discrete Flow Matching, a training method that guides intermediate trajectory decisions with an energy-based coherence measure. The authors argue that poor distillation trajectories, rather than insufficient student capacity, limit few-step generation. On a 170M-parameter language-modeling task, an 8-step student reportedly achieves lower perplexity than a 1,024-step teacher while reducing inference steps.

### Source excerpt

Discrete flow matching generates text by iteratively transforming noise tokens into coherent language, but may require hundreds of forward passes. Distillation uses the multi-step trajectory to train a student to reproduce the process in a few steps. When the student underperforms, the usual explanation is insufficient capacity. We argue the opposite: the trajectory is the bottleneck, not the student. Each training trajectory is built through a chain of blind stochastic jumps with no evaluation of sequence quality; a single bad decision at an early midpoint propagates through subsequent steps...

## Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each

DevFeed: [Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each](<https://devfeed.tech/articles/dense-vs-moe-models-active-parameters-throughput-and-when-to-choose-each-26912.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/dense-vs-moe-models-active-parameters-throughput-and-when-to-choose-each/>)

Author: Elizabeth Goodman

Published: 2026-09-15T17:00:11Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [llms](<https://devfeed.tech/tags/llms.md>), [memory](<https://devfeed.tech/tags/memory.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [models](<https://devfeed.tech/tags/models.md>), [moe](<https://devfeed.tech/tags/moe.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [performance](<https://devfeed.tech/tags/performance.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This article explains how dense and Mixture-of-Experts models activate parameters, compares their effects on throughput, memory cost, and serving complexity, and discusses when each architecture fits different deployment constraints. It uses Nemotron 3.5 Lightning as an example of an MoE model.

### Source excerpt

How can a 30B-parameter model activate only 3B parameters per token, and still use the capacity of the larger model? Nemotron 3.5 Lightning illustrates the...

## Optimizing cost and latency with Amazon Bedrock prompt caching

DevFeed: [Optimizing cost and latency with Amazon Bedrock prompt caching](<https://devfeed.tech/articles/optimizing-cost-and-latency-with-amazon-bedrock-prompt-caching-26941.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/optimizing-cost-and-latency-with-amazon-bedrock-prompt-caching/>)

Author: Daniel Abib

Published: 2026-09-15T16:18:19Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [API](<https://devfeed.tech/topics/api.md>), [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [Multi-tenancy](<https://devfeed.tech/topics/multi-tenancy.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [api](<https://devfeed.tech/tags/api.md>), [caching](<https://devfeed.tech/tags/caching.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [integration](<https://devfeed.tech/tags/integration.md>), [langchain](<https://devfeed.tech/tags/langchain.md>), [latency](<https://devfeed.tech/tags/latency.md>), [pricing](<https://devfeed.tech/tags/pricing.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This AWS post explains how Amazon Bedrock prompt caching can reduce repeated input-token costs by up to 90 percent and lower time to first token when requests reuse the same context. It presents six scenarios using the Converse API, including document, system prompt, tool definition, mixed TTL, tenant-isolated, and LangChain caching.

### Source excerpt

Prompt caching in Amazon Bedrock can cut input token costs by up to 90% when you repeatedly send the same context to foundation models. This post walks through six practical prompt caching scenarios using the Converse API: message content, system prompt, tool definition, mixed TTL, tenant isolation, and LangChain integration.

## Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine

DevFeed: [Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine](<https://devfeed.tech/articles/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine-21079.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine/>)

Author: Tanya Lenz

Published: 2026-09-14T16:39:15Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [Network](<https://devfeed.tech/topics/network.md>), [Python](<https://devfeed.tech/topics/python.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>), [mixtral](<https://devfeed.tech/topics/mixtral.md>), [qwen](<https://devfeed.tech/topics/qwen.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [communication](<https://devfeed.tech/tags/communication.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [mixtral](<https://devfeed.tech/tags/mixtral.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [moe](<https://devfeed.tech/tags/moe.md>), [networks](<https://devfeed.tech/tags/networks.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [performance](<https://devfeed.tech/tags/performance.md>), [python](<https://devfeed.tech/tags/python.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tensors](<https://devfeed.tech/tags/tensors.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>)

### AI overview

This article explains how NVIDIA Transformer Engine and JAX kernel optimizations accelerate dropless Mixture of Experts (MoE) training. It describes bottlenecks from token routing, expert dispatch and gathering, all-to-all communication, and ragged expert matrix operations. In DeepSeek-V3 training on NVIDIA GB200, the optimized approach increased performance from 103 to 1,068 TFLOPS per GPU, a 10.4x improvement.

### Source excerpt

Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE...

## Meta Open-Sources Astryx, Its Agent-Ready React Design System

DevFeed: [Meta Open-Sources Astryx, Its Agent-Ready React Design System](<https://devfeed.tech/articles/meta-open-sources-astryx-its-agent-ready-react-design-system-10827.md>)

Original publisher: [Read original article](<https://www.infoq.com/news/2026/09/meta-astryx-design-system/>)

Author: Bruno Couriol

Published: 2026-09-13T23:39:00Z

Content type: news

Language: en

Sources: [InfoQ](<https://devfeed.tech/sources/infoq.md>)

Topics: [Meta](<https://devfeed.tech/topics/meta.md>), [React](<https://devfeed.tech/topics/react.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [CSS](<https://devfeed.tech/topics/css.md>), [Tooling](<https://devfeed.tech/topics/tooling.md>), [Accessibility](<https://devfeed.tech/topics/accessibility.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [User interface design](<https://devfeed.tech/topics/ui-design.md>), [Web Development](<https://devfeed.tech/topics/web-development.md>), [Svelte](<https://devfeed.tech/topics/svelte.md>), [Flutter](<https://devfeed.tech/topics/flutter.md>)

Tags: [accessibility](<https://devfeed.tech/tags/accessibility.md>), [css](<https://devfeed.tech/tags/css.md>), [development](<https://devfeed.tech/tags/development.md>), [flutter](<https://devfeed.tech/tags/flutter.md>), [javascript](<https://devfeed.tech/tags/javascript.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [meta](<https://devfeed.tech/tags/meta.md>), [meta-astryx-design-system](<https://devfeed.tech/tags/meta-astryx-design-system.md>), [news](<https://devfeed.tech/tags/news.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [react](<https://devfeed.tech/tags/react.md>), [svelte](<https://devfeed.tech/tags/svelte.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [tooling](<https://devfeed.tech/tags/tooling.md>), [typescript](<https://devfeed.tech/tags/typescript.md>), [ui](<https://devfeed.tech/tags/ui.md>), [web-development](<https://devfeed.tech/tags/web-development.md>)

### AI overview

Meta has beta-released Astryx, an open-source React design system developed internally over eight years. It offers more than 150 accessible components, customizable CSS design tokens, precompiled StyleX-based styling, component code ejection, CLI tooling, and an MCP endpoint for developer and AI workflows.

### Source excerpt

Meta recently announced the beta release of Astryx, an open-source React design system developed internally over eight years. Astryx builds on React 19 and StyleX to provide over 150 accessible UI components, customizable CSS design tokens, and dedicated CLI and MCP tooling -- for both engineers and AI agents. By Bruno Couriol

## Chip Huyen explains how to cut inference costs without new hardware

DevFeed: [Chip Huyen explains how to cut inference costs without new hardware](<https://devfeed.tech/articles/chip-huyen-explains-how-to-cut-inference-costs-without-new-hardware-10830.md>)

Original publisher: [Read original article](<https://thenewstack.io/pg-99-conf-2026-inference-costs/>)

Author: Tim Koopmans

Published: 2026-09-13T15:00:00Z

Content type: article

Language: en

Sources: [The New Stack](<https://devfeed.tech/sources/the-new-stack.md>)

Topics: [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Low-Latency Inference](<https://devfeed.tech/topics/low-latency-inference.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [Frontier Model](<https://devfeed.tech/topics/frontier-model.md>), [AI Engineering](<https://devfeed.tech/topics/ai-engineering.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [math](<https://devfeed.tech/topics/math.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-engineering](<https://devfeed.tech/tags/ai-engineering.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [frontier-model](<https://devfeed.tech/tags/frontier-model.md>), [inference](<https://devfeed.tech/tags/inference.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [performance](<https://devfeed.tech/tags/performance.md>), [post-contributed](<https://devfeed.tech/tags/post-contributed.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [scylladb](<https://devfeed.tech/tags/scylladb.md>), [sponsor-scylladb](<https://devfeed.tech/tags/sponsor-scylladb.md>), [sponsored](<https://devfeed.tech/tags/sponsored.md>), [sponsored-post-contributed](<https://devfeed.tech/tags/sponsored-post-contributed.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

Chip Huyen explains why inference costs can outweigh one-time frontier-model training costs and outlines ways to optimize inference without new hardware. The article emphasizes latency metrics such as time to first token, time per output token, end-to-end latency, and goodput, especially for reasoning models.

### Source excerpt

Last October, the P99 conference -- the online gathering for developers focused on high-performance, low-latency applications -- featured a cracking The post Chip Huyen explains how to cut inference costs without new hardware appeared first on The New Stack.

## AP2 Protocol Explained: How Agent Payments Get Authorized

DevFeed: [AP2 Protocol Explained: How Agent Payments Get Authorized](<https://devfeed.tech/articles/ap2-protocol-explained-how-agent-payments-get-authorized-9636.md>)

Original publisher: [Read original article](<https://dodopayments.com/blogs/ap2-protocol-agent-payments/>)

Author: Ayush Agarwal

Published: 2026-09-13T00:00:00Z

Content type: article

Language: en

Sources: [Dodo Payments Blog](<https://devfeed.tech/sources/dodo-payments-blog.md>)

Topics: [Authorization](<https://devfeed.tech/topics/authorization.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [JSON Web Tokens](<https://devfeed.tech/topics/jwt.md>), [Google](<https://devfeed.tech/topics/google.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [cryptographic](<https://devfeed.tech/tags/cryptographic.md>), [google](<https://devfeed.tech/tags/google.md>), [payments](<https://devfeed.tech/tags/payments.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

A practical explanation of AP2, an authorization and evidence protocol for AI agent payment transactions. It describes cryptographic proof, verifiable digital credentials, SD-JWTs, and separate checkout and payment mandates.

### Source excerpt

A practical guide to AP2, the Agent Payments Protocol: checkout and payment mandates, open versus closed authorization, verifiable digital credentials, and what it means for merchants.

## Fear Is Not an Argument

DevFeed: [Fear Is Not an Argument](<https://devfeed.tech/articles/fear-is-not-an-argument-29429.md>)

Original publisher: [Read original article](<https://lemire.me/blog/2026/09/10/fear-is-not-an-argument/>)

Author: Daniel Lemire

Published: 2026-09-10T18:23:42Z

Content type: opinion

Language: en

Sources: [Daniel Lemire](<https://devfeed.tech/sources/daniel-lemire.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [ChatGPT](<https://devfeed.tech/topics/chatgpt.md>), [Tool](<https://devfeed.tech/topics/tool.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [openai](<https://devfeed.tech/tags/openai.md>), [statement](<https://devfeed.tech/tags/statement.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [tools](<https://devfeed.tech/tags/tools.md>)

### AI overview

This opinion argues that fears about AI causing human extinction are vague and unfalsifiable, and compares them with earlier technological and social end-of-the-world predictions. It describes large language models as systems that process and generate tokens using fixed weights, while noting that connecting them to tools makes their capabilities more consequential.

### Source excerpt

We are told that AI entities much like ChatGPT might soon kill us all. The statement is vague and unfalsifiable. It might be true, it might be false. People with credentials (e.g., Turing Award recipient Yoshua Bengio) believe it. Many still remember the Year-2000 bug. Our computers used two-digit coding for dates, and some software ... Continue reading Fear Is Not an Argument

## Firefox Is Getting Its Biggest Redesign in Years. Then Mozilla Got Cold Feet.

DevFeed: [Firefox Is Getting Its Biggest Redesign in Years. Then Mozilla Got Cold Feet.](<https://devfeed.tech/articles/firefox-is-getting-its-biggest-redesign-in-years-then-mozilla-got-cold-feet-9269.md>)

Original publisher: [Read original article](<https://webdesignerdepot.com/firefox-is-getting-its-biggest-redesign-in-years-then-mozilla-got-cold-feet/>)

Author: Alex Harper

Published: 2026-09-09T18:24:32Z

Content type: opinion

Language: en

Sources: [Web Designer Depot](<https://devfeed.tech/sources/web-designer-depot.md>)

Topics: [Firefox](<https://devfeed.tech/topics/firefox.md>)

Tags: [browser](<https://devfeed.tech/tags/browser.md>), [browser-design](<https://devfeed.tech/tags/browser-design.md>), [browser-redesign](<https://devfeed.tech/tags/browser-redesign.md>), [browser-ui](<https://devfeed.tech/tags/browser-ui.md>), [browser-ux](<https://devfeed.tech/tags/browser-ux.md>), [design](<https://devfeed.tech/tags/design.md>), [design-controversy](<https://devfeed.tech/tags/design-controversy.md>), [design-trends](<https://devfeed.tech/tags/design-trends.md>), [features](<https://devfeed.tech/tags/features.md>), [firefox](<https://devfeed.tech/tags/firefox.md>), [firefox-features](<https://devfeed.tech/tags/firefox-features.md>), [firefox-interface](<https://devfeed.tech/tags/firefox-interface.md>), [firefox-redesign](<https://devfeed.tech/tags/firefox-redesign.md>), [firefox-update](<https://devfeed.tech/tags/firefox-update.md>), [future-of-browsers](<https://devfeed.tech/tags/future-of-browsers.md>), [interface-design](<https://devfeed.tech/tags/interface-design.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [mozilla](<https://devfeed.tech/tags/mozilla.md>), [mozilla-firefox](<https://devfeed.tech/tags/mozilla-firefox.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [product-design](<https://devfeed.tech/tags/product-design.md>), [themes](<https://devfeed.tech/tags/themes.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [ui-design](<https://devfeed.tech/tags/ui-design.md>), [ux](<https://devfeed.tech/tags/ux.md>), [ux-design](<https://devfeed.tech/tags/ux-design.md>), [visual-ui-design](<https://devfeed.tech/tags/visual-ui-design.md>), [web-browsers](<https://devfeed.tech/tags/web-browsers.md>), [web-design](<https://devfeed.tech/tags/web-design.md>)

### AI overview

Firefox's Project Nova redesign is being softened after user feedback. Mozilla restored Compact Mode and reduced some of the boldest interface changes, while retaining refreshed components, icons, colors, themes, and rounded elements. The article argues that responsive iteration and user control are more valuable than following fashionable design trends.

### Source excerpt

Firefox is getting its biggest makeover in years--but Mozilla has already backed away from some of its boldest ideas. Project Nova reveals what happens when modern design trends, millions of opinionated users, and the internet's unstoppable obsession with rounded corners collide.

## How Smart Model Routing Can Cut LLM Costs by 10X

DevFeed: [How Smart Model Routing Can Cut LLM Costs by 10X](<https://devfeed.tech/articles/how-smart-model-routing-can-cut-llm-costs-by-10x-17990.md>)

Original publisher: [Read original article](<https://blog.bytebytego.com/p/how-smart-model-routing-can-cut-llm>)

Author: ByteByteGo

Published: 2026-09-09T15:30:26Z

Content type: article

Language: en

Sources: [ByteByteGo](<https://devfeed.tech/sources/bytebytego.md>)

Topics: [Model Routing](<https://devfeed.tech/topics/model-routing.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [API](<https://devfeed.tech/topics/api.md>)

Tags: [cost](<https://devfeed.tech/tags/cost.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model-routing](<https://devfeed.tech/tags/model-routing.md>), [models](<https://devfeed.tech/tags/models.md>), [routing](<https://devfeed.tech/tags/routing.md>), [routing-system](<https://devfeed.tech/tags/routing-system.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This article explains how smart model routing can reduce LLM application costs by sending simple requests to less expensive models and difficult requests to more capable models. It notes that savings and response quality depend on request types, model price differences, and routing performance, and discusses router, cascading, semantic, and learned routing approaches.

### Source excerpt

Cost reduction isn't a given. It also depends on the types of requests the application receives, the price difference between models, and how well the routing system performs. In this article, we are going to look at various aspects

## Optimize vLLM speculative decoding with FastMTP heads

DevFeed: [Optimize vLLM speculative decoding with FastMTP heads](<https://devfeed.tech/articles/optimize-vllm-speculative-decoding-with-fastmtp-heads-12348.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/08/optimize-vllm-speculative-decoding-fastmtp-heads>)

Author: Rahul Tuli

Published: 2026-09-08T14:20:16Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [vllm](<https://devfeed.tech/topics/vllm.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>), [qwen](<https://devfeed.tech/topics/qwen.md>)

Tags: [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [data](<https://devfeed.tech/tags/data.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [inference](<https://devfeed.tech/tags/inference.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [production](<https://devfeed.tech/tags/production.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

This article explains how FastMTP-style fine-tuning improves vLLM speculative decoding. It describes using native multi-token prediction heads as speculators, adapting a single head for recursive multi-step drafting, extracting weights from verifier checkpoints, and producing vLLM-ready checkpoints without training from scratch.

### Source excerpt

Autoregressive decoding makes large language model (LLM) inference memory-bandwidth bound: every token needs 1 full forward pass over billions of parameters, so the hardware spends most of its time moving weights rather than computing. MTP is a training objective: models like the DeepSeek and Qwen families learn to predict several future tokens at each position, which improves their data efficiency and quality. The post Optimize vLLM speculative decoding with FastMTP heads appeared first on Red Hat Developer.

## How engineering teams can measure AI coding ROI with cost attribution and outcome metrics

DevFeed: [How engineering teams can measure AI coding ROI with cost attribution and outcome metrics](<https://devfeed.tech/articles/how-leading-engineering-orgs-are-proving-the-roi-13503.md>)

Original publisher: [Read original article](<https://www.harness.io/blog/your-ai-code-spend-is-soaring-heres-how-leading-engineering-orgs-are-proving-the-roi>)

Author: Kelsey Rosen

Published: 2026-09-08T00:00:00Z

Content type: article

Language: en

Sources: [Harness Blog](<https://devfeed.tech/sources/harness-blog.md>)

Topics: [ai-coding](<https://devfeed.tech/topics/ai-coding.md>), [Ground truth / benchmark quality](<https://devfeed.tech/topics/ground-truth-benchmark-quality.md>), [coding](<https://devfeed.tech/topics/coding.md>), [Finance](<https://devfeed.tech/topics/finance.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-coding](<https://devfeed.tech/tags/ai-coding.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [blog](<https://devfeed.tech/tags/blog.md>), [coding](<https://devfeed.tech/tags/coding.md>), [cost](<https://devfeed.tech/tags/cost.md>), [datadog](<https://devfeed.tech/tags/datadog.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [governance](<https://devfeed.tech/tags/governance.md>), [harness](<https://devfeed.tech/tags/harness.md>), [incident](<https://devfeed.tech/tags/incident.md>), [lifecycle](<https://devfeed.tech/tags/lifecycle.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [numbers](<https://devfeed.tech/tags/numbers.md>), [production](<https://devfeed.tech/tags/production.md>), [team](<https://devfeed.tech/tags/team.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [tooling](<https://devfeed.tech/tags/tooling.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

A Harness panel discussion outlines ways engineering organizations can measure AI coding ROI. The panel recommends attributing costs to specific work, combining throughput metrics with qualitative evidence, and using governance and process changes to interpret results.

### Source excerpt

Harness panelists share practical strategies for measuring AI coding ROI, from granular cost attribution and lifecycle metrics to budgeting, governance. | Blog

## How to Implement OIDC Back-Channel Logout

DevFeed: [How to Implement OIDC Back-Channel Logout](<https://devfeed.tech/articles/how-to-implement-oidc-back-channel-logout-and-why-almost-nobody-has-16040.md>)

Original publisher: [Read original article](<https://workos.com/blog/oidc-back-channel-logout>)

Author: WorkOS

Published: 2026-09-08T00:00:00Z

Content type: tutorial

Language: en

Sources: [WorkOS Blog](<https://devfeed.tech/sources/workos-blog.md>)

Topics: [OpenID connect (OIDC)](<https://devfeed.tech/topics/oidc.md>), [Single sign-on (SSO)](<https://devfeed.tech/topics/sso.md>), [JSON Web Tokens](<https://devfeed.tech/topics/jwt.md>), [App](<https://devfeed.tech/topics/app.md>), [Server](<https://devfeed.tech/topics/server.md>)

Tags: [how-to](<https://devfeed.tech/tags/how-to.md>), [implement](<https://devfeed.tech/tags/implement.md>), [jwt](<https://devfeed.tech/tags/jwt.md>), [oidc](<https://devfeed.tech/tags/oidc.md>), [server](<https://devfeed.tech/tags/server.md>), [sso](<https://devfeed.tech/tags/sso.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This tutorial explains OIDC back-channel logout, including provider discovery, endpoint registration, form-encoded logout requests, and logout-token validation. It also describes how session-specific and user-wide logout work and notes limitations acknowledged by the specification.

### Source excerpt

It is the one standard that can end a session your app already issued, it has been final since 2022, and almost nobody implements it. Here is the whole mechanism, the validation your endpoint owes, and the two limitations the spec admits to itself.

## How AI Tools Accelerate the Reward Loop of Building

DevFeed: [How AI Tools Accelerate the Reward Loop of Building](<https://devfeed.tech/articles/no-natural-limit-9450.md>)

Original publisher: [Read original article](<https://joncphillips.com/no-natural-limit/>)

Author: Jon C. Phillips

Published: 2026-09-07T02:54:00Z

Content type: opinion

Language: en

Sources: [Jon C. Phillips](<https://devfeed.tech/sources/jon-c-phillips.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [articles](<https://devfeed.tech/tags/articles.md>), [audience-building](<https://devfeed.tech/tags/audience-building.md>), [code](<https://devfeed.tech/tags/code.md>), [design](<https://devfeed.tech/tags/design.md>), [digital-products](<https://devfeed.tech/tags/digital-products.md>), [music](<https://devfeed.tech/tags/music.md>), [no-natural-limit](<https://devfeed.tech/tags/no-natural-limit.md>), [photography](<https://devfeed.tech/tags/photography.md>), [product-engineering](<https://devfeed.tech/tags/product-engineering.md>), [side-projects](<https://devfeed.tech/tags/side-projects.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [web-development](<https://devfeed.tech/tags/web-development.md>)

### AI overview

The author argues that building has long been driven by an unpredictable reward loop, but AI tools have shortened the time from idea to working product, making that loop run faster and potentially changing the nature of the hobby.

### Source excerpt

A friend and I were comparing. They'd done about 10 billion tokens in the same period and neither of us found that alarming, really. Which is probably the first thing worth noticing. And we probably all know people running way higher.

## How to build an AI-powered app on Webflow Cloud with OpenAI and Supabase

DevFeed: [How to build an AI-powered app on Webflow Cloud with OpenAI and Supabase](<https://devfeed.tech/articles/how-to-build-an-ai-powered-app-on-webflow-cloud-with-openai-and-supabase-9168.md>)

Original publisher: [Read original article](<https://webflowmarketingmain.com/blog/ai-app-webflow-cloud-openai-supabase>)

Author: Ismail Ajagbe

Published: 2026-09-04T00:00:00Z

Content type: tutorial

Language: en

Sources: [Webflow Blog](<https://devfeed.tech/sources/webflow-blog.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Next.js](<https://devfeed.tech/topics/next-js.md>), [Workers](<https://devfeed.tech/topics/workers.md>), [API](<https://devfeed.tech/topics/api.md>), [Node.js](<https://devfeed.tech/topics/node-js.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [api](<https://devfeed.tech/tags/api.md>), [article](<https://devfeed.tech/tags/article.md>), [cli](<https://devfeed.tech/tags/cli.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloudflare-workers](<https://devfeed.tech/tags/cloudflare-workers.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [guides](<https://devfeed.tech/tags/guides.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [next-js](<https://devfeed.tech/tags/next-js.md>), [node-js](<https://devfeed.tech/tags/node-js.md>), [openai](<https://devfeed.tech/tags/openai.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [storage](<https://devfeed.tech/tags/storage.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [webflow](<https://devfeed.tech/tags/webflow.md>)

### AI overview

Learn how to build a streaming AI chat app on Webflow Cloud with OpenAI and Supabase, including Next.js route handlers, Cloudflare Workers setup, browser token streaming, and optional conversation history storage.

### Source excerpt

Learn how to build a streaming AI chat app on Webflow Cloud with OpenAI and Supabase.

## Attention Mechanisms in LLMs, clearly explained

DevFeed: [Attention Mechanisms in LLMs, clearly explained](<https://devfeed.tech/articles/attention-mechanisms-in-llms-clearly-explained-18232.md>)

Original publisher: [Read original article](<https://blog.dailydoseofds.com/p/attention-mechanisms-in-llms-clearly>)

Author: Avi Chawla

Published: 2026-09-03T20:05:32Z

Content type: tutorial

Language: en

Sources: [Daily Dose of Data Science](<https://devfeed.tech/sources/daily-dose-of-data-science.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Cache](<https://devfeed.tech/topics/cache.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [llms](<https://devfeed.tech/tags/llms.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

A tutorial explaining why attention is used in language models, how long-range dependencies are handled, and why storing attention state for long sequences and large batches can exhaust GPU memory. It introduces attention variants including Multi-Query Attention, Grouped-Query Attention, and Multi-Head Latent Attention.

### Source excerpt

Everything you need to understand how attention works, why the KV cache is the bottleneck, and what every attention variant is actually solving.

## Five Reasons Why Your Auth0 Permissions Are Not in your Access Token

DevFeed: [Five Reasons Why Your Auth0 Permissions Are Not in your Access Token](<https://devfeed.tech/articles/five-reasons-why-your-auth0-permissions-are-not-in-your-access-token-15644.md>)

Original publisher: [Read original article](<https://auth0.com/blog/five-reasons-permissions-not-in-access-token/>)

Author: Carla Urrea Stabile

Published: 2026-09-03T00:00:00Z

Content type: tutorial

Language: en

Sources: [Auth0 Blog](<https://devfeed.tech/sources/auth0-blog.md>)

Topics: [Auth0](<https://devfeed.tech/topics/auth0.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [JSON Web Tokens](<https://devfeed.tech/topics/jwt.md>), [AWS Identity and Access Management (IAM)](<https://devfeed.tech/topics/aws-identity-and-access-management-iam.md>)

Tags: [auth0](<https://devfeed.tech/tags/auth0.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [jwt](<https://devfeed.tech/tags/jwt.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

A tutorial explaining five common reasons Auth0 RBAC permissions may be missing from an access token, including an omitted audience parameter, disabled permission settings, and incomplete role assignments.

### Source excerpt

Decoding your Auth0 JWT and seeing an empty permissions array? Here are 5 common reasons your Auth0 RBAC permissions are missing and how to fix them fast.

## How Coinbase used Code Connect to guide agents and shrink token costs

DevFeed: [How Coinbase used Code Connect to guide agents and shrink token costs](<https://devfeed.tech/articles/how-coinbase-used-code-connect-to-guide-agents-and-shrink-token-costs-9753.md>)

Original publisher: [Read original article](<https://www.figma.com/blog/how-coinbase-used-code-connect-to-shrink-token-costs/>)

Author: Jenny Xie

Published: 2026-09-02T20:28:00Z

Content type: article

Language: en

Sources: [Figma Blog](<https://devfeed.tech/sources/figma-blog.md>)

Topics: [Figma](<https://devfeed.tech/topics/figma.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [Code quality](<https://devfeed.tech/topics/code-quality.md>), [Accessibility](<https://devfeed.tech/topics/accessibility.md>), [Cryptocurrency](<https://devfeed.tech/topics/cryptocurrency.md>)

Tags: [accessibility](<https://devfeed.tech/tags/accessibility.md>), [agents](<https://devfeed.tech/tags/agents.md>), [code](<https://devfeed.tech/tags/code.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coinbase](<https://devfeed.tech/tags/coinbase.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cryptocurrency](<https://devfeed.tech/tags/cryptocurrency.md>), [figma](<https://devfeed.tech/tags/figma.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-server](<https://devfeed.tech/tags/mcp-server.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

The Coinbase Design System team evaluated Code Connect in Figma's MCP server with coding agents. The article reports improved adherence to the design system, better code quality, and an average 22.5% reduction in token costs when converting Figma designs into code.

### Source excerpt

The Coinbase Design System team put Code Connect to the test against coding agents--and found that it boosted design system adherence while cutting token costs by an average of 22.5%.

## GLM-5.3 is 50% off through DigitalOcean on AI Gateway

DevFeed: [GLM-5.3 is 50% off through DigitalOcean on AI Gateway](<https://devfeed.tech/articles/glm-5-3-is-50-off-through-digitalocean-on-ai-gateway-959.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/glm-5-3-is-50-off-through-digitalocean-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-09-02T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [Vercel](<https://devfeed.tech/topics/vercel.md>), [Digital Ocean](<https://devfeed.tech/topics/digital-ocean.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [long-context](<https://devfeed.tech/topics/long-context.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [codex](<https://devfeed.tech/topics/codex.md>), [cursor](<https://devfeed.tech/topics/cursor.md>)

Tags: [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [codex](<https://devfeed.tech/tags/codex.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cursor](<https://devfeed.tech/tags/cursor.md>), [digitalocean](<https://devfeed.tech/tags/digitalocean.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [model](<https://devfeed.tech/tags/model.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [vercel](<https://devfeed.tech/tags/vercel.md>)

### AI overview

Vercel announces a 50% discount on GLM-5.3 through DigitalOcean on AI Gateway until September 8. The article explains the temporary promo model name, standard provider routing, model limits, spend tracking, and setup for coding agents.

### Source excerpt

GLM-5.3 is 50% off on AI Gateway through Tuesday, September 8, in partnership with DigitalOcean. How to use the model during the offer period Using the promo name (zai/glm-5.3-promo-50) gets the discounted rate. It routes only to DigitalOcean, with no fallback to another provider, and it stops serving when the offer ends. Using the standard name (i.e., zai/glm-5.3) with provider options to sort DigitalOcean as the preferred provider keeps working after September 8 and routes across every provider that serves the model, at their usual rates. Because the promo name goes away when the offer ends, treat it as something you switch on for the window rather than hardcode. To keep the standard name in your code instead, pin the provider with order: ['digitalocean'] under providerOptions.gateway, which prefers DigitalOcean and falls back to the others if it cannot serve the request. GLM-5.3 takes text input, with a 1M token context window and a maximum output of 128K tokens. Discounted requests appear in your spend dashboard and carry a trace like any other request. Try GLM-5.3 in the model playground. To use it in a coding agent, see the coding agents guide, then run vercel ai-gateway coding-agents setup to connect agents like Claude Code, Codex, OpenCode, Cursor, Pi, and more and select zai/glm-5.3-promo-50 inside the agent. You can view all language models available on AI Gateway. Read more

## Refresh token behavior across fourteen providers

DevFeed: [Refresh token behavior across fourteen providers](<https://devfeed.tech/articles/refresh-token-behavior-across-fourteen-providers-16049.md>)

Original publisher: [Read original article](<https://workos.com/blog/refresh-token-behavior-across-fourteen-providers>)

Author: WorkOS

Published: 2026-08-31T00:00:00Z

Content type: article

Language: en

Sources: [WorkOS Blog](<https://devfeed.tech/sources/workos-blog.md>)

Topics: [OAuth](<https://devfeed.tech/topics/oauth.md>), [API](<https://devfeed.tech/topics/api.md>)

Tags: [providers](<https://devfeed.tech/tags/providers.md>), [retry](<https://devfeed.tech/tags/retry.md>), [rotation](<https://devfeed.tech/tags/rotation.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This article compares documented OAuth refresh-token behavior across fourteen providers, including token rotation, expiration reporting, grace periods, and revocation on reuse. It explains how rotation affects persistence and retry handling, with examples including Google, Box, Atlassian, Dropbox, Asana, GitHub, and Salesforce.

### Source excerpt

Which providers rotate refresh tokens, which return expires_in, which give you a grace period, and which revoke on reuse. One row per provider, verified against provider documentation in August 2026.

## Type-Safe Authentication in Rust with Auth0 and Axum

DevFeed: [Type-Safe Authentication in Rust with Auth0 and Axum](<https://devfeed.tech/articles/type-safe-authentication-in-rust-with-auth0-and-axum-15651.md>)

Original publisher: [Read original article](<https://auth0.com/blog/type-safe-authentication-rust-auth0-axum/>)

Author: Aniket Bhattacharyea

Published: 2026-08-31T00:00:00Z

Content type: tutorial

Language: en

Sources: [Auth0 Blog](<https://devfeed.tech/sources/auth0-blog.md>)

Topics: [Authentication](<https://devfeed.tech/topics/authentication.md>), [Auth0](<https://devfeed.tech/topics/auth0.md>), [Rust](<https://devfeed.tech/topics/rust.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [OAuth 2.0](<https://devfeed.tech/topics/oauth2.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [API](<https://devfeed.tech/topics/api.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [auth0](<https://devfeed.tech/tags/auth0.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [cli](<https://devfeed.tech/tags/cli.md>), [oauth](<https://devfeed.tech/tags/oauth.md>), [oauth-2-0](<https://devfeed.tech/tags/oauth-2-0.md>), [rust](<https://devfeed.tech/tags/rust.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>)

### AI overview

A tutorial showing how to build a Rust CLI that uses Auth0's OAuth 2.0 Device Authorization Flow, then create an Axum API that validates the resulting access token before allowing access to a protected route.

### Source excerpt

Secure your Rust CLI applications with Auth0 Device Code flow and protect your Axum backend endpoints by validating JWTs with Rust's type safety.

## Kubernetes v1.37: Pod Certificates and Cluster Trust Bundles

DevFeed: [Kubernetes v1.37: Pod Certificates and Cluster Trust Bundles](<https://devfeed.tech/articles/kubernetes-v1-37-pod-certificates-and-cluster-trust-bundles-4574.md>)

Original publisher: [Read original article](<https://kubernetes.io/blog/2026/08/28/kubernetes-v1-37-pod-certificates-and-cluster-trust-bundles/>)

Author: Taahir Ahmed

Published: 2026-08-28T18:30:00Z

Content type: article

Language: en

Sources: [Kubernetes Blog](<https://devfeed.tech/sources/kubernetes-blog.md>)

Topics: [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Authentication](<https://devfeed.tech/topics/authentication.md>), [JSON Web Tokens](<https://devfeed.tech/topics/jwt.md>), [TLS (Transport Layer Security)](<https://devfeed.tech/topics/tls.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [authentication](<https://devfeed.tech/tags/authentication.md>), [blog](<https://devfeed.tech/tags/blog.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cryptographic](<https://devfeed.tech/tags/cryptographic.md>), [json](<https://devfeed.tech/tags/json.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [post](<https://devfeed.tech/tags/post.md>), [tls](<https://devfeed.tech/tags/tls.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

Kubernetes 1.37 introduces generally available Pod Certificates and Cluster Trust Bundles, adding built-in X.509 certificate issuance for TLS and mTLS. The article explains how this production identity mechanism relates to existing service account JWTs and addresses the security limitations of bearer tokens.

### Source excerpt

Pod Certificate / Cluster Trust Bundles Blog Post Kubernetes brings a wealth of features that make it easy to run your production workloads securely and reliably. While aspects like scheduling, health checks and resource limits are probably at the front of your mind, one other important feature of Kubernetes is production identity -- how your workload can authenticate to other systems in order to do its job. Up until now, the primary production identity mechanism built into Kubernetes has been service account JWTs (JSON Web Tokens). These are cryptographically-signed tokens, issued by the control plane of your cluster, that let anyone in the world understand who is calling when your workload uses them. In Kubernetes 1.37, the foundations of a new built-in production identity technology have gone GA. Pod Certificates (and the closely-associated Cluster Trust Bundles) build X.509 certificate issuance for TLS and mTLS directly into core Kubernetes. Why? Service account JWTs have a lot going for them: They are built directly into Kubelet, and work pretty magically. They are written to your workload container's filesystem before your workload starts up, and automatically kept up to date. The issuance system follows least-privilege principles; the node restriction admission plugin ensures that tokens can only be requested by the Kubelet that is actually currently running your pod. They can be federated, allowing you to use them to authenticate to other systems outside of Kubernetes. Service account JWTs underpin the pod-to-cloud authentication store for all of the largest cloud providers, and have widespread support across many additional services and software packages. If it can understand JWTs, you can authenticate to it with a service account token. However, service account JWTs have one big downside -- they are bearer tokens. With bearer tokens, if you have the token, then you are the identity asserted by the token. And since you necessarily have to hand copies of the J

## Three ways to let an AI agent call third-party APIs on behalf of a user

DevFeed: [Three ways to let an AI agent call third-party APIs on behalf of a user](<https://devfeed.tech/articles/three-ways-to-let-an-ai-agent-call-third-party-apis-on-behalf-of-a-user-15997.md>)

Original publisher: [Read original article](<https://workos.com/blog/ai-agent-third-party-api-access-patterns>)

Author: WorkOS

Published: 2026-08-27T00:00:00Z

Content type: tutorial

Language: en

Sources: [WorkOS Blog](<https://devfeed.tech/sources/workos-blog.md>)

Topics: [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [OAuth](<https://devfeed.tech/topics/oauth.md>), [Security](<https://devfeed.tech/topics/security.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [apis](<https://devfeed.tech/tags/apis.md>), [hubspot](<https://devfeed.tech/tags/hubspot.md>), [linear](<https://devfeed.tech/tags/linear.md>), [oauth](<https://devfeed.tech/tags/oauth.md>), [patterns](<https://devfeed.tech/tags/patterns.md>), [proxy](<https://devfeed.tech/tags/proxy.md>), [security](<https://devfeed.tech/tags/security.md>), [slack](<https://devfeed.tech/tags/slack.md>), [third-party](<https://devfeed.tech/tags/third-party.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This article explains three patterns for letting an AI agent access third-party APIs on a user's behalf: storing OAuth credentials yourself, fetching tokens at runtime, or using a proxy that keeps tokens out of the agent-controlled runtime. It compares their operational and security implications and recommends choosing based on where the code runs and the system's requirements.

### Source excerpt

Store the token yourself, fetch it at runtime, or never hold it at all. Where the credential ends up in each pattern, what each one costs, and how to pick without guessing.

## How Speculative Decoding Can Make LLM Generation 2-3 Times Faster

DevFeed: [How Speculative Decoding Can Make LLM Generation 2-3 Times Faster](<https://devfeed.tech/articles/how-to-make-llms-3x-faster-17992.md>)

Original publisher: [Read original article](<https://blog.bytebytego.com/p/how-to-make-llms-3x-faster>)

Author: ByteByteGo

Published: 2026-08-26T15:30:34Z

Content type: tutorial

Language: en

Sources: [ByteByteGo](<https://devfeed.tech/sources/bytebytego.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [text-generation](<https://devfeed.tech/topics/text-generation.md>), [GPU](<https://devfeed.tech/topics/gpu.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [decoding](<https://devfeed.tech/tags/decoding.md>), [generation](<https://devfeed.tech/tags/generation.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [llms](<https://devfeed.tech/tags/llms.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This tutorial explains speculative decoding, in which a smaller model proposes candidate tokens and a larger model evaluates them in a single forward pass. It covers autoregressive generation, GPU utilization, candidate acceptance and rejection, output-quality preservation, acceptance rates, draft sources, and when the technique may stop helping.

### Source excerpt

In this article, we will look at how speculative decoding works.

[Next page](<https://devfeed.tech/tags/tokens.md?cursor=WyIyMDI2LTA4LTI2VDE1OjMwOjM0KzAwOjAwIiwgIjg1NjFhMDE1LWEzMDYtNDY5ZC04ZGI4LTQ4YzM5MjU1YzU0OSJd>)