# Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference

DevFeed: [Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference](<https://devfeed.tech/articles/co-designing-ai-models-using-speculative-decoding-for-faster-llm-inference-6781.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/co-designing-ai-models-using-speculative-decoding-for-faster-llm-inference/>)

Author: Tanya Lenz

Published: 2026-09-02T16:04:19Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Inference](<https://devfeed.tech/topics/inference.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [accelerate](<https://devfeed.tech/tags/accelerate.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [batch](<https://devfeed.tech/tags/batch.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llms](<https://devfeed.tech/tags/llms.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>)

## AI overview

The article explains speculative decoding as a way to speed up LLM inference while preserving standard-decoding outputs. A smaller draft model proposes several tokens, which the larger target model verifies in parallel; it also defines draft and acceptance lengths and gives a speedup formula.

## Source excerpt

This post is the third in a series on AI model co-design. It explores how to accelerate LLM inference while maintaining accuracy using speculative decoding and...