# Efficiently Aligning Draft Models via Parameter- and Data-Efficient Adaptation

DevFeed: [Efficiently Aligning Draft Models via Parameter- and Data-Efficient Adaptation](<https://devfeed.tech/articles/efficiently-aligning-draft-models-via-parameter-and-data-efficient-adaptation-134966.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2603.09527>)

Author: Luxi Lin, Zhihang Lin, Zhanpeng Zeng, Yuhao Chen, Qingyu Zhang, Jixiang Luo, Xuelong Li, Rongrong Ji

Published: 2026-11-16T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [peft](<https://devfeed.tech/topics/peft.md>), [Model Optimizer](<https://devfeed.tech/topics/model-optimizer.md>), [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>)

Tags: [adapting](<https://devfeed.tech/tags/adapting.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [component](<https://devfeed.tech/tags/component.md>), [components](<https://devfeed.tech/tags/components.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [distributions](<https://devfeed.tech/tags/distributions.md>), [draft](<https://devfeed.tech/tags/draft.md>), [eda](<https://devfeed.tech/tags/eda.md>), [framework](<https://devfeed.tech/tags/framework.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-inference](<https://devfeed.tech/tags/llm-inference.md>), [models](<https://devfeed.tech/tags/models.md>), [parameter](<https://devfeed.tech/tags/parameter.md>), [practical](<https://devfeed.tech/tags/practical.md>), [private](<https://devfeed.tech/tags/private.md>), [solution](<https://devfeed.tech/tags/solution.md>), [speculative-decoding](<https://devfeed.tech/tags/speculative-decoding.md>), [target](<https://devfeed.tech/tags/target.md>), [updating](<https://devfeed.tech/tags/updating.md>)

## AI overview

Efficient Draft Adaptation (EDA) aims to restore speculative decoding performance when a target language model is fine-tuned for a specific domain, without retraining a draft model from scratch. It separates shared and target-specific output modeling, updating only a lightweight private component; regenerates training data with the fine-tuned target to better align adaptation with decoding; and selects high-value samples. The abstract reports higher average acceptance lengths and significantly lower training costs than full retraining, but provides no quantitative results or experimental details.

## Source excerpt

arXiv:2603.09527v2 Announce Type: replace-cross Abstract: Speculative decoding accelerates LLM inference but suffers from performance degradation when target models are fine-tuned for specific domains. A naive solution is to retrain draft models for every target model, which is costly and inefficient. To address this, we introduce a practical parameter- and data-efficient framework named Efficient Draft Adaptation, abbreviated as EDA, for efficiently adapting draft models. EDA introduces three innovations: (1) a decoupled architecture that utilizes shared and private components to model the shared and target-specific output distributions separately, enabling parameter-efficient adaptation by updating only the lightweight private component; (2) a data regeneration strategy that utilizes the fine-tuned target model to regenerate training data, thereby improving the alignment between training and speculative decoding, leading to higher average acceptance length; (3) a sample selection mechanism that prioritizes high-value data for efficient adaptation. Our experiments show that EDA effectively restores speculative performance on fine-tuned models, achieving superior average acceptance lengths with significantly reduced training costs compared to full retraining. Code is available at https://github.com/Lyn-Lucy/Efficient-Draft-Adaptation.