# Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod

DevFeed: [Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod](<https://devfeed.tech/articles/fine-tuning-gpt-oss-20b-for-multilingual-reasoning-on-amazon-sagemaker-hyperpod-91293.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/fine-tuning-gpt-oss-20b-for-multilingual-reasoning-on-amazon-sagemaker-hyperpod/>)

Author: Mijanur Palash

Published: 2026-10-20T17:48:27Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Amazon SageMaker HyperPod](<https://devfeed.tech/topics/amazon-sagemaker-hyperpod.md>), [gpt-oss](<https://devfeed.tech/topics/gpt-oss.md>), [grpo](<https://devfeed.tech/topics/grpo.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [lora](<https://devfeed.tech/topics/lora.md>), [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [Enhancing AI model performance](<https://devfeed.tech/topics/enhancing-ai-model-performance.md>), [trl](<https://devfeed.tech/topics/trl.md>), [peft](<https://devfeed.tech/topics/peft.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [adapter](<https://devfeed.tech/tags/adapter.md>), [adapters](<https://devfeed.tech/tags/adapters.md>), [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-eks](<https://devfeed.tech/tags/amazon-eks.md>), [amazon-elastic-container-registry](<https://devfeed.tech/tags/amazon-elastic-container-registry.md>), [amazon-elastic-kubernetes-service](<https://devfeed.tech/tags/amazon-elastic-kubernetes-service.md>), [amazon-elastic-kubernetes-service-amazon-eks](<https://devfeed.tech/tags/amazon-elastic-kubernetes-service-amazon-eks.md>), [amazon-fsx](<https://devfeed.tech/tags/amazon-fsx.md>), [amazon-fsx-for-lustre](<https://devfeed.tech/tags/amazon-fsx-for-lustre.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-hyperpod](<https://devfeed.tech/tags/amazon-sagemaker-hyperpod.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gpt-oss](<https://devfeed.tech/tags/gpt-oss.md>), [grpo](<https://devfeed.tech/tags/grpo.md>), [headroom](<https://devfeed.tech/tags/headroom.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [sft](<https://devfeed.tech/tags/sft.md>), [supervised-fine-tuning](<https://devfeed.tech/tags/supervised-fine-tuning.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

## AI overview

Fine-tuning GPT-OSS-20B with LoRA on Amazon SageMaker HyperPod raised reasoning in the requested language from 22% to 100% on a 50-case, five-language evaluation. SFT taught the missing behavior; final-answer language accuracy reached 62%. GRPO on the SFT checkpoint raised that metric to 70% while maintaining 100% reasoning-language accuracy. A Qwen2.5-7B control showed GRPO added 6 points on multilingual reasoning where there was headroom, but no gain on GSM8K, already at 90.5%. The results support using SFT for behaviors the model does not yet exhibit and adding GRPO to refine behaviors it sometimes produces; when sampled groups are already mostly correct, GRPO may have no useful learning signal. The article describes HyperPod training infrastructure and configuration, including TRL for GPT-OSS-20B and veRL with Ray and vLLM for the Qwen control.

## Source excerpt

Learn how we fine-tuned GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod, and how to decide between supervised fine-tuning (SFT) and reinforcement learning with GRPO. SFT took reasoning-language accuracy from 22% to 100%, and GRPO added measurable gains where headroom existed.