# Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps

DevFeed: [Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps](<https://devfeed.tech/articles/fine-tuning-a-350m-model-for-better-structured-outputs-in-100-grpo-steps-7235.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/grpo-with-trl-ifstruct>)

Author: Leonie Monigatti; ben burtenshaw; Sergio Paniego

Published: 2026-09-03T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [community](<https://devfeed.tech/tags/community.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [grpo](<https://devfeed.tech/tags/grpo.md>), [guide](<https://devfeed.tech/tags/guide.md>), [json](<https://devfeed.tech/tags/json.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [python](<https://devfeed.tech/tags/python.md>), [rl](<https://devfeed.tech/tags/rl.md>), [training](<https://devfeed.tech/tags/training.md>), [trl](<https://devfeed.tech/tags/trl.md>)

## AI overview

A tutorial on fine-tuning a 350M language model with GRPO to improve structured-output and JSON Schema compliance, then evaluating it on the IFStruct benchmark.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.