# We Got Claude to Fine-Tune an Open Source LLM

DevFeed: [We Got Claude to Fine-Tune an Open Source LLM](<https://devfeed.tech/articles/we-got-claude-to-fine-tune-an-open-source-llm-7240.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/hf-skills-training>)

Author: ben burtenshaw; shaun smith

Published: 2025-12-04T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [jobs](<https://devfeed.tech/topics/jobs.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [lora](<https://devfeed.tech/topics/lora.md>), [rlvr](<https://devfeed.tech/topics/rlvr.md>), [codex](<https://devfeed.tech/topics/codex.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [codex](<https://devfeed.tech/tags/codex.md>), [community](<https://devfeed.tech/tags/community.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [llm](<https://devfeed.tech/tags/llm.md>), [lora](<https://devfeed.tech/tags/lora.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

This tutorial explains how Hugging Face Skills enable Claude Code to fine-tune language models by validating datasets, selecting GPUs, configuring authentication, submitting cloud training jobs, monitoring progress, and publishing finished models to the Hugging Face Hub. It covers LoRA, full fine-tuning, supervised fine-tuning, direct preference optimization, reinforcement learning with verifiable rewards, GGUF conversion, and multi-stage training pipelines.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.