# Vision Language Model Alignment in TRL ⚡

DevFeed: [Vision Language Model Alignment in TRL ⚡](<https://devfeed.tech/articles/vision-language-model-alignment-in-trl-7542.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/trl-vlm-alignment>)

Author: Sergio Paniego; merve; Quentin Gallouédec; Kashif Rasul; Aritra Roy Gosthipaty

Published: 2025-08-07T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [trl](<https://devfeed.tech/topics/trl.md>), [vlm](<https://devfeed.tech/topics/vlm.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [dpo](<https://devfeed.tech/tags/dpo.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [grpo](<https://devfeed.tech/tags/grpo.md>), [model](<https://devfeed.tech/tags/model.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [trl](<https://devfeed.tech/tags/trl.md>), [vision](<https://devfeed.tech/tags/vision.md>), [vlm](<https://devfeed.tech/tags/vlm.md>)

## AI overview

This article presents new and extended methods in TRL for aligning Vision Language Models with human preferences. It covers Mixed Preference Optimization, Group Relative Policy Optimization, Group Sequence Policy Optimization, Reinforce Leave One Out, and Online Direct Preference Optimization, along with native supervised fine-tuning support, training scripts, and demo notebooks.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.