# Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL

DevFeed: [Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL](<https://devfeed.tech/articles/async-grpo-with-lora-across-hf-jobs-a-bucket-a-proxy-and-no-nccl-17376.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/asyncgrpo-lora-hfjobs>)

Author: Amine Dirhoussi; Quentin Gallouédec; Kashif Rasul; Sergio Paniego

Published: 2026-09-10T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [lora](<https://devfeed.tech/topics/lora.md>), [grpo](<https://devfeed.tech/topics/grpo.md>), [jobs](<https://devfeed.tech/topics/jobs.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [async](<https://devfeed.tech/topics/async.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>)

Tags: [async](<https://devfeed.tech/tags/async.md>), [grpo](<https://devfeed.tech/tags/grpo.md>), [hub](<https://devfeed.tech/tags/hub.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [jobs](<https://devfeed.tech/tags/jobs.md>), [llm](<https://devfeed.tech/tags/llm.md>), [lora](<https://devfeed.tech/tags/lora.md>), [nccl](<https://devfeed.tech/tags/nccl.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [rl](<https://devfeed.tech/tags/rl.md>), [storage](<https://devfeed.tech/tags/storage.md>), [trl](<https://devfeed.tech/tags/trl.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

## AI overview

This article describes asynchronous GRPO training with a LoRA adapter across separate Hugging Face Jobs. The adapter is synchronized to vLLM replicas through a shared Storage Bucket, while a proxy handles authentication, rollout routing, and adapter-load broadcasts. Five runs reduced the time for 500 steps from 3 hours 27 minutes to 53 minutes.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.