# When Shards Fly: Cross-Tensor In-Flight Conversion for Low-Latency, Low-Memory Weight Updates in Disaggregated RL

DevFeed: [When Shards Fly: Cross-Tensor In-Flight Conversion for Low-Latency, Low-Memory Weight Updates in Disaggregated RL](<https://devfeed.tech/articles/when-shards-fly-cross-tensor-in-flight-conversion-for-low-latency-low-memory-weight-updates-in-disaggregated-rl-113780.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.00646>)

Author: Jiayu Xiao, Ye Wang, Zhi Zhang, Jiarui Guo, Kan Liu, Tao Lan, Minchen Yu

Published: 2026-11-03T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [GPU optimization](<https://devfeed.tech/topics/gpu-optimization.md>), [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [performance-engineering](<https://devfeed.tech/topics/performance-engineering.md>), [grpo](<https://devfeed.tech/topics/grpo.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>)

Tags: [communication](<https://devfeed.tech/tags/communication.md>), [components](<https://devfeed.tech/tags/components.md>), [conversion](<https://devfeed.tech/tags/conversion.md>), [cross](<https://devfeed.tech/tags/cross.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-memory](<https://devfeed.tech/tags/gpu-memory.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [grpo](<https://devfeed.tech/tags/grpo.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [latency](<https://devfeed.tech/tags/latency.md>), [layout](<https://devfeed.tech/tags/layout.md>), [llm](<https://devfeed.tech/tags/llm.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [mappings](<https://devfeed.tech/tags/mappings.md>), [memory](<https://devfeed.tech/tags/memory.md>), [models](<https://devfeed.tech/tags/models.md>), [native](<https://devfeed.tech/tags/native.md>), [rl](<https://devfeed.tech/tags/rl.md>), [updates](<https://devfeed.tech/tags/updates.md>), [weight](<https://devfeed.tech/tags/weight.md>)

## AI overview

ShardFly targets synchronous policy-weight updates between training and rollout GPU pools in disaggregated LLM reinforcement learning. Its Planner compiles shard mappings, quantization dependencies, and replica routes into reusable cross-tensor schedules, reserving payload buffers for scheduled transfers. Its Executor uses one persistent transfer kernel per rank to combine layout conversion, quantization, GPU-initiated communication, and destination writes while forwarding transformed bytes across replicas. Plans and communication state are reused under stable configurations and replaced between updates for rollout scaling. On up to 32 H20 GPUs, the abstract reports 1.26-27.92x complete BF16 update speedups across five models and four baselines (veRL NCCL, Awex, veRL NIXL, and WeightBridge). For Qwen3-30B-A3B GRPO, response-token throughput was 5.49-6.71% higher than veRL NCCL across four rollout configurations.

## Source excerpt

arXiv:2611.00646v1 Announce Type: new Abstract: Disaggregated LLM reinforcement learning (RL) repeatedly synchronizes policy weights between training and rollout GPU pools. Existing systems reduce communication through shard delivery and replica forwarding, yet separate conversion passes and staging buffers still add latency and GPU-memory overheads to synchronous updates. We present ShardFly, which coordinates reusable transfer planning with streaming GPU execution for synchronous, in-place weight updates. ShardFly introduces two components. The Planner compiles native shard mappings, quantization dependencies, and replica routes into cross-tensor schedules, reserving payload buffers only for scheduled transfers. The Executor runs each rank's schedule in one persistent transfer kernel, fusing memory-layout conversion, quantization, GPU-initiated communication, and destination writes while forwarding transformed bytes across replicas. Plans and communication state are reused under stable configurations and replaced between updates for coordinated rollout scaling. On up to 32 H20 GPUs, ShardFly achieves complete BF16 weight-update speedups of 1.26--27.92$\times$ across five models and four baselines: veRL NCCL, Awex, veRL NIXL, and WeightBridge. In end-to-end Qwen3-30B-A3B GRPO across four rollout configurations, ShardFly improves response-token throughput by 5.49--6.71\% over veRL NCCL.