# Network Contention State Aware Dynamic Optimizer for Accelerator Collective Communication Libraries

DevFeed: [Network Contention State Aware Dynamic Optimizer for Accelerator Collective Communication Libraries](<https://devfeed.tech/articles/network-contention-state-aware-dynamic-optimizer-for-accelerator-collective-communication-libraries-125292.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.10984>)

Author: Rajat Bisht (Tennessee Technological University), Tevfik Kosar (University at Buffalo), Anthony Skjellum (Tennessee Technological University), Gene Cooperman (Northeastern University), MD S Q Zulkar N

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [distributed-training](<https://devfeed.tech/topics/distributed-training.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-architecture](<https://devfeed.tech/tags/agent-architecture.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [ai-workloads](<https://devfeed.tech/tags/ai-workloads.md>), [bare-metal](<https://devfeed.tech/tags/bare-metal.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [collective](<https://devfeed.tech/tags/collective.md>), [communication](<https://devfeed.tech/tags/communication.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [connectivity](<https://devfeed.tech/tags/connectivity.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ma](<https://devfeed.tech/tags/cs-ma.md>), [delta](<https://devfeed.tech/tags/delta.md>), [fabric](<https://devfeed.tech/tags/fabric.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [latency](<https://devfeed.tech/tags/latency.md>), [learning](<https://devfeed.tech/tags/learning.md>), [libraries](<https://devfeed.tech/tags/libraries.md>), [long-short-term-memory](<https://devfeed.tech/tags/long-short-term-memory.md>), [network](<https://devfeed.tech/tags/network.md>)

## AI overview

Static collective communication settings can degrade under background network traffic. This NCCL runtime tuner uses an LSTM-based detector with a sequential probability ratio test to distinguish sustained contention from transient spikes, then a Dueling Double DQN selector with Conservative Q-Learning to adjust configuration parameters. On Chameleon Cloud's isolated bare-metal cluster, it reduced AllReduce latency by 36% versus NCCL and 32% versus fully converged AutoCCL. Across six AI workloads, it reported up to 65% speedups on Delta with NVIDIA A100 GPUs and Slingshot-11. The supplied abstract does not specify the workload-level results or broader evaluation limits.

## Source excerpt

arXiv:2611.10984v1 Announce Type: cross Abstract: Collective Communication Libraries (CCL) are critical for large-scale distributed AI/ML training, yet their configurations are determined by static heuristics that do not account for real-time network conditions. Our empirical study shows that these heuristics perform near-optimally in contention-free environments, but degrade substantially under background traffic. To address this, we present a cooperative multi-agent run-time optimizer for accelerator collective communication. Our approach employs a two-agent architecture: (i) detector- a Long Short Term Memory(LSTM) recurring neural network fed classifier head with a sequential probability ratio test that distinguishes sustained contention from transient spikes; and (ii) selector- a configuration selector built on a Dueling Double DQN (D3QN) with Conservative Q-Learning that adapts configuration parameters in response. We implemented this dynamic tuner over NCCL, a widely used CCL developed by NVIDIA. When evaluated on Chameleon Cloud's isolated bare-metal cluster, this dynamic tuning approach reduces AllReduce latency by 36% over NCCL and 32% over a fully converged AutoCCL. We further evaluated it across six real AI workloads spanning convolutional networks, transformers, and recommendation architectures. Our multi-agent tuner approach delivers up to 65% speedups on Delta cluster with NVIDIA A100 GPUs and Slingshot-11 fabric internode connectivity.