# arXiv: Distributed Computing

Research papers on distributed systems, parallel computing, consensus, fault tolerance, and scalable architectures.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Achieving Near-Zero-Overhead Multi-Model Hierarchical Classification in Real-Time Detection Pipelines

DevFeed: [Achieving Near-Zero-Overhead Multi-Model Hierarchical Classification in Real-Time Detection Pipelines](<https://devfeed.tech/articles/achieving-near-zero-overhead-multi-model-hierarchical-classification-in-real-time-detection-pipelines-144919.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2608.11770>)

Author: Vaishnav Raju

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [quantization](<https://devfeed.tech/topics/quantization.md>), [Jetson Orin](<https://devfeed.tech/topics/jetson-orin.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [real-time](<https://devfeed.tech/topics/real-time.md>)

Tags: [accelerators](<https://devfeed.tech/tags/accelerators.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-vehicles](<https://devfeed.tech/tags/autonomous-vehicles.md>), [bottleneck](<https://devfeed.tech/tags/bottleneck.md>), [classification](<https://devfeed.tech/tags/classification.md>), [classifier](<https://devfeed.tech/tags/classifier.md>), [classifiers](<https://devfeed.tech/tags/classifiers.md>), [compilation](<https://devfeed.tech/tags/compilation.md>), [concurrent](<https://devfeed.tech/tags/concurrent.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [custom](<https://devfeed.tech/tags/custom.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [detection](<https://devfeed.tech/tags/detection.md>), [drone](<https://devfeed.tech/tags/drone.md>), [edge](<https://devfeed.tech/tags/edge.md>), [overhead](<https://devfeed.tech/tags/overhead.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [real-time](<https://devfeed.tech/tags/real-time.md>)

### AI overview

The paper reports that a GPU detector paired with DLA classification on a Jetson Orin NX ran at 12.5 FPS at 1080p, compared with 13.3 FPS for the detector alone. Its five-step deployment method covers adapting classification architectures, repairing TensorRT implicit quantization ranges for pipeline validation (raising reported accuracy from 75% to 94%), quantization-aware training, ONNX graph surgery, and concurrent GPU/DLA inference. The authors also describe nine engineering constraints and report dual-DLA scaling without additional cost. Evidence here is limited to the abstract.

### Source excerpt

arXiv:2608.11770v2 Announce Type: replace-cross Abstract: Edge-deployed vision systems in target recognition, surveillance, autonomous vehicles, and drone domains require hierarchical inference pipelines where a detection model identifies objects of interest and downstream classifiers provide fine-grained attribute analysis. Running all models on the GPU creates a serial bottleneck that limits real-time throughput as pipeline stages grow. Modern edge SoCs pair GPUs with dedicated neural accelerators (NPUs, DLAs) capable of concurrent execution, yet deploying custom models on these accelerators remains impractical due to strict operator constraints, quantization incompatibilities, and an undocumented end-to-end pipeline. We target NVIDIA Jetson DLA cores as the representative platform. We present a five-step methodology for zero GPU fallback DLA INT8 deployment of classification backbones, comprising architecture adaptation, manual dynamic range workaround to rescue TensorRT's implicit quantization (recovering 94.0% accuracy from implicit quantization's 75%) for rapid pipeline validation before explicit quantization, quantization-aware training, ONNX graph surgery for DLA compilation, and a concurrent GPU-detection/DLA-classification inference pipeline. We document nine engineering constraints with root-cause analysis and generalizable solutions. Validation on a dual-head person attribute classifier running on DLA alongside a GPU object detector on a Jetson Orin NX demonstrates near-zero pipeline overhead (12.5 vs. 13.3~FPS detector-only at 1080p), with dual-DLA scaling at no additional cost. The methodology is backbone-agnostic and generalizes to any detection-classification edge pipeline.

## AscMLA: Unlocking FP4 Efficiency for Long-Context MLA Decoding through Asymmetric Scaling

DevFeed: [AscMLA: Unlocking FP4 Efficiency for Long-Context MLA Decoding through Asymmetric Scaling](<https://devfeed.tech/articles/ascmla-unlocking-fp4-efficiency-for-long-context-mla-decoding-through-asymmetric-scaling-146129.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26106>)

Author: Zechun Zhou, Zhiyong Zheng, Xiaomin Zhang, Lin Ye, Han Li, Jingwei Sun, Guangzhong Sun, Jing Li

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [GPU optimization](<https://devfeed.tech/topics/gpu-optimization.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>), [Decoding](<https://devfeed.tech/topics/decoding.md>)

Tags: [attention](<https://devfeed.tech/tags/attention.md>), [cache](<https://devfeed.tech/tags/cache.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [decoding](<https://devfeed.tech/tags/decoding.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [fp4](<https://devfeed.tech/tags/fp4.md>), [long-context](<https://devfeed.tech/tags/long-context.md>), [memory](<https://devfeed.tech/tags/memory.md>), [mla](<https://devfeed.tech/tags/mla.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

AscMLA addresses the mismatch between K/V scaling requirements when FP4 is applied to MLA's shared latent. It combines asymmetric K/V scaling with pipelined scale delivery to process one FP4 payload directly, avoiding the dequantization or separate encodings used by existing approaches, which add execution or storage overhead. The abstract reports 38.2% less cache memory than FP8 and geometric-mean decoding speedups of 1.35x over TRT-LLM's FP8 kernels and 1.26x over CAKE's NVFP4 MLA kernels.

### Source excerpt

arXiv:2611.26106v1 Announce Type: new Abstract: Long-context decoding repeatedly reads a growing KV cache. FP4 reduces cache storage and traffic but needs block scaling to handle its limited dynamic range. Applying FP4 to multi-head latent attention (MLA) requires reconciling different K/V scaling requirements on a shared latent. Existing approaches address this mismatch through dequantization or separate encodings, adding execution or storage overhead. We present AscMLA, which combines asymmetric K/V scaling with pipelined scale delivery to process a single FP4 payload directly. AscMLA uses 38.2% less cache memory than FP8 and achieves geometric-mean speedups of 1.35x over TRT-LLM's FP8 and 1.26x over CAKE's NVFP4 MLA kernels.

## Beyond 4: Improved Competitive Traveling Repairperson

DevFeed: [Beyond 4: Improved Competitive Traveling Repairperson](<https://devfeed.tech/articles/beyond-4-improved-competitive-traveling-repairperson-146120.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.21943>)

Author: Bibek Maharjan, Gokarna Sharma

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Algorithms](<https://devfeed.tech/topics/algorithms.md>), [Combinatorial optimization](<https://devfeed.tech/topics/combinatorial-optimization.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [class](<https://devfeed.tech/tags/class.md>), [computer-science](<https://devfeed.tech/tags/computer-science.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-dm](<https://devfeed.tech/tags/cs-dm.md>), [cs-ds](<https://devfeed.tech/tags/cs-ds.md>), [cs-ma](<https://devfeed.tech/tags/cs-ma.md>), [data-structures-and-algorithms](<https://devfeed.tech/tags/data-structures-and-algorithms.md>), [metric](<https://devfeed.tech/tags/metric.md>), [online](<https://devfeed.tech/tags/online.md>), [problems](<https://devfeed.tech/tags/problems.md>), [ratio](<https://devfeed.tech/tags/ratio.md>), [residual](<https://devfeed.tech/tags/residual.md>), [state](<https://devfeed.tech/tags/state.md>), [zero](<https://devfeed.tech/tags/zero.md>)

### AI overview

For the online traveling repairperson problem on arbitrary metrics, the paper reports a deterministic algorithm with competitive ratio 3.877, improving on the stated 4-competitive state of the art. For zero-residual instances, it reports a ratio of 3+ε for every ε>0. The abstract also says these results extend to some variants of online dial-a-ride; it does not specify which variants or give further algorithmic details.

### Source excerpt

arXiv:2611.21943v1 Announce Type: cross Abstract: With $k\geq 1$ repairpersons starting initially from a depot, we present a 3.877-competitive deterministic algorithm for the fundamental online traveling repairperson problem on an arbitrary metric. For the special class of zero-residual instances, we improve the ratio to $3+\epsilon$ for every $\epsilon>0$. We also extend these results to some variants of the related so-called online dial-a-ride problem. The state-of-the-art is the 4-competitive deterministic algorithm for both problems.

## Towards Scale-Up Networking: Challenges and Open Questions

DevFeed: [Towards Scale-Up Networking: Challenges and Open Questions](<https://devfeed.tech/articles/towards-scale-up-networking-challenges-and-open-questions-146131.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26156>)

Author: Tingting Xu, Zixun Su, Xinyang Huang, Bowen Liu, Kun Tan, Dong Lin, Hao Wang, Yinben Xia, Weifeng Zhang, Binzhang Fu, Shuihai Hu, Kai Chen

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>), [arXiv: Networking](<https://devfeed.tech/sources/arxiv-networking.md>)

Topics: [NVLink](<https://devfeed.tech/topics/nvlink.md>), [Distributed Systems & Parallel Computing](<https://devfeed.tech/topics/distributed-systems-parallel-computing.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [bandwidth](<https://devfeed.tech/tags/bandwidth.md>), [bottleneck](<https://devfeed.tech/tags/bottleneck.md>), [challenges](<https://devfeed.tech/tags/challenges.md>), [collective](<https://devfeed.tech/tags/collective.md>), [communication](<https://devfeed.tech/tags/communication.md>), [compatibility](<https://devfeed.tech/tags/compatibility.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-ni](<https://devfeed.tech/tags/cs-ni.md>), [design](<https://devfeed.tech/tags/design.md>), [device](<https://devfeed.tech/tags/device.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [domain](<https://devfeed.tech/tags/domain.md>), [experts](<https://devfeed.tech/tags/experts.md>), [foundation](<https://devfeed.tech/tags/foundation.md>), [framework](<https://devfeed.tech/tags/framework.md>), [networking](<https://devfeed.tech/tags/networking.md>), [open](<https://devfeed.tech/tags/open.md>), [open-questions](<https://devfeed.tech/tags/open-questions.md>), [scale-up](<https://devfeed.tech/tags/scale-up.md>)

### AI overview

The paper derives scale-up network requirements from critical-path communication in distributed training and inference, focusing on domain size, per-accelerator bandwidth, and collective completion latency. It uses those requirements to compare representative proprietary and open fabrics, describing trade-offs in performance, scalability, compatibility, and implementation cost across their interconnects, topologies, protocols, and communication semantics. It also identifies open challenges in switching and physical interconnects, efficient communication, semantics, resource sharing, and connecting heterogeneous devices. This is a requirement-driven analysis; the supplied excerpt does not provide specific fabric-by-fabric results.

### Source excerpt

arXiv:2611.26156v1 Announce Type: cross Abstract: The rapid growth of AI models and the widespread use of distributed training and inference have made inter-accelerator communication a critical system bottleneck. Scale-up fabrics address this bottleneck by combining high per-accelerator bandwidth with low and predictable latency over tightly coupled accelerator domains. However, the appropriate topology, protocol mechanisms, communication semantics, and system integration remain actively debated. We analyze the critical-path communication generated by parallelism strategies and derive the resulting requirements for domain scale, per-accelerator bandwidth, and collective completion latency. We then use these requirements as a framework to examine representative proprietary and open scale-up fabrics, revealing how their physical interconnects, topologies, protocols, and semantics make different trade-offs among performance, scalability, compatibility, and implementation cost. Moreover, based on this analysis and discussions with industry experts, we identify challenges and open problems in physical interconnects and switching, efficient communication, semantics, resource sharing and heterogeneous device interconnection. This paper provides a requirement-driven foundation for analyzing current scale-up fabrics and guiding the design of future systems.

## Release-Bound Withdrawal Authorization for Bitcoin Custody

DevFeed: [Release-Bound Withdrawal Authorization for Bitcoin Custody](<https://devfeed.tech/articles/release-bound-withdrawal-authorization-for-bitcoin-custody-146025.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25231>)

Author: Jian Cui (University of Illinois Urbana-Champaign), Rui Zhu (Yale University), Haixu Tang (Indiana University Bloomington)

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>), [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Access Control](<https://devfeed.tech/topics/access-control.md>), [Bitcoin](<https://devfeed.tech/topics/bitcoin.md>), [audit](<https://devfeed.tech/topics/audit.md>), [Threat monitoring](<https://devfeed.tech/topics/threat-monitoring.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [Authentication](<https://devfeed.tech/topics/authentication.md>)

Tags: [audit](<https://devfeed.tech/tags/audit.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [bitcoin](<https://devfeed.tech/tags/bitcoin.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [custody](<https://devfeed.tech/tags/custody.md>), [http](<https://devfeed.tech/tags/http.md>), [lease](<https://devfeed.tech/tags/lease.md>), [probing](<https://devfeed.tech/tags/probing.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [rollback](<https://devfeed.tech/tags/rollback.md>), [rpc](<https://devfeed.tech/tags/rpc.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [tests](<https://devfeed.tech/tags/tests.md>)

### AI overview

Release-Bound Withdrawal Authorization (RBWA) orders Bitcoin withdrawal permits against pauses in a replicated journal and restores exposure if closing evidence leaves the active chain. An optional route delays large payouts and allows independent cold recovery; after a rollback, replayed recovery can prevail or lose to an already exported mature payout. On regtest, direct payments confirmed in one block, while staged payments confirmed in three or seven blocks with delays of two or six. Authenticated receipts can revoke one signing lease in a shared wallet. In matched synthetic schedules, probes reduced permits through compromised leases from 20 to 9 of 33, with one false fence. Two held-out HTTP workloads showed equal fixed-threshold precision for boosted audit and probe-augmented detectors. Live tests found a file marker could fence a compromised lease missed by RPC-only audit; audit using the same file-read evidence also caught a reader bypassing the probe. The benefit of probing therefore depends on evidence available to the operator.

### Source excerpt

arXiv:2611.25231v1 Announce Type: new Abstract: A compromised cryptocurrency withdrawal backend can request signatures on unauthorized payments. Previously signed transactions may remain spendable after pause or become spendable again after a reorganization. Release-Bound Withdrawal Authorization (RBWA) orders permits against pause in a replicated journal and restores exposure when its closing evidence disappears from Bitcoin's active chain. An optional route delays large payouts and permits independent cold recovery. Direct payments confirm in one block on regtest, and staged payments confirm in three or seven at delays of two or six. After rollback, a replayed recovery can win or lose to an already exported mature payout. Authenticated receipts can revoke one signing lease in a shared wallet. In matched synthetic schedules, probes reduce permits through compromised leases from 20 to 9 out of 33, with one false fence. Two held-out HTTP workloads find equal fixed-threshold precision for boosted audit and probe-augmented detectors. The audit fields already expose the probe authentication outcome. Live tests verify an exact maintenance exception and add a file marker as a distinct source. The marker fences a compromised lease that RPC-only audit misses. Audit with the same file-read evidence also fences a reader who bypasses the probe. The results tie the benefit of active probing to which evidence the operator can obtain.

## KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization

DevFeed: [KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization](<https://devfeed.tech/articles/kernelopt-dispatch-aware-agentic-search-for-gpu-kernel-optimization-144934.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2609.30059>)

Author: Aheli Poddar, Sanskar Prasad, Arindam Samanta, Subha Chakraborty, Vishal Goyal, Rohit Singh Rathaur

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Compilers and Linkers](<https://devfeed.tech/topics/compilers-and-linkers.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [abstract](<https://devfeed.tech/tags/abstract.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [arithmetic](<https://devfeed.tech/tags/arithmetic.md>), [artifacts](<https://devfeed.tech/tags/artifacts.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [automatically](<https://devfeed.tech/tags/automatically.md>), [challenge](<https://devfeed.tech/tags/challenge.md>), [changes](<https://devfeed.tech/tags/changes.md>), [code](<https://devfeed.tech/tags/code.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [compiler](<https://devfeed.tech/tags/compiler.md>), [compilers](<https://devfeed.tech/tags/compilers.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dispatch](<https://devfeed.tech/tags/dispatch.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [search](<https://devfeed.tech/tags/search.md>)

### AI overview

KernelOPT uses profiling-guided agents to inspect compiler artifacts, including generated Triton kernels and external library calls, then synthesize and refine kernels and evaluate the assembled model. Its four validation stages combine execution checks, multi-seed numerical comparisons, model-level checks with a float64 fallback, and an end-to-end performance gate of 1.03x. On 250 KernelBench problems run on NVIDIA H200, it reports geometric mean speedups over torch.compile of 1.40x for single operators, 1.15x for composite operators, and 1.07x for model architectures. The authors note that gains include precision changes and algebraic simplifications within evaluated tolerances, and that isolated kernel improvements can differ from end-to-end performance.

### Source excerpt

arXiv:2609.30059v3 Announce Type: replace-cross Abstract: Deep learning inference and training performance depends critically on GPU kernel efficiency. Modern compilers such as PyTorch Inductor automatically generate GPU kernels from high-level model code, but frequently underperform expert-written implementations by wide margins. Recent LLM-assisted optimizers explore these opportunities through kernel generation and refinement; yet translating isolated kernel improvements into model-level gains remains a challenge. We present KernelOPT, a profiling-guided multi-agent system for GPU kernel optimization. It inspects generated Triton kernels and external library calls in compiler artifacts to guide synthesis and refinement, then assembles and evaluates the resulting model. Four stages of validation combine execution checks, multi-seed numerical comparison, model-level checking with a float64 fallback and end-to-end performance gating ($\gamma{=}1.03$). The system supports PyTorch nn.Modules, standalone Triton kernels, and Helion kernels. It is evaluated on all 250 KernelBench problems on NVIDIA H200 which includes 100 single-operator problems (Level1), 100 composite operators (Level2), and 50 model architectures (Level3). KernelOPT achieves geometric mean speedups over torch.compile of 1.40$\times$, 1.15$\times$ and 1.07$\times$ respectively across L1, L2 and L3. Among problems exceeding 1.03$\times$ speedup, the geomeans are 2.54$\times$ (36 L1), 1.84$\times$ (23 L2), and 1.37$\times$ (11 L3). These gains include arithmetic-precision changes and task-specific algebraic simplifications under the evaluated numerical tolerances. The evaluation also reveals discrepancies between isolated kernel improvements and end-to-end performance, motivating model-level measurement alongside kernel-level optimization. Code is available at https://github.com/TorchedHat/KernelOPT.

## Matching Architecture to Workload: Comparing RISC-V Parallel Accelerators for Energy-Efficient Embedded Computing

DevFeed: [Matching Architecture to Workload: Comparing RISC-V Parallel Accelerators for Energy-Efficient Embedded Computing](<https://devfeed.tech/articles/matching-architecture-to-workload-comparing-risc-v-parallel-accelerators-for-energy-efficient-embedded-computing-146128.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25947>)

Author: Luca Colombo, Luigi Ghionda, Amirhossein Kiamarzi, Yvan Tortorella, Riccardo Giunti, Niccol\\\`o Giuliani, Samuele Colmi, Angelo Garofalo, Giuseppe Tagliavini, Davide Rossi

Published: 2026-11-20T05:00:00Z

Content type: comparison

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [RISC-V](<https://devfeed.tech/topics/riscv.md>), [Distributed Systems & Parallel Computing](<https://devfeed.tech/topics/distributed-systems-parallel-computing.md>), [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Embedded Software Dev](<https://devfeed.tech/topics/embedded-software-dev.md>), [Sustainable Computing](<https://devfeed.tech/topics/sustainable-computing.md>)

Tags: [accelerators](<https://devfeed.tech/tags/accelerators.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [compare](<https://devfeed.tech/tags/compare.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [computing](<https://devfeed.tech/tags/computing.md>), [cs-ar](<https://devfeed.tech/tags/cs-ar.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [embedded](<https://devfeed.tech/tags/embedded.md>), [energy](<https://devfeed.tech/tags/energy.md>), [energy-efficiency](<https://devfeed.tech/tags/energy-efficiency.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [memory](<https://devfeed.tech/tags/memory.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [power](<https://devfeed.tech/tags/power.md>), [regular](<https://devfeed.tech/tags/regular.md>), [risc-v](<https://devfeed.tech/tags/risc-v.md>), [scalar](<https://devfeed.tech/tags/scalar.md>), [stream](<https://devfeed.tech/tags/stream.md>), [vector](<https://devfeed.tech/tags/vector.md>)

### AI overview

A comparison using open-source RISC-V accelerators implemented in the same 12 nm technology and evaluated on a common benchmark suite finds that no execution model leads on every workload. Spatz offers the largest gains for regular, compute-intensive applications with substantial vectorization, but is especially sensitive to data parallelism and regular computation and memory access. Snitch Cluster performs well when parallelism is limited and memory access is streamable. PULP Cluster is strongest on irregular, control-dominated applications. The abstract reports peak performance and energy-efficiency gains of up to 4.29x and 5.17x for Spatz, 5.53x and 1.45x for Snitch, and 5.66x and 2.80x for PULP, respectively. It also notes that PULP and Snitch's greater flexibility than Spatz costs area and power.

### Source excerpt

arXiv:2611.25947v1 Announce Type: new Abstract: Embedded computing demands high performance and energy efficiency across workloads with widely different computational characteristics. Choosing the most suitable execution model therefore requires a quantitative understanding of how each model maps to different workload classes. In this paper, we compare three execution models for energy-efficient embedded computing: scalar multicore, stream ing multicore, and vector processing. We use three open-source RISC-V accelerators as representative implementations: the PULP Cluster, the Snitch Cluster, and Spatz, respectively. Their open-source hardware and software stacks enable a controlled comparison based on implementations in the same 12 nm technology and a common benchmark suite. Our results reveal that no single execution model performs best across all workload classes. Spatz delivers the greatest benefits for regular and highly vectorizable compute-intensive applications, achieving up to 4.29x higher performance and 5.17x greater energy efficiency than the other architectures. However, its effectiveness strongly depends on the availability of data-level parallelism and regular computation and memory-access patterns, making it the most sensitive to workload characteristics. The Snitch Cluster performs particularly well on applications with limited parallelism and streamable memory-access patterns, providing up to 5.53x higher performance and 1.45x greater energy efficiency. Conversely, the PULP Cluster is most effective on irregular and control-dominated applications, achieving improvements of up to 5.66x in performance and 2.80x in energy efficiency. Compared with Spatz, however, the greater flexibility offered by PULP and Snitch comes at a non-negligible cost in terms of both area and power.

## Held While Waiting: What LLM Agent Sessions Reserve on Serverless and Agent Runtimes

DevFeed: [Held While Waiting: What LLM Agent Sessions Reserve on Serverless and Agent Runtimes](<https://devfeed.tech/articles/held-while-waiting-what-llm-agent-sessions-reserve-on-serverless-and-agent-runtimes-145792.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26480>)

Author: Mekhala Hithyshini Sreenivasa

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>), [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [Serverless](<https://devfeed.tech/topics/serverless.md>), [Amazon Bedrock AgentCore](<https://devfeed.tech/topics/amazon-bedrock-agentcore.md>), [virtual machines](<https://devfeed.tech/topics/virtual-machines.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-runtimes](<https://devfeed.tech/tags/agent-runtimes.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-pf](<https://devfeed.tech/tags/cs-pf.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [llm](<https://devfeed.tech/tags/llm.md>), [runtimes](<https://devfeed.tech/tags/runtimes.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [waiting](<https://devfeed.tech/tags/waiting.md>)

### AI overview

On Amazon Bedrock AgentCore, each conversation reserves its own environment while waiting for model replies: the excerpt reports a 2.7-second median wait versus an estimated 5-40 milliseconds of computation. This can exhaust environment capacity well before processor capacity. Two remedies are described: clients can close conversations to release environments sooner (the benchmark found environments otherwise stayed reserved 15 minutes after conversations averaging 33 seconds), while sharing environments across conversations requires platform support. In simulation, sharing one environment among 64 conversations used 59 times fewer environments, with 99% of replies delayed by at most 40 milliseconds. The computation estimates are uncertain; three measurement approaches each produced plausible but too-low values. The excerpt says only one surveyed agent runtime permits sharing in part, and identifies safe isolation of model-selected tools or code as an open problem.

### Source excerpt

arXiv:2611.26480v1 Announce Type: cross Abstract: LLM agents spend nearly all their time waiting for the model. On Amazon Bedrock AgentCore, our agents waited a median of 2.7 seconds for each model reply, then computed for an estimated 5 to 40 milliseconds. AgentCore does not charge for CPU during the wait. But it reserves a separate environment, a virtual machine with its own memory, for every conversation, and keeps it reserved until the conversation is closed. So 1,000 conversations reserve 1,000 environments to do the work of 2 to 15 processor cores. A service runs out of environments long before it runs out of processing power. The shortage has two causes, and each has a fix. An environment stays reserved after its conversation ends: in the customer-service benchmark we ran, a conversation lasts 33 seconds on average, but its environment is held for 15 minutes more unless the client closes it. And an environment serves only one conversation, which is mostly waiting: in our simulation, 64 conversations sharing one environment need 59 times fewer environments, and 99 of every 100 replies are delayed by at most 40 milliseconds. The milliseconds are an estimate because they are hard to measure: a stubbed model, a timer around the model call, and steps run back to back each gave a plausible number that was too low. We show how to avoid all three. Of the two fixes, closing needs only the client. Sharing needs the platform, and of the agent runtimes we surveyed only one allows it, in part. They keep conversations apart because an agent runs tools, and sometimes code, chosen by a model. The open problem is to keep them apart without reserving an environment for each while it waits.

## StarMPI-SVD: Distributed-Memory Parallel Star-M Tensor SVD

DevFeed: [StarMPI-SVD: Distributed-Memory Parallel Star-M Tensor SVD](<https://devfeed.tech/articles/starmpi-svd-distributed-memory-parallel-star-m-tensor-svd-146136.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26451>)

Author: Naman Pesricha, Grey Ballard, Srinivas Eswar, Md Taufique Hussain, Vishwas Rao, Phani Motamarri

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Distributed Systems & Parallel Computing](<https://devfeed.tech/topics/distributed-systems-parallel-computing.md>), [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>), [Compression](<https://devfeed.tech/topics/compression.md>)

Tags: [adaptive](<https://devfeed.tech/tags/adaptive.md>), [asynchronous](<https://devfeed.tech/tags/asynchronous.md>), [communication](<https://devfeed.tech/tags/communication.md>), [compression](<https://devfeed.tech/tags/compression.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [kernels](<https://devfeed.tech/tags/kernels.md>), [matrix](<https://devfeed.tech/tags/matrix.md>), [nodes](<https://devfeed.tech/tags/nodes.md>), [order](<https://devfeed.tech/tags/order.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [singular-value-decomposition](<https://devfeed.tech/tags/singular-value-decomposition.md>), [size](<https://devfeed.tech/tags/size.md>), [star](<https://devfeed.tech/tags/star.md>), [svd](<https://devfeed.tech/tags/svd.md>)

### AI overview

The work presents the first distributed-memory implementations of t-SVDM-I and adaptive t-SVDM-II for N-way tensors, extending star-M compression beyond shared-memory settings. t-SVDM-I uses invertible transformations and slice-wise truncated SVDs at a prescribed rank; t-SVDM-II selects slice-wise ranks to meet an error tolerance. Asynchronous, non-blocking communication is used for data redistribution to address computational and communication bottlenecks. Strong-scaling experiments report at least 70% parallel efficiency on up to 128 nodes (6,144 cores); the methods are applied to datasets up to 768 GB.

### Source excerpt

arXiv:2611.26451v1 Announce Type: new Abstract: The star-M tensor algebra generalizes the optimal compression guarantees of the matrix singular value decomposition (SVD) to higher-order tensors. The t-SVDM-I decomposition is computed using a set of invertible transformations and slice-wise truncated SVDs with a prescribed rank, and its adaptive, multirank variant t-SVDM-II can determine slice-wise ranks to satisfy a prescribed error tolerance. Existing implementations of these algorithms are limited to shared-memory environments, restricting their applicability to modern large-scale datasets. In this work, we present the first distributed-memory implementations of t-SVDM-I and t-SVDM-II, which are generalized to N-way tensors. To address computational and communication bottlenecks, we design asynchronous, non-blocking communication strategies for efficient data redistribution to obtain highly efficient key computational kernels. Strong-scaling experiments demonstrate the efficiency and scalability of our approach (at least 70% parallel efficiency on up to 128 nodes, or 6144 cores), and we apply the star-M compression techniques to a set of application datasets of size up to 768 GB.

## TideCache: Efficient Hybrid LLM Serving with Transparent Cache Management and Layer-Wise Streaming

DevFeed: [TideCache: Efficient Hybrid LLM Serving with Transparent Cache Management and Layer-Wise Streaming](<https://devfeed.tech/articles/tidecache-efficient-hybrid-llm-serving-with-transparent-cache-management-and-layer-wise-streaming-145202.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26619>)

Author: Jinbin Luo, Xiaozhe Yao, Shang Yang, Zhijian Liu, Song Han, Qinghao Hu

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>), [Cache](<https://devfeed.tech/topics/cache.md>), [sglang](<https://devfeed.tech/topics/sglang.md>), [memory pool](<https://devfeed.tech/topics/memory-pool.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [attention](<https://devfeed.tech/tags/attention.md>), [backend](<https://devfeed.tech/tags/backend.md>), [bounded](<https://devfeed.tech/tags/bounded.md>), [cache](<https://devfeed.tech/tags/cache.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [components](<https://devfeed.tech/tags/components.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [context](<https://devfeed.tech/tags/context.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [execution](<https://devfeed.tech/tags/execution.md>), [hybrid](<https://devfeed.tech/tags/hybrid.md>), [layer](<https://devfeed.tech/tags/layer.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-serving](<https://devfeed.tech/tags/llm-serving.md>), [management](<https://devfeed.tech/tags/management.md>), [serving](<https://devfeed.tech/tags/serving.md>), [streaming](<https://devfeed.tech/tags/streaming.md>), [transparent](<https://devfeed.tech/tags/transparent.md>)

### AI overview

TideCache serves hybrid LLMs by coordinating GPU and host memory for global-attention and bounded-state caches. Its Transparent Cache Pool reallocates physical pages while preserving virtual addresses and backend interfaces; its Cache Streamer uses bounded-state computation intervals to prefetch global-attention prefixes into shared GPU slots, overlapping transfers with computation while keeping generated KV resident. A Request Scheduler chooses resident or streamed execution and adjusts capacity based on request size and queue state. Implemented in SGLang, TideCache was evaluated on GB300 and GH200 across seven model/platform configurations. Compared with SGLang using HiCache, it completed up to 2.04x as many agent turns, reduced overall P50 per-token latency by 20-59%, and improved agent P50 TTFT by 1.40-3.05x.

### Source excerpt

arXiv:2611.26619v1 Announce Type: cross Abstract: Hybrid architectures have become mainstream among open-weight language models. Their global-attention and bounded-state layers maintain heterogeneous caches whose demands vary with context length and concurrency. We present TideCache, a serving system on CPU--GPU superchips with three components for allocating GPU memory among caches and managing their residency across GPU and host memory. The Transparent Cache Pool redistributes physical pages among cache components behind fixed virtual addresses, preserving cache layouts and backend interfaces. The Cache Streamer uses computation intervals provided by bounded-state layers to prefetch the next global-attention layer's prefix into GPU slots shared across global-attention layers, reducing GPU residency while overlapping layer-wise transfers with computation. Generated KV remains resident. The Request Scheduler selects resident or streamed execution and triggers capacity adjustments according to request size and queue state. Together, they let HBM released by streaming accommodate other cache components and additional requests. Implemented in SGLang and evaluated on GB300 and GH200 across seven model/platform configurations, TideCache completes up to 2.04x as many agent turns, reduces overall P50 per-token latency by 20--59%, and improves agent P50 TTFT by 1.40--3.05x compared with SGLang with HiCache.

## Aggron: Aggressive Compression of Agentic KV Caches during Head-of-Line Stalls in the Request Queue

DevFeed: [Aggron: Aggressive Compression of Agentic KV Caches during Head-of-Line Stalls in the Request Queue](<https://devfeed.tech/articles/aggron-aggressive-compression-of-agentic-kv-caches-during-head-of-line-stalls-in-the-request-queue-146134.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26435>)

Author: Rishabh Ravi, Tony Hong, Chen Wang, Yue Zhu, Mengmei Ye, Hubertus Franke, Fan Lai, Josep Torrellas

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [queueing theory](<https://devfeed.tech/topics/queueing-theory.md>), [performance-engineering](<https://devfeed.tech/topics/performance-engineering.md>), [vllm](<https://devfeed.tech/topics/vllm.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [cache](<https://devfeed.tech/tags/cache.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [compression](<https://devfeed.tech/tags/compression.md>), [context-compression](<https://devfeed.tech/tags/context-compression.md>), [cs-ar](<https://devfeed.tech/tags/cs-ar.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [engine](<https://devfeed.tech/tags/engine.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [kv-cache](<https://devfeed.tech/tags/kv-cache.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [load](<https://devfeed.tech/tags/load.md>), [memory](<https://devfeed.tech/tags/memory.md>), [model](<https://devfeed.tech/tags/model.md>), [queue](<https://devfeed.tech/tags/queue.md>), [request](<https://devfeed.tech/tags/request.md>), [serving](<https://devfeed.tech/tags/serving.md>), [stalled](<https://devfeed.tech/tags/stalled.md>), [throughput](<https://devfeed.tech/tags/throughput.md>)

### AI overview

Aggron addresses KV-cache limits in long-running LLM agents by summarizing selected cache content at every turn, keeping each summarization request lightweight. It runs these requests in a separate queue while the corresponding agent request is stalled behind a head-of-line block, using capacity left idle in the main queue; it launches summarization only when it predicts completion before that agent request executes. The abstract says this approach retains accuracy and, versus state-of-the-art asynchronous summarization at high load, reduces P99 program latency by 27-31% and increases throughput by 1.34-1.40x. The supplied text is an abstract, so it does not provide evaluation details or broader comparisons.

### Source excerpt

arXiv:2611.26435v1 Announce Type: new Abstract: LLM agents run long, multi-turn programs whose contexts grow at every step, and serving them is limited by KV cache capacity. To alleviate this limitation, systems use context compression techniques, which typically wait until the KV cache crosses a large threshold and then summarize large spans of history at once, either in the background while the agent progresses or on the critical path. These summarizations can be done using the same model running on the same engine, or using the same or a different model running on extra hardware. When running on the same engine, summarization competes with the requests being served for both compute and memory capacity. To maximize the cost-effectiveness of summarization, this paper presents a new serving system called {\em Aggron}. Aggron summarizes agentic requests at every turn and selectively summarizes only certain parts of the KV cache. As a result, Aggron retains accuracy and keeps summarization requests lightweight. Moreover, Aggron launches summarization requests from a separate {\em Summarization Queue} while the corresponding agentic request whose KV cache we want to compress is stalled in the main request queue due to head-of-line stalls. The Summarization queue utilizes compute and memory capacity left over by the head-of-line stalls in the main queue. Further, to maximize efficiency, the server issues summarizations only when it predicts that they can complete before the corresponding agentic request will finally execute. In our evaluation, we compare Aggron to state-of-the-art asynchronous summarization. At high load, Aggron reduces P99 program latency by $27$--$31\%$, and raises throughput by $1.34$--$1.40\times$.

## Characterizing High Bandwidth Flash for LLM Serving

DevFeed: [Characterizing High Bandwidth Flash for LLM Serving](<https://devfeed.tech/articles/characterizing-high-bandwidth-flash-for-llm-serving-144948.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2609.39131>)

Author: Zack Yu, Chloe Wong, Coleman Hooper, Minjae Lee, Wonjun Kang, Youngjin Cho, Michael W. Mahoney, Yakun Sophia Shao, Kurt Keutzer, Amir Gholami

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Cache](<https://devfeed.tech/topics/cache.md>), [systems](<https://devfeed.tech/topics/systems.md>), [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>)

Tags: [agentic-workloads](<https://devfeed.tech/tags/agentic-workloads.md>), [cs-ar](<https://devfeed.tech/tags/cs-ar.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [endurance](<https://devfeed.tech/tags/endurance.md>), [hbm](<https://devfeed.tech/tags/hbm.md>), [high-bandwidth-flash](<https://devfeed.tech/tags/high-bandwidth-flash.md>), [kv-cache](<https://devfeed.tech/tags/kv-cache.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-serving](<https://devfeed.tech/tags/llm-serving.md>), [scheduling](<https://devfeed.tech/tags/scheduling.md>), [simulations](<https://devfeed.tech/tags/simulations.md>)

### AI overview

Trace-driven simulations of high-throughput agentic LLM serving find that adding high-bandwidth flash (HBF) to an HBM-HBF-host memory hierarchy can reduce completion time by 21.1-86.9% versus HBM-only systems in the evaluated workloads. Modeled energy savings reach 62.4%, varying with workload and weight placement. Because HBF has access costs and limited write endurance, the study pairs data placement with buffered cache-aware scheduling; in one evaluated configuration, this scheduling raises estimated HBF write lifetime from 0.99 to 13.63 years. These are simulation results, not measurements of deployed systems.

### Source excerpt

arXiv:2609.39131v3 Announce Type: replace Abstract: Large language model (LLM) serving requires substantial memory to store model weights and KV caches. Agentic workloads compound this pressure through repeated interactions over growing contexts, making it important to retain KV cache for reuse. High-bandwidth flash (HBF) offers a way to expand accelerator memory capacity for LLM serving, but its access costs and limited write endurance complicate its use. We evaluate HBF for high-throughput agentic serving across system design and scheduling choices to understand when additional capacity improves serving performance and energy efficiency. We introduce an HBM-HBF-host hierarchical storage system and buffered cache-aware scheduling, and use trace-driven simulations to analyze their effects on performance, energy consumption, and HBF write lifetime. Across the evaluated workloads, the fastest HBF-augmented systems reduce completion time by 21.1-86.9% relative to HBM-only systems. Modeled energy savings reach 62.4%, with benefits depending on the workload and weight placement. Buffered cache-aware scheduling extends estimated HBF write lifetime from 0.99 to 13.63 years in the evaluated configuration. These results demonstrate the importance of coordinating data placement and scheduling in serving LLM with HBF, positioning HBF as an actively utilized lower-level memory tier rather than passive storage.

## Thinflow: Organizing HPC Benchmarking Campaigns as Rerunnable Directory Trees

DevFeed: [Thinflow: Organizing HPC Benchmarking Campaigns as Rerunnable Directory Trees](<https://devfeed.tech/articles/thinflow-organizing-hpc-benchmarking-campaigns-as-rerunnable-directory-trees-146138.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26526>)

Author: Richard Schulze, Ari Rasch, Anna-Lena Roth, Jonas Posner

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Bash](<https://devfeed.tech/topics/bash.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [The Julia Language](<https://devfeed.tech/topics/julia.md>)

Tags: [bash](<https://devfeed.tech/tags/bash.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [campaign](<https://devfeed.tech/tags/campaign.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [dependencies](<https://devfeed.tech/tags/dependencies.md>), [environment](<https://devfeed.tech/tags/environment.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [julia](<https://devfeed.tech/tags/julia.md>), [manifest](<https://devfeed.tech/tags/manifest.md>), [openmp](<https://devfeed.tech/tags/openmp.md>), [paper](<https://devfeed.tech/tags/paper.md>), [partitions](<https://devfeed.tech/tags/partitions.md>), [provenance](<https://devfeed.tech/tags/provenance.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [slurm](<https://devfeed.tech/tags/slurm.md>), [supercomputer](<https://devfeed.tech/tags/supercomputer.md>), [supercomputers](<https://devfeed.tech/tags/supercomputers.md>)

### AI overview

Thinflow is a small Bash engine that organizes HPC benchmark campaigns as rerunnable directory trees. Each task pairs code with a short shell script; a sweep command builds, runs benchmarks, and plots results. Declared dependencies determine execution order, recorded in a plain-text manifest, while per-supercomputer profiles submit runs to workload managers such as Slurm. Each run records its environment, hardware, and parameters. Because the engine travels with the campaign, it can be rerun without installing a separate tool and may serve as a paper artifact. In a case study, identical task files ran on three Slurm partitions across two supercomputers, up to 16 nodes: 455 runs for a matrix-multiplication strong-scaling study covering C/OpenMP, C/MPI, and Julia/MPI. The 37 task files contained 217 non-comment lines; differences between partitions were chiefly profiles and command-line parameters.

### Source excerpt

arXiv:2611.26526v1 Announce Type: new Abstract: A benchmarking campaign provides the measurements behind an HPC performance study: code variants are built, swept over core or node counts, and measured repeatedly. Moving such a campaign to another supercomputer or rerunning it months later requires work that is not part of the study itself. Job scripts are adapted to each supercomputer, and what exactly ran is often reconstructed afterwards. We present Thinflow, a small Bash engine for organizing HPC benchmarking campaigns as rerunnable directory trees of tasks and runs. A task is a directory with a short shell script next to the code. For each sweep, one command builds the code, runs the benchmarks, and plots the results. Thinflow derives the execution order from declared dependencies and writes it to a plain-text manifest. Per-supercomputer profiles submit the runs to a workload manager such as Slurm. Each run writes a provenance record of its environment, hardware, and parameters. The engine ships inside the campaign directory, so a campaign stays rerunnable without installing a separate tool and, once completed, may serve as a paper artifact. In a case study, we ran one campaign with identical task files on three Slurm partitions of two supercomputers, on up to 16 nodes. This strong-scaling study of matrix multiplication in C/OpenMP, C/MPI, and Julia/MPI comprises 37 task files with 217 non-comment lines. Its 455 benchmark runs recorded what differed per partition, chiefly profiles and command-line parameters. This suggests that such a campaign needs little structure beyond plain shell files.

## HEL: A Heterogeneous Extensible Layer for GPU-Resident Runtime Orchestration

DevFeed: [HEL: A Heterogeneous Extensible Layer for GPU-Resident Runtime Orchestration](<https://devfeed.tech/articles/hel-a-heterogeneous-extensible-layer-for-gpu-resident-runtime-orchestration-146118.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.24830>)

Author: Agnieszka M. {\\L}upi\\'nska, Serban D. Porumbescu, John D. Owens

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [scheduling](<https://devfeed.tech/topics/scheduling.md>), [hpx](<https://devfeed.tech/topics/hpx.md>), [microsoft-work-graphs](<https://devfeed.tech/topics/microsoft-work-graphs.md>)

Tags: [asynchronous](<https://devfeed.tech/tags/asynchronous.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [case-study](<https://devfeed.tech/tags/case-study.md>), [compression](<https://devfeed.tech/tags/compression.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-sy](<https://devfeed.tech/tags/cs-sy.md>), [eess-sy](<https://devfeed.tech/tags/eess-sy.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [latency](<https://devfeed.tech/tags/latency.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [performance](<https://devfeed.tech/tags/performance.md>), [runtime](<https://devfeed.tech/tags/runtime.md>)

### AI overview

HEL is a GPU-resident runtime built from stateful services that persist for an application's lifetime. Applications spawn coroutine-like tasks, which the runtime schedules on a spatially partitioned GPU alongside the application. It supports synchronous and asynchronous tasks, runtime dependencies, batched submissions, and automatic retries. Producer-consumer and host-RPC benchmarks, plus a PFPL compression case study, report performance advantages on underutilized GPUs and when HEL can hide task latency. The excerpt does not provide measurements or comparisons with other runtimes.

### Source excerpt

arXiv:2610.24830v2 Announce Type: replace Abstract: We describe a GPU-resident runtime system, HEL, built on stateful services that persist throughout the lifespan of a user application. A HEL programmer expresses a workload as an application that spawns coroutine-like tasks, which are then scheduled and run by the HEL runtime. HEL supports synchronous and asynchronous tasks, tasks with runtime dependencies, batched task submission, and automatic retries. Applications and tasks run alongside each other on the spatially partitioned GPU. Using producer-consumer and host-RPC benchmarks together with a PFPL compression case study, we show that HEL demonstrates a performance advantage for underutilized GPUs and for scenarios where HEL enables hiding task latency.

## Live Migration of Gated DeltaNet Requests: Exact Catch-Up and the Cost of Log Backlog

DevFeed: [Live Migration of Gated DeltaNet Requests: Exact Catch-Up and the Cost of Log Backlog](<https://devfeed.tech/articles/live-migration-of-gated-deltanet-requests-exact-catch-up-and-the-cost-of-log-backlog-146130.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26153>)

Author: Hanqing Yu, Jiaqi Yang, Si Wu, Feng Li, Xiuzhen Cheng, Pengfei Hu, Yongbo Yu

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [data migrations](<https://devfeed.tech/topics/data-migrations.md>), [model architecture](<https://devfeed.tech/topics/model-architecture.md>)

Tags: [backlog](<https://devfeed.tech/tags/backlog.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [gated-deltanet](<https://devfeed.tech/tags/gated-deltanet.md>), [live-migration](<https://devfeed.tech/tags/live-migration.md>), [log](<https://devfeed.tech/tags/log.md>)

### AI overview

Live migration of streaming Gated DeltaNet requests recovers recurrent state at the correct token boundary on a worker with the same model weights. The paper adapts snapshots, batched replay and token catch-up, and proposes a compact update log; exact catch-up retains native single-token decoding and matches the applicable bitwise reference on tested inputs. In 1,350 scheduled pure-GDN trials across two GPU deployments, compact logs had the shortest exact handoff gap in all 90 configurations, while exact catch-up released the source earliest in the 80 complete configurations. When arithmetic differences were allowed, 32-step replay achieved the highest output rate; at 10 MB/s it cut median handoff gaps from 445-464 ms for logs to about 81 ms. Retrospective selection across 40 historical KV-aligned Qwen configurations reduced mean gap by 13.9% versus the strongest scored simple rule under either numerical contract. Whole-request hybrid results are initial, and joint KV/GDN policy evaluation remains to be done.

### Source excerpt

arXiv:2611.26153v1 Announce Type: new Abstract: Live migration of a streaming Gated DeltaNet (GDN) request requires recovering recurrent state at the correct token boundary on a worker with the same model weights. We adapt snapshots, batched replay, and token catch-up, and design a compact update-log migration path. Exact catch-up preserves native single-token decode and matches the applicable bitwise reference on the tested inputs. We use both a prior-based and a probe-calibrated selector to choose a path for user interruption, source release, or output rate. In 1,350 scheduled pure-GDN trials on two GPU deployments, compact logs achieved the shortest exact handoff gap in all 90 configurations, including 10 winners determined using a replay timeout bound. In the 80 complete configurations, exact catch-up always released the source earliest, while 32-step replay provided the highest output rate when arithmetic differences were allowed. At 10 MB/s, 32-step replay also reduced the median handoff gap from 445--464 ms for logs to about 81 ms across the two deployments. On 40 historical KV-aligned Qwen configurations, retrospective selection reduced the mean gap by 13.9% against the strongest scored simple rule under either numerical contract. We report initial whole-request hybrid results and specify how the joint KV and GDN policy will be evaluated.

## Multilevel Graph Partitioning on GPU Supercomputers

DevFeed: [Multilevel Graph Partitioning on GPU Supercomputers](<https://devfeed.tech/articles/multilevel-graph-partitioning-on-gpu-supercomputers-142978.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24264>)

Author: Michael S. Gilbert, Erik G. Boman, Kamesh Madduri

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>), [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Distributed Systems & Parallel Computing](<https://devfeed.tech/topics/distributed-systems-parallel-computing.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [graph theory](<https://devfeed.tech/topics/graph-theory.md>)

Tags: [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [graph](<https://devfeed.tech/tags/graph.md>), [multi-gpu](<https://devfeed.tech/tags/multi-gpu.md>), [optimize](<https://devfeed.tech/tags/optimize.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [partitioning](<https://devfeed.tech/tags/partitioning.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [supercomputers](<https://devfeed.tech/tags/supercomputers.md>)

### AI overview

The work presents a distributed multi-GPU graph partitioner based on the single-GPU Jet partitioner, aiming to improve scalability while preserving solution quality. It uses CUDA-aware MPI, one-sided communication, and a bulk-synchronous parallel structure. The authors report solution quality comparable to Jet and weak scaling up to 256 GPUs, allowing it to partition instances larger than a single-GPU partitioner can handle.

### Source excerpt

arXiv:2611.24264v1 Announce Type: new Abstract: Graph partitioning is a key enabler in computational science, with applications to sparse linear algebra, load-balanced parallel computation, and graph computations. In recent years, graphics processing units (GPUs) have become the preferred accelerator on the world's top supercomputers. Despite this, most existing distributed graph partitioners do not utilize GPUs. In this work, we develop a new multi-GPU distributed partitioner based on Jet, a prior single-GPU partitioner. We seek to optimize scalability without sacrificing quality. Our partitioner utilizes CUDA-aware MPI, one-sided communication routines, and an overall bulk-synchronous parallel structure. We demonstrate solution quality comparable to Jet. Our experiments show excellent weak scaling up to 256 GPUs, enabling partitioning of instances significantly larger than a single-GPU partitioner can handle.

## LEDGE: An Efficient Simulator for Distributed LLM Serving on Heterogeneous Edge Devices

DevFeed: [LEDGE: An Efficient Simulator for Distributed LLM Serving on Heterogeneous Edge Devices](<https://devfeed.tech/articles/ledge-an-efficient-simulator-for-distributed-llm-serving-on-heterogeneous-edge-devices-142754.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24085>)

Author: Zihao Wang, Ye Tian, Tajana Rosing, Nalini Venkatasubramanian

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [qwen](<https://devfeed.tech/topics/qwen.md>), [resource orchestration](<https://devfeed.tech/topics/resource-orchestration.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [edge](<https://devfeed.tech/tags/edge.md>), [edge-devices](<https://devfeed.tech/tags/edge-devices.md>), [jetson](<https://devfeed.tech/tags/jetson.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-serving](<https://devfeed.tech/tags/llm-serving.md>), [pipeline-parallelism](<https://devfeed.tech/tags/pipeline-parallelism.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [raspberry](<https://devfeed.tech/tags/raspberry.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [simulator](<https://devfeed.tech/tags/simulator.md>), [source-code](<https://devfeed.tech/tags/source-code.md>)

### AI overview

LEDGE simulates distributed LLM serving on heterogeneous edge devices without executing tensor operations. It builds event graphs for non-uniform tensor and pipeline parallelism, estimates execution costs with reusable performance models calibrated from end-to-end measurements, and models shared-link contention. On a 10-device Jetson and Raspberry Pi testbed, it covered 17 model-precision combinations across four LLM families. For Qwen deployments, request-level MAPE was below 3.6%, with 135.3x aggregate speedup over physical inference. Models calibrated on one family achieved 7.44% zero-shot end-to-end latency MAPE across three others. The authors also report simulations showing effects of shared-link contention on placement and network topology on scaling; 26,773 runs across four edge environments took 83.8 minutes.

### Source excerpt

arXiv:2611.24085v1 Announce Type: cross Abstract: Evaluating distributed large language model (LLM) serving on heterogeneous edge devices requires exploring diverse model partitions, device placements, and network conditions, making repeated physical experiments costly. An efficient simulator for edge LLM serving must support diverse, fine-grained placement configurations, capture runtime behavior, and accurately predict execution times while keeping simulation overhead low. We present LEDGE, a lightweight simulator for fast, fine-grained evaluation of distributed LLM serving on heterogeneous edge devices without executing tensor operations. LEDGE constructs event graphs supporting non-uniform tensor and pipeline parallelism, estimates execution costs using reusable performance models calibrated from end-to-end measurements, and simulates shared-link contention. We evaluate LEDGE on a heterogeneous testbed of 10 Jetson and Raspberry Pi devices, covering 17 model--precision combinations across 4 LLM families. On Qwen deployments, LEDGE achieves request-level mean absolute percentage errors below 3.6% and a 135.3 times aggregate speedup over physical inference. Performance model calibrated on one LLM family yield 7.44% zero-shot end-to-end latency MAPE across three other families. Further simulations show how shared-link contention affects placement decisions and network topology constrains scaling. Across four edge environments, LEDGE completes 26,773 simulation runs in 83.8 minutes, enabling efficient exploration of deployment strategies under diverse resource conditions and serving objectives. The source code is publicly available at https://github.com/gdfwj/LEDGE.

## Training-Free Domain Generation for One-Shot Federated Learning with Server-Side Pre-trained Diffusion Models

DevFeed: [Training-Free Domain Generation for One-Shot Federated Learning with Server-Side Pre-trained Diffusion Models](<https://devfeed.tech/articles/training-free-domain-generation-for-one-shot-federated-learning-with-server-side-pre-trained-diffusion-models-142722.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23908>)

Author: Yixuan Tong, Yuanguo Bi, Mingjian Zhi, Wenchao Xu, Yuan Wu

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Federated Learning](<https://devfeed.tech/topics/federated-learning.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [ai-image-generator](<https://devfeed.tech/topics/ai-image-generator.md>), [stable-diffusion](<https://devfeed.tech/topics/stable-diffusion.md>), [Image](<https://devfeed.tech/topics/image.md>)

Tags: [adapter](<https://devfeed.tech/tags/adapter.md>), [class](<https://devfeed.tech/tags/class.md>), [classification](<https://devfeed.tech/tags/classification.md>), [classification-accuracy](<https://devfeed.tech/tags/classification-accuracy.md>), [client](<https://devfeed.tech/tags/client.md>), [communication](<https://devfeed.tech/tags/communication.md>), [costs](<https://devfeed.tech/tags/costs.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [data](<https://devfeed.tech/tags/data.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [diffusion-models](<https://devfeed.tech/tags/diffusion-models.md>), [distributions](<https://devfeed.tech/tags/distributions.md>), [domain](<https://devfeed.tech/tags/domain.md>), [domains](<https://devfeed.tech/tags/domains.md>), [encoder](<https://devfeed.tech/tags/encoder.md>), [entropy](<https://devfeed.tech/tags/entropy.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [federated-learning](<https://devfeed.tech/tags/federated-learning.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generation](<https://devfeed.tech/tags/generation.md>), [guidance](<https://devfeed.tech/tags/guidance.md>)

### AI overview

FedDoG addresses heterogeneous client data in one-shot federated learning by using a server-side pre-trained diffusion model to generate domain-aligned synthetic data. Clients send compact domain representations extracted with a frozen image encoder; a pre-trained image-conditioning adapter uses them as visual guidance. The method adjusts conditioning strength based on domain concentration and filters generated samples for class consistency and predictive entropy. On three benchmarks, the authors report higher-quality synthetic images and better classification accuracy than existing OSFL baselines, alongside 99.9% less client upload and 91.5% less client computation time. These are reported experimental results; the excerpt gives no benchmark names or further evaluation details.

### Source excerpt

arXiv:2611.23908v1 Announce Type: new Abstract: One-shot federated learning (OSFL) has attracted increasing attention for its ability to substantially reduce communication overhead by limiting client-server interaction to a single communication round. Nevertheless, this limited interaction makes learning from heterogeneous client distributions challenging. Diffusion-based OSFL approaches seek to address this challenge by synthesizing data that approximate client distributions. However, existing diffusion-based approaches often impose substantial computational costs on clients and lack effective visual guidance to generate data aligned with client distributions. To address these limitations, we propose FedDoG, a training-free Domain Generation framework that leverages server-side pre-trained diffusion models to synthesize data aligned with client domains. FedDoG extracts compact domain representations using a frozen image encoder, substantially reducing client-side computational and communication costs. These representations are incorporated into the diffusion model through a pre-trained image-conditioning adapter, thereby providing explicit visual guidance for domain generation. To further improve the quality of synthetic data, FedDoG adapts the strength of visual conditioning according to domain concentration and filters generated samples based on class consistency and predictive entropy. Experiments on three benchmarks demonstrate that FedDoG generates higher-quality synthetic images and outperforms existing OSFL baselines in classification accuracy. Meanwhile, FedDoG reduces client upload and computation time by 99.9% and 91.5%, respectively. The code is available at https://github.com/YXTong17/FedDoG.

## eFAIR: Fair LLM Serving under Hourly Electricity Commitments

DevFeed: [eFAIR: Fair LLM Serving under Hourly Electricity Commitments](<https://devfeed.tech/articles/efair-fair-llm-serving-under-hourly-electricity-commitments-142977.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24119>)

Author: You Peng, Youhe Jiang, Chen Wang, Binhang Yuan

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [clean energy data centers](<https://devfeed.tech/topics/clean-energy-data-centers.md>)

Tags: [budget](<https://devfeed.tech/tags/budget.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [electricity](<https://devfeed.tech/tags/electricity.md>), [fairness](<https://devfeed.tech/tags/fairness.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-serving](<https://devfeed.tech/tags/llm-serving.md>), [online](<https://devfeed.tech/tags/online.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [scheduler](<https://devfeed.tech/tags/scheduler.md>), [serving](<https://devfeed.tech/tags/serving.md>), [throughput](<https://devfeed.tech/tags/throughput.md>)

### AI overview

eFAIR coordinates LLM request dispatch, hourly electricity budgeting, and GPU frequency selection to improve fairness under day-ahead electricity commitments. It measures service as each request's output rate relative to its standalone throughput and service entitlement, then uses leximin optimization to prioritize the lowest normalized throughput. Its online scheduler dispatches based on entitlement and progress, reserves electricity for current and expected future work, and uses savings to raise GPU frequencies for requests with higher entitlements. On H20 and H200 configurations with 32 replicas each, it raised tenth-percentile normalized throughput by 28.0%-31.0% over the best budget-feasible baseline, with absolute deviations from hourly commitments below 0.26%. The abstract also reports better balance among concurrent requests and closer alignment of electricity allocation with service demand over time.

### Source excerpt

arXiv:2611.24119v1 Announce Type: new Abstract: Datacenters can procure electricity in day-ahead markets by committing to energy purchases for individual hours. For LLM services operating within these hourly budgets, maximizing aggregate throughput alone may still leave individual requests waiting or receiving much slower service than desired. Fair serving therefore requires improving service for poorly served requests while reserving electricity for later arrivals whose timing and demand are unknown. To compare service across requests, we define normalized throughput as each request's actual output rate divided by the product of its standalone throughput and its service entitlement, a positive weight representing its desired service level. Using this measure, we formulate fair serving as leximin optimization under an hourly electricity constraint, prioritizing requests with the lowest normalized throughput. To address this problem, we present eFAIR, an online scheduler that coordinates request dispatching, electricity budget allocation, and GPU frequency selection through a common normalized-throughput target. Specifically, request dispatching prioritizes requests by desired service level and progress; electricity budget allocation reserves electricity for current and expected future work; and frequency selection uses electricity savings to raise GPU frequencies for requests with higher desired service levels. Evaluations on H20 and H200 configurations, each with 32 replicas, show that eFAIR improves the tenth percentile of normalized throughput by 28.0%-31.0% over the best budget-feasible baseline, while keeping absolute deviations from the hourly electricity commitment below 0.26%. eFAIR also improves throughput balance among concurrent requests and aligns electricity allocation more closely with service demand over time. Together, these results demonstrate how eFAIR improves request-level fairness within an hourly commitment.

## Authenticating IoT Data on Ethereum after Pectra and Fusaka: A Cost Study of Signature Schemes, Batching and Anchoring for Agricultural Supply Chain Finance

DevFeed: [Authenticating IoT Data on Ethereum after Pectra and Fusaka: A Cost Study of Signature Schemes, Batching and Anchoring for Agricultural Supply Chain Finance](<https://devfeed.tech/articles/authenticating-iot-data-on-ethereum-after-pectra-and-fusaka-a-cost-study-of-signature-schemes-batching-and-anchoring-for-agricultural-supply-chain-finance-142969.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23764>)

Author: Ming-Fong Sie, Jian-Hong Chen, Gwan-yen Lin, Yen-Shuo Chen, Shih-wei Liao

Published: 2026-11-19T05:00:00Z

Content type: comparison

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>), [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Blockchain](<https://devfeed.tech/topics/blockchain.md>), [ECDSA](<https://devfeed.tech/topics/ecdsa.md>), [Internet of things](<https://devfeed.tech/topics/iot.md>), [Cryptography](<https://devfeed.tech/topics/cryptography.md>), [Finance](<https://devfeed.tech/topics/finance.md>)

Tags: [1-6](<https://devfeed.tech/tags/1-6.md>), [2](<https://devfeed.tech/tags/2.md>), [2025](<https://devfeed.tech/tags/2025.md>), [abstract](<https://devfeed.tech/tags/abstract.md>), [added](<https://devfeed.tech/tags/added.md>), [after](<https://devfeed.tech/tags/after.md>), [aggregate](<https://devfeed.tech/tags/aggregate.md>), [aggregation](<https://devfeed.tech/tags/aggregation.md>), [application](<https://devfeed.tech/tags/application.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [batching](<https://devfeed.tech/tags/batching.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [data](<https://devfeed.tech/tags/data.md>), [ethereum](<https://devfeed.tech/tags/ethereum.md>), [finance](<https://devfeed.tech/tags/finance.md>), [fusaka](<https://devfeed.tech/tags/fusaka.md>), [iot](<https://devfeed.tech/tags/iot.md>), [study](<https://devfeed.tech/tags/study.md>), [supply-chain](<https://devfeed.tech/tags/supply-chain.md>)

### AI overview

The study finds that batching and Merkle anchoring reduce ECDSA authentication costs sixfold, to 8,963 gas per record, while secp256k1 ECDSA remains the least costly authenticated option after Ethereum's Pectra and Fusaka upgrades. P-256 costs 1.6 times as much per record, the pseudonymous identity-based design 2.7 times, and BLS aggregation 3.9 times, largely because of on-chain hash-to-curve; a transaction fits up to 1,754 ECDSA-authenticated records versus 411 BLS-aggregated records. On a Raspberry Pi Zero 2 W, pairing-based signing takes 5.7 ms compared with 0.29 ms for ECDSA. The upgrades primarily affect feasibility rather than cost. Pairing-based schemes may suit applications needing their added properties, while the identity-based scheme introduces key escrow at the key generation centre. Results are from the abstract; it says the benchmark harness is released for reproducibility.

### Source excerpt

arXiv:2611.23764v1 Announce Type: cross Abstract: Blockchain-based supply chain finance can turn the sensor-recorded production history of smallholder farms into verifiable credit evidence, but only if every record is authenticated and anchored at a cost that scales to large device fleets. Ethereum's 2025 Pectra and Fusaka upgrades changed this cost landscape: they added precompiles for BLS12-381 and P-256, repriced calldata and MODEXP, and capped transaction gas at $2^{24}$. We organize the authentication and anchoring of IoT records into three trust levels, from posting a Merkle root through a trusted aggregator to verifying every device signature on-chain, and implement four replay-protected signature designs: ECDSA over secp256k1 and P-256, BLS aggregate signatures with on-chain hash-to-curve, and a pseudonymous identity-based signature with batch verification. Measured as signed transactions under the rules before and after both upgrades, the upgrades mainly changed which designs are feasible, not their cost. Batching and Merkle anchoring cut the cost of ECDSA authentication sixfold, to 8,963 gas per record, and secp256k1 ECDSA remains the cheapest authenticated design: P-256 costs 1.6 times as much, the identity-based design 2.7 times and BLS aggregation 3.9 times, dominated by on-chain hashing to the curve. One transaction carries at most 1,754 ECDSA-authenticated records but only 411 BLS-aggregated ones. On a Raspberry Pi Zero 2 W, pairing-based signing takes 5.7 ms against 0.29 ms for ECDSA. Pairing-based designs pay off only when the application needs their additional properties, and the identity-based design adds key escrow at the key generation centre. The benchmark harness is released for reproducibility.

## Locality-Aware Scheduling for Stream Processing Applications in Serverless Environments

DevFeed: [Locality-Aware Scheduling for Stream Processing Applications in Serverless Environments](<https://devfeed.tech/articles/locality-aware-scheduling-for-stream-processing-applications-in-serverless-environments-142973.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23879>)

Author: Tianyu Qi, Maria A. Rodriguez, Rajkumar Buyya

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [scheduling](<https://devfeed.tech/topics/scheduling.md>), [stream-processing](<https://devfeed.tech/topics/stream-processing.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>)

Tags: [balance](<https://devfeed.tech/tags/balance.md>), [chaining](<https://devfeed.tech/tags/chaining.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [function](<https://devfeed.tech/tags/function.md>), [function-as-a-service](<https://devfeed.tech/tags/function-as-a-service.md>), [i-o](<https://devfeed.tech/tags/i-o.md>), [latency](<https://devfeed.tech/tags/latency.md>), [local](<https://devfeed.tech/tags/local.md>), [locality](<https://devfeed.tech/tags/locality.md>), [monitors](<https://devfeed.tech/tags/monitors.md>), [network](<https://devfeed.tech/tags/network.md>), [operator](<https://devfeed.tech/tags/operator.md>), [operators](<https://devfeed.tech/tags/operators.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [reduce](<https://devfeed.tech/tags/reduce.md>), [routing](<https://devfeed.tech/tags/routing.md>), [scheduling](<https://devfeed.tech/tags/scheduling.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [stream-processing](<https://devfeed.tech/tags/stream-processing.md>)

### AI overview

LcSched targets a locality tradeoff in stateful serverless stream pipelines: keeping each operator's state with its execution can force chained invocations to cross workers, raising latency and I/O overhead. The distributed strategy aims to run chained invocations locally while ensuring they access state on the same worker, and monitors runtime workload to balance workers. The abstract reports up to 3.6x higher throughput and up to 79% lower end-to-end latency than the state-of-the-art distributed scheduling strategy for stateful serverless environments.

### Source excerpt

arXiv:2611.23879v1 Announce Type: new Abstract: Stateful Serverless (Function-as-a-Service) environment are increasingly used for stream processing applications. These applications are often structured as pipelines where data flows through a sequence of distinct processing operators. Many operators are stateful and require access to the processing state during execution. To address this, stateful serverless platforms introduce state servers on worker nodes, co-locating state with computation to dramatically reduce access latency. In serverless, these data pipelines are realized by chaining function invocations, passing the processed data from one function to the next. To reduce network overhead, state-of-the-art scheduling approaches employ a distributed worker-level scheduling model, routing locally generated chained requests directly to destination workers, bypassing centralized schedulers. However, these approaches always co-locate state and execution for the same operator in the same worker, which forces most invocations to the next operator to be transferred across workers, thereby increasing both latency and I/O overhead. As a result, this paper proposes LcSched, a novel distributed scheduling strategy tailored for stream processing applications in stateful serverless environments. LcSched seeks to maximise local execution of chained function invocations while ensuring that each execution accesses its state from the local worker. It also monitors workload at runtime to maintain workload balance between workers. Experimental results show that LcSched improves throughput by up to 3.6x and reduces end-to-end latency by up to 79% compared to the state-of-the-art distributed scheduling strategy for stateful serverless environments.

## Dissecting an Unexplored SASS Control-Code Field: Barrier Exemption and Programmable Warp Priority

DevFeed: [Dissecting an Unexplored SASS Control-Code Field: Barrier Exemption and Programmable Warp Priority](<https://devfeed.tech/articles/dissecting-an-unexplored-sass-control-code-field-barrier-exemption-and-programmable-warp-priority-142981.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24437>)

Author: Ziwen Wang, Qi Luo, Kunlin Li, Changxi Liu, Dongsheng Wang, Yun Chen

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Robotics](<https://devfeed.tech/topics/robotics.md>), [code analysis](<https://devfeed.tech/topics/code-analysis.md>), [inlining](<https://devfeed.tech/topics/inlining.md>)

Tags: [binaries](<https://devfeed.tech/tags/binaries.md>), [control](<https://devfeed.tech/tags/control.md>), [cs-ar](<https://devfeed.tech/tags/cs-ar.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-pf](<https://devfeed.tech/tags/cs-pf.md>), [exemption](<https://devfeed.tech/tags/exemption.md>), [llm-inference](<https://devfeed.tech/tags/llm-inference.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [optimizations](<https://devfeed.tech/tags/optimizations.md>), [priority](<https://devfeed.tech/tags/priority.md>), [sass](<https://devfeed.tech/tags/sass.md>), [scheduling](<https://devfeed.tech/tags/scheduling.md>), [warp](<https://devfeed.tech/tags/warp.md>)

### AI overview

The unexplored SASS control-code field governs two independent scheduling mechanisms: EXEMPT lets instructions blocked by a pending barrier issue during the wait, while START, TILE, and END move warps among three hardware priority levels. The study uses instruction-level microbenchmarks to identify when these mechanisms can improve performance and applies them through a post-compilation binary optimizer, without changing source code or the compiler. Across six GPUs spanning four architectures, optimizations improve representative kernels by up to 31.9%; production kernels in llama.cpp and vLLM by up to 5.4%; and end-to-end LLM inference by up to 3.6%.

### Source excerpt

arXiv:2611.24437v1 Announce Type: cross Abstract: Every instruction in NVIDIA's native GPU ISA (SASS) carries a control code that guides hardware scheduling, and prior work has decoded its known fields to optimize GPU kernels. However, one control-code field remains unexplored: it appears over 500000 times in NVIDIA's closed-source libraries such as cuBLAS and cuDNN, yet nvcc never emits it when compiling user programs. This paper presents the first systematic study of this control-code field across GPU architectures from Volta to Blackwell. Using instruction-level microbenchmarks, we show that the field controls two independent hardware mechanisms: barrier exemption (EXEMPT), which allows instructions blocked by a pending barrier to issue early during the barrier wait, and programmable warp priority (START, TILE, and END), which moves warps across three priority levels in the hardware scheduler. We identify the conditions under which each mechanism improves GPU kernel performance and implement a post-compilation binary optimizer that places these marks directly in compiled binaries without modifying source code or the compiler. Evaluated across six GPUs spanning four architectures, our optimizations speed up representative kernels by up to 31.9%, and the optimizer accelerates production kernels in llama.cpp and vLLM by up to 5.4% and end-to-end LLM inference by up to 3.6%.

## ScaleBench: An Extensible and Reproducible Experimental Platform for Kubernetes Autoscaling Research

DevFeed: [ScaleBench: An Extensible and Reproducible Experimental Platform for Kubernetes Autoscaling Research](<https://devfeed.tech/articles/scalebench-an-extensible-and-reproducible-experimental-platform-for-kubernetes-autoscaling-research-142980.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24398>)

Author: Ze Wang, Sajid Alam, Amjad Ullah

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Deployment & Scaling](<https://devfeed.tech/topics/deployment-scaling.md>), [Distributed Systems & Parallel Computing](<https://devfeed.tech/topics/distributed-systems-parallel-computing.md>)

Tags: [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experimental](<https://devfeed.tech/tags/experimental.md>), [integration](<https://devfeed.tech/tags/integration.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [kubernetes-autoscaling](<https://devfeed.tech/tags/kubernetes-autoscaling.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [optimisation](<https://devfeed.tech/tags/optimisation.md>), [performance-evaluation](<https://devfeed.tech/tags/performance-evaluation.md>), [platform](<https://devfeed.tech/tags/platform.md>), [research](<https://devfeed.tech/tags/research.md>)

### AI overview

ScaleBench is a native Kubernetes platform for evaluating autoscalers in a repeatable way while accounting for deployment and integration alongside scaling performance. The paper identifies a practical adoption gap: Kubernetes commonly uses the reactive, CPU-based Horizontal Pod Autoscaler, while research on newer methods has paid limited attention to their deployment complexity and operational overhead. ScaleBench integrates autoscalers as native Kubernetes components, and a case study evaluating multiple approaches demonstrates its use for systematic assessment in realistic cloud-native environments. The excerpt does not report specific comparative results.

### Source excerpt

arXiv:2611.24398v1 Announce Type: new Abstract: Autoscaling enables cloud-native applications to meet their SLOs by dynamically adjusting computational resources at runtime. Recent research has explored a broad range of advanced autoscaling approaches, including rule-based, optimisation-based, and machine learning-based techniques, to address the limitations of traditional resource management strategies in cloud-native environments. Despite significant advances, a considerable gap remains between academic innovations and their practical adoption in real-world environments. For instance, Kubernetes deployments commonly rely on the reactive, CPU-based Horizontal Pod Autoscaler, limiting the adoption of more advanced autoscaling approaches. Recent studies have investigated challenges such as autoscaler configuration and reproducible performance evaluation; however, the practical deployment, integration complexity, and operational overhead of research-based autoscalers in Kubernetes environments have received limited attention. To address this gap, we present ScaleBench, a native Kubernetes experimental platform to enable extensible and reproducible evaluation of autoscaling solutions. Unlike existing approaches, ScaleBench integrates autoscalers as native Kubernetes components, allowing researchers to assess not only scaling performance but also deployment characteristics and integration requirements within realistic cloud-native environments. We demonstrate the effectiveness of ScaleBench by evaluating multiple autoscaling approaches through a case study. The results highlight its capability to support systematic, repeatable, and practical assessment of Kubernetes autoscaling approaches.

## OpenGNS: An Open Dataset of the Gradient Noise Scale across Vision, Language, and Diffusion Models

DevFeed: [OpenGNS: An Open Dataset of the Gradient Noise Scale across Vision, Language, and Diffusion Models](<https://devfeed.tech/articles/opengns-an-open-dataset-of-the-gradient-noise-scale-across-vision-language-and-diffusion-models-142979.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24331>)

Author: Marcel Aach, Jiangtao Wang, Stefan Kesselheim, Andreas Lintermann

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Neural Network](<https://devfeed.tech/topics/neural-network.md>), [scaling laws](<https://devfeed.tech/topics/scaling-laws.md>)

Tags: [autoregressive](<https://devfeed.tech/tags/autoregressive.md>), [batch](<https://devfeed.tech/tags/batch.md>), [classification](<https://devfeed.tech/tags/classification.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [diffusion-models](<https://devfeed.tech/tags/diffusion-models.md>), [diffusion-transformers](<https://devfeed.tech/tags/diffusion-transformers.md>), [gradient](<https://devfeed.tech/tags/gradient.md>), [language](<https://devfeed.tech/tags/language.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [measurements](<https://devfeed.tech/tags/measurements.md>), [metric](<https://devfeed.tech/tags/metric.md>), [modeling](<https://devfeed.tech/tags/modeling.md>), [models](<https://devfeed.tech/tags/models.md>), [mup](<https://devfeed.tech/tags/mup.md>), [noise](<https://devfeed.tech/tags/noise.md>), [open](<https://devfeed.tech/tags/open.md>), [scale](<https://devfeed.tech/tags/scale.md>), [size](<https://devfeed.tech/tags/size.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

OpenGNS releases over 400 Gradient Noise Scale measurement trajectories for ResNets, GPTs, and Diffusion Transformers, covering 11M-1B parameter models trained with muP and dense batch-size and learning-rate sweeps. The authors report that at equivalent loss, GNS remains stable across model sizes under muP, behaving like a consistent "temperature of training." Its relationship to Critical Batch Size appears task-dependent: GNS tends to overestimate CBS for classification and underestimate it for generative tasks, with the direction holding across common CBS definitions.

### Source excerpt

arXiv:2611.24331v1 Announce Type: cross Abstract: The Gradient Noise Scale (GNS) metric measures the signal-to-noise ratio of gradients in stochastic gradient descent and, as shown by McCandlish et al. (2018), can be used to approximate the Critical Batch Size (CBS) during neural network training. Despite its appearance in technical reports of frontier models, no open dataset of GNS measurements across modern architectures exists, limiting systematic study of the metric. We close this gap by releasing OpenGNS, a dataset of more than 400 GNS measurement trajectories spanning three domains: image classification with ResNets, autoregressive language modeling with Generative Pre-trained Transformers (GPTs), and image synthesis with Diffusion Transformers (DiTs), covering models from 11M to 1B parameters trained under Maximal Update Parameterization (muP) with dense batch-size and learning-rate sweeps. Building on this dataset, we study how the GNS depends on hyperparameters, scale, and training progress, and how it relates to the CBS. We find that the GNS behaves as a consistent "temperature of training", remaining stable across model sizes under muP at equivalent loss, and our results suggest task-dependent biases in its relation to the CBS: a tendency to overestimate the CBS for classification and to underestimate it for generative tasks, consistent in direction across common CBS definitions. The dataset is available at https://huggingface.co/datasets/olympique-marcel/OpenGNS

[Next page](<https://devfeed.tech/sources/arxiv-distributed-computing.md?cursor=WyIyMDI2LTExLTE5VDA1OjAwOjAwKzAwOjAwIiwgImIwZGUwZDlhLTZlODMtNDRjOS1iMjNmLTA3NjhmMGM4ZTU0NCJd>)