# GB200

Published articles for GB200.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine

DevFeed: [Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine](<https://devfeed.tech/articles/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine-21079.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine/>)

Author: Tanya Lenz

Published: 2026-09-14T16:39:15Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [Network](<https://devfeed.tech/topics/network.md>), [Python](<https://devfeed.tech/topics/python.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>), [mixtral](<https://devfeed.tech/topics/mixtral.md>), [qwen](<https://devfeed.tech/topics/qwen.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [communication](<https://devfeed.tech/tags/communication.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [mixtral](<https://devfeed.tech/tags/mixtral.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [moe](<https://devfeed.tech/tags/moe.md>), [networks](<https://devfeed.tech/tags/networks.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [performance](<https://devfeed.tech/tags/performance.md>), [python](<https://devfeed.tech/tags/python.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tensors](<https://devfeed.tech/tags/tensors.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>)

### AI overview

This article explains how NVIDIA Transformer Engine and JAX kernel optimizations accelerate dropless Mixture of Experts (MoE) training. It describes bottlenecks from token routing, expert dispatch and gathering, all-to-all communication, and ragged expert matrix operations. In DeepSeek-V3 training on NVIDIA GB200, the optimized approach increased performance from 103 to 1,068 TFLOPS per GPU, a 10.4x improvement.

### Source excerpt

Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE...

## From Wafer-Out to First Token: Codifying Supply Chain Expertise with Nemotron and Palantir Foundry

DevFeed: [From Wafer-Out to First Token: Codifying Supply Chain Expertise with Nemotron and Palantir Foundry](<https://devfeed.tech/articles/from-wafer-out-to-first-token-codifying-supply-chain-expertise-with-nemotron-and-palantir-foundry-6824.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/from-wafer-out-to-first-token-codifying-supply-chain-expertise-with-nemotron-and-palantir-foundry/>)

Author: Elizabeth Goodman

Published: 2026-09-10T09:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [datacenter](<https://devfeed.tech/topics/datacenter.md>), [networking](<https://devfeed.tech/topics/networking.md>), [Software](<https://devfeed.tech/topics/software.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [blackwell](<https://devfeed.tech/tags/blackwell.md>), [compute](<https://devfeed.tech/tags/compute.md>), [cuopt](<https://devfeed.tech/tags/cuopt.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [llms](<https://devfeed.tech/tags/llms.md>), [manufacturing](<https://devfeed.tech/tags/manufacturing.md>), [memory](<https://devfeed.tech/tags/memory.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [networking](<https://devfeed.tech/tags/networking.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-blackwell](<https://devfeed.tech/tags/nvidia-blackwell.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [performance](<https://devfeed.tech/tags/performance.md>), [production](<https://devfeed.tech/tags/production.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [software](<https://devfeed.tech/tags/software.md>), [supply-chain](<https://devfeed.tech/tags/supply-chain.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>)

### AI overview

NVIDIA describes how it measures and reduces the time from wafer-out to first token across complex Grace Blackwell and Vera Rubin supply chains. The article focuses on time-to-rack, critical material allocation, real-time visibility, redundancy, reliability, and codifying human expertise.

### Source excerpt

NVIDIA has one of the largest and most complex supply chains in the world, and its performance is measured from wafer-out to first token. The interval is in two...

## Micron 6600 ION 245TB: Swap the Hard Drives, Power an NVL72 for Free

DevFeed: [Micron 6600 ION 245TB: Swap the Hard Drives, Power an NVL72 for Free](<https://devfeed.tech/articles/micron-6600-ion-245tb-swap-the-hard-drives-power-an-nvl72-for-free-12385.md>)

Original publisher: [Read original article](<https://www.storagereview.com/review/micron-6600-ion-245tb-swap-the-hard-drives-power-an-nvl72-for-free>)

Author: Brian Beeler

Published: 2026-09-03T17:00:39Z

Content type: article

Language: en

Sources: [StorageReview.com](<https://devfeed.tech/sources/storagereview-com.md>)

Topics: [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [datacenter](<https://devfeed.tech/topics/datacenter.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Server](<https://devfeed.tech/topics/server.md>), [dell](<https://devfeed.tech/topics/dell.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [compute](<https://devfeed.tech/tags/compute.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [dell](<https://devfeed.tech/tags/dell.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hdd](<https://devfeed.tech/tags/hdd.md>), [measurements](<https://devfeed.tech/tags/measurements.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [performance](<https://devfeed.tech/tags/performance.md>), [servers](<https://devfeed.tech/tags/servers.md>), [ssd](<https://devfeed.tech/tags/ssd.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

This article evaluates replacing eight 30TB nearline HDDs with one 245TB Micron 6600 ION SSD. Its measurements indicate lower power consumption, substantially higher read efficiency, and a reduction from 22 racks of HDD storage to six racks of flash at exabyte scale, potentially freeing enough power for a GB200 NVL72.

### Source excerpt

For two decades, the SSD-versus-HDD conversation ended the same way: flash wins on performance, disk wins on price per terabyte, and the size of that price gap settled the argument in favor of bulk storage. As storage technology has matured and AI has taken over, that framing is clearly out of date. The largest data The post Micron 6600 ION 245TB: Swap the Hard Drives, Power an NVL72 for Free appeared first on StorageReview.com.

## GPU-Accelerated Clustering for Financial Instruments at Scale

DevFeed: [GPU-Accelerated Clustering for Financial Instruments at Scale](<https://devfeed.tech/articles/gpu-accelerated-clustering-for-financial-instruments-at-scale-6832.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/gpu-accelerated-clustering-for-financial-instruments-at-scale/>)

Author: Elizabeth Goodman

Published: 2026-08-21T16:21:04Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [GPU](<https://devfeed.tech/topics/gpu.md>), [Algorithm](<https://devfeed.tech/topics/algorithm.md>), [Matrix](<https://devfeed.tech/topics/matrix-org.md>)

Tags: [batch](<https://devfeed.tech/tags/batch.md>), [communication](<https://devfeed.tech/tags/communication.md>), [data-analytics-processing](<https://devfeed.tech/tags/data-analytics-processing.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [financial-services](<https://devfeed.tech/tags/financial-services.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [memory](<https://devfeed.tech/tags/memory.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [post](<https://devfeed.tech/tags/post.md>), [scale](<https://devfeed.tech/tags/scale.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

A GPU-accelerated workflow uses rolling correlation and tail-dependence matrices to cluster financial instruments for portfolio construction, risk aggregation, statistical arbitrage, and trade surveillance. Its adaptive SymNMF-based solver supports soft factor loadings and hard cluster labels, while memory-efficient and distributed implementations scale from single GPUs to one million instruments across multiple nodes.

### Source excerpt

Use AdaptGrow, a GPU-accelerated matrix factorization algorithm, to turn rolling correlation and tail-dependence matrices into hard clusters, soft factor...

## NVIDIA Exemplar Cloud: Lessons for Unlocking Full Performance on AI Infrastructure

DevFeed: [NVIDIA Exemplar Cloud: Lessons for Unlocking Full Performance on AI Infrastructure](<https://devfeed.tech/articles/nvidia-exemplar-cloud-lessons-for-unlocking-full-performance-on-ai-infrastructure-6891.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/nvidia-exemplar-cloud-lessons-for-unlocking-full-performance-on-ai-infrastructure/>)

Author: Elizabeth Goodman

Published: 2026-07-30T16:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [debugging](<https://devfeed.tech/topics/debugging.md>), [Processes](<https://devfeed.tech/topics/processes.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [blackwell](<https://devfeed.tech/tags/blackwell.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [debugging](<https://devfeed.tech/tags/debugging.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dgx-cloud](<https://devfeed.tech/tags/dgx-cloud.md>), [diagnostics](<https://devfeed.tech/tags/diagnostics.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gb300-nvl72](<https://devfeed.tech/tags/gb300-nvl72.md>), [grace-cpu](<https://devfeed.tech/tags/grace-cpu.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [hopper](<https://devfeed.tech/tags/hopper.md>), [infiniband](<https://devfeed.tech/tags/infiniband.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [linux](<https://devfeed.tech/tags/linux.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [performance](<https://devfeed.tech/tags/performance.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

A troubleshooting guide for closing AI-training throughput gaps between NVIDIA reference architectures and partner clusters. It covers configuration and installation issues across memory management, CPU power and NUMA placement, NCCL queue-pair concurrency, and hardware setup.

### Source excerpt

Two AI computing clusters built from identical NVIDIA H100, GB200 NVL72, or GB300 NVL72 systems can deliver materially different training throughput. We...

## Reducing High-Bandwidth Memory Bottlenecks in JAX-Based LLM Training with Host Offloading

DevFeed: [Reducing High-Bandwidth Memory Bottlenecks in JAX-Based LLM Training with Host Offloading](<https://devfeed.tech/articles/reducing-high-bandwidth-memory-bottlenecks-in-jax-based-llm-training-with-host-offloading-6925.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/reducing-high-bandwidth-memory-bottlenecks-in-jax-based-llm-training-with-host-offloading/>)

Author: Tanya Lenz

Published: 2026-07-10T18:17:40Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [systems](<https://devfeed.tech/topics/systems.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [blackwell](<https://devfeed.tech/tags/blackwell.md>), [compute](<https://devfeed.tech/tags/compute.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [grace-cpu](<https://devfeed.tech/tags/grace-cpu.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-techniques](<https://devfeed.tech/tags/llm-techniques.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>), [work](<https://devfeed.tech/tags/work.md>)

### AI overview

This article explains how host offloading in JAX-based large language model training reduces GPU high-bandwidth memory pressure by moving selected activations to pinned host memory and streaming them back during the backward pass. It discusses activation-transfer overlap, NVIDIA Grace Blackwell and GB200 NVL72 systems, and experiments involving Llama 3.1 405B and DeepSeek-V3 671B.

### Source excerpt

Large language model (LLM) training workloads increasingly run into GPU memory limits before compute is fully used. Model weights, gradients, optimizer states,...

## Running Low-Latency Analytical Workloads with GPU-Accelerated Presto on NVIDIA GB200 NVL72

DevFeed: [Running Low-Latency Analytical Workloads with GPU-Accelerated Presto on NVIDIA GB200 NVL72](<https://devfeed.tech/articles/running-low-latency-analytical-workloads-with-gpu-accelerated-presto-on-nvidia-gb200-nvl72-6935.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/running-low-latency-analytical-workloads-with-gpu-accelerated-presto-on-nvidia-gb200-nvl72/>)

Author: Tanya Lenz

Published: 2026-07-08T16:05:25Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [GPU](<https://devfeed.tech/topics/gpu.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [GPUDirect](<https://devfeed.tech/topics/gpudirect.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [C++](<https://devfeed.tech/topics/c-plus-plus.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>)

Tags: [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [c-plus-plus](<https://devfeed.tech/tags/c-plus-plus.md>), [cache](<https://devfeed.tech/tags/cache.md>), [communication](<https://devfeed.tech/tags/communication.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [data](<https://devfeed.tech/tags/data.md>), [data-analytics](<https://devfeed.tech/tags/data-analytics.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpudirect](<https://devfeed.tech/tags/gpudirect.md>), [latency](<https://devfeed.tech/tags/latency.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [multi-gpu](<https://devfeed.tech/tags/multi-gpu.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [performance](<https://devfeed.tech/tags/performance.md>)

### AI overview

This article presents GPU-accelerated Presto for low-latency analytical SQL workloads on large datasets. It compares single-node multi-GPU execution on NVIDIA DGX B200 and multinode NVIDIA GB200 NVL72 systems with CPU-based Presto, highlighting NVLink communication, GPUDirect Storage, cuDF algorithms, Parquet data, and benchmark results.

### Source excerpt

Presto is an open source, distributed SQL engine for running fast, interactive queries on very large datasets. On NVIDIA GPUs, Presto delivers peak performance...

## NVIDIA Dynamo 1.0 Is Available to DigitalOcean Customers for Inference Performance and Cost Efficiency

DevFeed: [NVIDIA Dynamo 1.0 Is Available to DigitalOcean Customers for Inference Performance and Cost Efficiency](<https://devfeed.tech/articles/meet-the-new-standard-for-high-performance-low-cost-inference-nvidia-dynamo-1-0-is-now-available-to-digitalocean-customers-19923.md>)

Original publisher: [Read original article](<https://www.digitalocean.com/blog/nvidia-dynamo-1-now-available>)

Author: Waverly Swinton

Published: 2026-03-19T22:13:37Z

Content type: release

Language: en

Sources: [DigitalOcean](<https://devfeed.tech/sources/digitalocean.md>)

Topics: [Dynamo](<https://devfeed.tech/topics/dynamo.md>), [Digital Ocean](<https://devfeed.tech/topics/digital-ocean.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [sglang](<https://devfeed.tech/topics/sglang.md>), [TensorRT-LLM](<https://devfeed.tech/topics/tensorrt-llm.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>)

Tags: [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cost](<https://devfeed.tech/tags/cost.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [digitalocean](<https://devfeed.tech/tags/digitalocean.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [load-balancing](<https://devfeed.tech/tags/load-balancing.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [product-updates](<https://devfeed.tech/tags/product-updates.md>), [routing](<https://devfeed.tech/tags/routing.md>), [sglang](<https://devfeed.tech/tags/sglang.md>), [tensorrt-llm](<https://devfeed.tech/tags/tensorrt-llm.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

NVIDIA Dynamo 1.0 is now available to DigitalOcean customers as an inference service framework for large-scale generative AI workloads. The article describes claimed performance improvements on NVIDIA GB200 NVL systems, cost-efficiency benefits, deployment options, and features including GPU-aware routing and disaggregated serving.

### Source excerpt

NVIDIA Dynamo 1.0, which was released on Monday at NVIDIA GTC, is now available to DigitalOcean customers to help drive performance enhancements and cost efficiency. NVIDIA Dynamo 1.0 offers a 7x inference performance increase on NVIDIA GB200 NVL systems, and by pairing it with DigitalOcean's Agentic Inference Cloud, customers can achieve higher performance at lower costs while benefiting from seamless deployment. Working together, DigitalOcean's optimizations with NVIDIA have already achieved a 67% cost savings for customers like Workato, and this new generation of Dynamo can unlock even greater gains for businesses who run production-grade agentic workflows. DigitalOcean customers can get access to NVIDIA Dynamo 1.0 as a container image that can be run on a Droplet or can deploy directly on DigitalOcean Kubernetes with an inference runtime (vLLM, SGlang, TensorRT). What is NVIDIA Dynamo 1.0? NVIDIA Dynamo is a cutting-edge, high-performance inference service framework specifically designed to accelerate and optimize large-scale generative AI and inference models. Dynamo is an orchestration layer that sits above engines like vLLM, SGLang, and NVIDIA TensorRT-LLM. Think of it as the distributed traffic controller for your GPU fleet, seamlessly orchestrating GPU and memory resources across a cluster and reducing bottleneck by intelligently routing requests Key technical breakthroughs offered by Dynamo 1.0 include: 7x Performance Boost: When paired with NVIDIA Blackwell Ultra GPUs, Dynamo can increase inference performance by up to 7x, significantly lowering your cost per token. KV-Aware Routing: Instead of simple round-robin load balancing, Dynamo routes requests to the specific GPUs that already have the relevant "memory" from previous turns of a conversation. Disaggregated Serving: Dynamo splits the "prefill" (reading the prompt) and "decode" (generating the answer) phases across different GPUs to maximize utilization and reduce latency. Memory Offloading: The KV B

## QEMU version 10.1.0 released

DevFeed: [QEMU version 10.1.0 released](<https://devfeed.tech/articles/qemu-version-10-1-0-released-32653.md>)

Original publisher: [Read original article](<https://www.qemu.org/2025/08/26/qemu-10-1-0/>)

Published: 2025-08-26T23:25:00Z

Content type: release

Language: en

Sources: [QEMU](<https://devfeed.tech/sources/qemu.md>)

Topics: [qemu](<https://devfeed.tech/topics/qemu.md>), [version](<https://devfeed.tech/topics/version.md>), [virtualization](<https://devfeed.tech/topics/virtualization.md>), [virtual machines](<https://devfeed.tech/topics/virtual-machines.md>), [RISC-V](<https://devfeed.tech/topics/riscv.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [Kernel](<https://devfeed.tech/topics/kernel.md>), [Arm](<https://devfeed.tech/topics/arm.md>), [InfiniBand](<https://devfeed.tech/topics/infiniband.md>), [intel](<https://devfeed.tech/topics/intel.md>), [GB200](<https://devfeed.tech/topics/gb200.md>)

Tags: [arm](<https://devfeed.tech/tags/arm.md>), [cxl](<https://devfeed.tech/tags/cxl.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [intel](<https://devfeed.tech/tags/intel.md>), [ipv6](<https://devfeed.tech/tags/ipv6.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [kvm](<https://devfeed.tech/tags/kvm.md>), [migration](<https://devfeed.tech/tags/migration.md>), [qemu](<https://devfeed.tech/tags/qemu.md>), [qemu-10-1](<https://devfeed.tech/tags/qemu-10-1.md>), [rdma](<https://devfeed.tech/tags/rdma.md>), [release](<https://devfeed.tech/tags/release.md>), [releases](<https://devfeed.tech/tags/releases.md>), [risc-v](<https://devfeed.tech/tags/risc-v.md>), [version](<https://devfeed.tech/tags/version.md>), [virtual-machines](<https://devfeed.tech/tags/virtual-machines.md>), [virtualization](<https://devfeed.tech/tags/virtualization.md>), [x86](<https://devfeed.tech/tags/x86.md>)

### AI overview

QEMU 10.1.0 has been released with more than 2,700 commits from 226 authors. Highlights include confidential-guest support, live-migration improvements, Windows guest load querying, new ARM and RISC-V capabilities, and expanded KVM and x86 virtualization support.

### Source excerpt

We'd like to announce the availability of the QEMU 10.1.0 release. This release contains 2700+ commits from 226 authors.

## Introducing Training Cluster as a Service - a new collaboration with NVIDIA

DevFeed: [Introducing Training Cluster as a Service - a new collaboration with NVIDIA](<https://devfeed.tech/articles/introducing-training-cluster-as-a-service-a-new-collaboration-with-nvidia-7373.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nvidia-training-cluster>)

Author: Jeff Boudier; Arjuna; Simon Pagezy

Published: 2025-06-11T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [anthropic](<https://devfeed.tech/topics/anthropic.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [Hopper](<https://devfeed.tech/topics/hopper.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>)

Tags: [announcement](<https://devfeed.tech/tags/announcement.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [dgx-cloud](<https://devfeed.tech/tags/dgx-cloud.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hopper](<https://devfeed.tech/tags/hopper.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [libraries](<https://devfeed.tech/tags/libraries.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [partners](<https://devfeed.tech/tags/partners.md>), [partnerships](<https://devfeed.tech/tags/partnerships.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

Hugging Face and NVIDIA introduce Training Cluster as a Service, connecting organizations with GPU cluster capacity for AI model training. Organizations can request clusters sized for their needs and pay for the duration of training runs. The service combines NVIDIA Cloud Partners, NVIDIA DGX Cloud Lepton, and Hugging Face developer resources and open source libraries, with Hugging Face and NVIDIA coordinating procurement, pricing, provisioning, and setup.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.