# NVIDIA Developer

News and tutorials for developers, data scientists, and IT admins

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Enabling Real-Time AI for Scientific Instruments with GPU-Native Data Acquisition

DevFeed: [Enabling Real-Time AI for Scientific Instruments with GPU-Native Data Acquisition](<https://devfeed.tech/articles/enabling-real-time-ai-for-scientific-instruments-with-gpu-native-data-acquisition-143888.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/enabling-real-time-ai-for-scientific-instruments-with-gpu-native-data-acquisition/>)

Author: Cara Laasch

Published: 2026-11-19T17:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Holoscan](<https://devfeed.tech/topics/holoscan.md>), [streaming data analytics](<https://devfeed.tech/topics/streaming-data-analytics.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>)

Tags: [acquisition](<https://devfeed.tech/tags/acquisition.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [bandwidth](<https://devfeed.tech/tags/bandwidth.md>), [batch](<https://devfeed.tech/tags/batch.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [communication](<https://devfeed.tech/tags/communication.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [connectx](<https://devfeed.tech/tags/connectx.md>), [control](<https://devfeed.tech/tags/control.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [data](<https://devfeed.tech/tags/data.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dgx-spark](<https://devfeed.tech/tags/dgx-spark.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [instruments](<https://devfeed.tech/tags/instruments.md>), [measurements](<https://devfeed.tech/tags/measurements.md>), [networking-communications](<https://devfeed.tech/tags/networking-communications.md>), [processes](<https://devfeed.tech/tags/processes.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [sc26](<https://devfeed.tech/tags/sc26.md>), [science](<https://devfeed.tech/tags/science.md>), [sensor](<https://devfeed.tech/tags/sensor.md>)

### AI overview

NVIDIA DAQIRI moves high-bandwidth sensor data directly into GPU memory so it can be processed during acquisition, enabling real-time inspection and feedback without first writing measurements to disk. At Lawrence Berkeley National Laboratory's Molecular Foundry, a high-dynamic-range electron microscopy camera streams over 500 Gbps; DAQIRI and GPU processing assemble and correct detector frames, derive energy-loss spectra, and improve spatial resolution from 5-micrometer sensor pixels to submicron resolution. The latest release adds packet reordering on supported NVIDIA ConnectX-7-or-newer NICs, an ibverbs backend, and direct polling. The ibverbs engine benchmarks at about twice the previous DPDK backend's per-core throughput for packets up to 1,024 bytes at rates above 200 Gbps on specified NVIDIA platforms. Direct polling avoids a separate I/O-worker handoff; cabled loopback tests demonstrated roughly 2-4 μs application send-to-receive latency. These results are benchmark-specific, and the excerpt recommends evaluating throughput and latency on the target hardware.

### Source excerpt

In science and industry, analyzing sensor measurements in real time can enable AI to adjust processes, guide experiments, and search for better operating...

## Build Tool-Calling Parsers in Rust with AI Agents

DevFeed: [Build Tool-Calling Parsers in Rust with AI Agents](<https://devfeed.tech/articles/build-tool-calling-parsers-in-rust-with-ai-agents-143887.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/build-tool-calling-parsers-in-rust-with-ai-agents/>)

Author: Keiven Chang

Published: 2026-11-19T16:30:46Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [function calling](<https://devfeed.tech/topics/function-calling.md>), [rust-ai](<https://devfeed.tech/topics/rust-ai.md>), [Test-driven development](<https://devfeed.tech/topics/tdd.md>), [Multi-step AI processes](<https://devfeed.tech/topics/multi-step-ai-processes.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [adapter](<https://devfeed.tech/tags/adapter.md>), [adapting](<https://devfeed.tech/tags/adapting.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [argument](<https://devfeed.tech/tags/argument.md>), [build](<https://devfeed.tech/tags/build.md>), [call](<https://devfeed.tech/tags/call.md>), [can](<https://devfeed.tech/tags/can.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [frontend](<https://devfeed.tech/tags/frontend.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [leak](<https://devfeed.tech/tags/leak.md>), [markup](<https://devfeed.tech/tags/markup.md>), [model](<https://devfeed.tech/tags/model.md>), [rust](<https://devfeed.tech/tags/rust.md>), [tool](<https://devfeed.tech/tags/tool.md>), [tool-calling](<https://devfeed.tech/tags/tool-calling.md>), [turns](<https://devfeed.tech/tags/turns.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Tool-call parsers must separate text, reasoning, and calls while preserving streaming boundaries and avoiding lost data, duplicate calls, or leaked model markup. The article's Rust workflow uses frontend-crates and its shared Conformance Corpus: adapt applicable UNIFIED fixtures, create and human-review GOLDEN expectations against the model specification and related sources, then implement the parser and inspect captured results in the local conformance report. An unavailable tool is reported as generated; the serving layer checks availability, authorization, schema, and policy. Incomplete calls require explicit buffering and end-of-stream recovery rules rather than guessing missing content. CPU fixtures suffice for parser conformance, while end-to-end validation needs Dynamo runtime, discovery services, and model hardware. Further checks should measure speed and memory across input and chunk sizes, verify incremental event delivery and truncation behavior, and test the configured quote-handling policy. Guided decoding may reduce malformed calls but cannot prevent truncation or incorrect tool choices.

### Source excerpt

A tool call can arrive in pieces, an argument can be cut short, or model-specific markup can leak into the answer. A frontend parser turns that output, received...

## Tackling GPU Bottlenecks in Plane-Wave DFT with K-Point Batching and Mixed Precision

DevFeed: [Tackling GPU Bottlenecks in Plane-Wave DFT with K-Point Batching and Mixed Precision](<https://devfeed.tech/articles/tackling-gpu-bottlenecks-in-plane-wave-dft-with-k-point-batching-and-mixed-precision-141012.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/tackling-gpu-bottlenecks-in-plane-wave-dft-with-k-point-batching-and-mixed-precision/>)

Author: Erica Tsai

Published: 2026-11-18T15:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Tensor Cores](<https://devfeed.tech/topics/tensor-cores.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [acceleration](<https://devfeed.tech/tags/acceleration.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-workloads](<https://devfeed.tech/tags/ai-workloads.md>), [aimd](<https://devfeed.tech/tags/aimd.md>), [batching](<https://devfeed.tech/tags/batching.md>), [bottlenecks](<https://devfeed.tech/tags/bottlenecks.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [computational-chemistry-materials-science](<https://devfeed.tech/tags/computational-chemistry-materials-science.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dft](<https://devfeed.tech/tags/dft.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [energy](<https://devfeed.tech/tags/energy.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [learning](<https://devfeed.tech/tags/learning.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [parallel-programming](<https://devfeed.tech/tags/parallel-programming.md>), [precision](<https://devfeed.tech/tags/precision.md>), [quantum-chemistry](<https://devfeed.tech/tags/quantum-chemistry.md>), [sc26](<https://devfeed.tech/tags/sc26.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [software-defined-data-center](<https://devfeed.tech/tags/software-defined-data-center.md>), [supercomputing](<https://devfeed.tech/tags/supercomputing.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

Daviator targets underused GPUs in plane-wave DFT by batching independent k-point and spin work, including the Davidson solver, to reduce kernel launches and raise GPU occupancy. It integrates at VASP call boundaries; users enable it with LDAVIATOR=True, and current use is limited to a single node. A mixed-precision option runs less precision-sensitive work in FP32 while retaining FP64 for sensitive steps, switching back as convergence requires. The gains depend on hardware: mixed precision offers only marginal end-to-end improvement on H100/H200, but about 2x on GPUs with high FP32:FP64 throughput such as RTX PRO 6000. Benchmarks report up to 22x faster execution and 60-75% lower projected dataset-generation cost versus CPU, depending on configuration. These estimates use 13 representative OMat24 inputs and tuned parallel runs; they do not establish identical gains for every workload. A VASP user license is required.

### Source excerpt

Training a next-generation machine learning interatomic potential (MLIP) requires ground truth: tens to hundreds of millions of density functional theory (DFT)...

## Accelerate Molecular Dynamics Simulations with Accurate, Flexible Primitives Using NVIDIA cuPotential

DevFeed: [Accelerate Molecular Dynamics Simulations with Accurate, Flexible Primitives Using NVIDIA cuPotential](<https://devfeed.tech/articles/accelerate-molecular-dynamics-simulations-with-accurate-flexible-primitives-using-nvidia-cupotential-136676.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/accelerate-molecular-dynamics-simulations-with-accurate-flexible-primitives-using-nvidia-cupotential/>)

Author: Yutong Zhao

Published: 2026-11-16T22:30:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Molecular Dynamics](<https://devfeed.tech/topics/molecular-dynamics.md>), [Computational Chemistry / Materials Science](<https://devfeed.tech/topics/computational-chemistry-materials-science.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [RTX PRO](<https://devfeed.tech/topics/rtx-pro.md>)

Tags: [accelerate](<https://devfeed.tech/tags/accelerate.md>), [api](<https://devfeed.tech/tags/api.md>), [biology](<https://devfeed.tech/tags/biology.md>), [chemistry](<https://devfeed.tech/tags/chemistry.md>), [computational-chemistry-materials-science](<https://devfeed.tech/tags/computational-chemistry-materials-science.md>), [cuda-x](<https://devfeed.tech/tags/cuda-x.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [materials-science](<https://devfeed.tech/tags/materials-science.md>), [molecular-dynamics](<https://devfeed.tech/tags/molecular-dynamics.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [physics](<https://devfeed.tech/tags/physics.md>), [sc26](<https://devfeed.tech/tags/sc26.md>), [science](<https://devfeed.tech/tags/science.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [simulations](<https://devfeed.tech/tags/simulations.md>)

### AI overview

NVIDIA cuPotential provides modular GPU primitives for molecular dynamics, targeting long-range electrostatics and dispersion bottlenecks. Its OpenMM plugin replaces the nonbonded force and can also supply a Langevin integrator and Monte Carlo barostat; the excerpt gives Linux build steps using Conda or Micromamba, CUDA 13.1, and OpenMM 8.4.0. Reported NPT benchmarks show over 3x end-to-end speedups on selected RTX PRO 6000 Blackwell systems and gains often around 2x or more on other tested GPUs, for standard non-alchemical systems. The text also reports reduced force error and energy drift under specified comparisons. The plugin targets solvated, roughly uniform-density systems in rectangular periodic boxes; it does not support LJPME, triclinic boxes, or particle and exception parameter offsets. These results and instructions are from the supplied excerpt.

### Source excerpt

Molecular dynamics (MD) is an indispensable tool across physics, chemistry, biology, and materials science. Owing to its arithmetic structure, particularly the...

## NVIDIA Vera Rubin NVL72 Leads Agentic Inference Performance on MLPerf Endpoints v1.0

DevFeed: [NVIDIA Vera Rubin NVL72 Leads Agentic Inference Performance on MLPerf Endpoints v1.0](<https://devfeed.tech/articles/nvidia-vera-rubin-nvl72-leads-agentic-inference-performance-on-mlperf-endpoints-v1-0-136678.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/nvidia-vera-rubin-nvl72-leads-agentic-inference-performance-on-mlperf-endpoints-v1-0/>)

Author: Zhihan Jiang

Published: 2026-11-16T16:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Vera Rubin NVL72](<https://devfeed.tech/topics/vera-rubin-nvl72.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Agentic AI](<https://devfeed.tech/topics/what-is-agentic-ai.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agentic-tasks](<https://devfeed.tech/tags/agentic-tasks.md>), [agentic-workloads](<https://devfeed.tech/tags/agentic-workloads.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [api](<https://devfeed.tech/tags/api.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [blackwell-ultra](<https://devfeed.tech/tags/blackwell-ultra.md>), [co-design](<https://devfeed.tech/tags/co-design.md>), [coding](<https://devfeed.tech/tags/coding.md>), [context](<https://devfeed.tech/tags/context.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [gb300](<https://devfeed.tech/tags/gb300.md>), [groq-3-lpx](<https://devfeed.tech/tags/groq-3-lpx.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [infiniband](<https://devfeed.tech/tags/infiniband.md>), [mlperf](<https://devfeed.tech/tags/mlperf.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-vera-rubin](<https://devfeed.tech/tags/nvidia-vera-rubin.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [tensorrt-llm](<https://devfeed.tech/tags/tensorrt-llm.md>), [tool](<https://devfeed.tech/tags/tool.md>), [top-stories](<https://devfeed.tech/tags/top-stories.md>), [turns](<https://devfeed.tech/tags/turns.md>), [vera-rubin-nvl72](<https://devfeed.tech/tags/vera-rubin-nvl72.md>)

### AI overview

Provisional MLPerf Endpoints v1.0 results report that NVIDIA Vera Rubin NVL72 delivered over 10x the throughput per kilowatt of GB300 NVL72 at a shared minimum average interactivity of 50 tokens per second per user. The comparison uses different configurations and concurrency: Vera Rubin's 32 accelerators served 1,024 queries at 50.4 tokens per second per user, while GB300's 48 accelerators served 48 queries at 56.2; the Vera Rubin results are pending MLCommons verification and peer review. The benchmark checks generated tool calls and workflow intent, with separate SWE-bench Verified evaluations for end-to-end task solving. The excerpt attributes performance to hardware and serving co-design, including HBM4, Tensor Cores, NVLink, prefix caching, state reuse, Dynamo routing, disaggregated prefill and decode, and model-specific kernels. It describes comparisons across throughput and responsiveness without interpolating between measured points.

### Source excerpt

Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool...

## NVIDIA Vera Rubin NVL72 Achieves up to 2x Blackwell Ultra Performance in MLPerf Training v6.1

DevFeed: [NVIDIA Vera Rubin NVL72 Achieves up to 2x Blackwell Ultra Performance in MLPerf Training v6.1](<https://devfeed.tech/articles/nvidia-vera-rubin-nvl72-achieves-up-to-2x-blackwell-ultra-performance-in-mlperf-training-v6-1-136677.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/nvidia-vera-rubin-nvl72-achieves-up-to-2x-blackwell-ultra-performance-in-mlperf-training-v6-1/>)

Author: Farshad Ghodsian

Published: 2026-11-16T16:00:00Z

Content type: news

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Vera Rubin NVL72](<https://devfeed.tech/topics/vera-rubin-nvl72.md>), [NVIDIA Vera Rubin](<https://devfeed.tech/topics/nvidia-vera-rubin.md>), [grpo](<https://devfeed.tech/topics/grpo.md>), [post-training](<https://devfeed.tech/topics/post-training.md>), [GB300 NVL72](<https://devfeed.tech/topics/gb300-nvl72.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [NVIDIA Vera](<https://devfeed.tech/topics/nvidia-vera.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [agentic workflows](<https://devfeed.tech/topics/agentic-workflows.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>), [NVIDIA Spectrum-X Ethernet](<https://devfeed.tech/topics/nvidia-spectrum-x-ethernet.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [a-team](<https://devfeed.tech/tags/a-team.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [blackwell](<https://devfeed.tech/tags/blackwell.md>), [blackwell-ultra](<https://devfeed.tech/tags/blackwell-ultra.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [featured](<https://devfeed.tech/tags/featured.md>), [llm-benchmarking](<https://devfeed.tech/tags/llm-benchmarking.md>), [mlperf](<https://devfeed.tech/tags/mlperf.md>), [models](<https://devfeed.tech/tags/models.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-vera](<https://devfeed.tech/tags/nvidia-vera.md>), [nvidia-vera-rubin](<https://devfeed.tech/tags/nvidia-vera-rubin.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [performance](<https://devfeed.tech/tags/performance.md>), [rubin](<https://devfeed.tech/tags/rubin.md>), [software-defined-data-center](<https://devfeed.tech/tags/software-defined-data-center.md>), [time](<https://devfeed.tech/tags/time.md>), [top-stories](<https://devfeed.tech/tags/top-stories.md>), [train](<https://devfeed.tech/tags/train.md>), [training](<https://devfeed.tech/tags/training.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

In MLPerf Training v6.1, NVIDIA reports that Vera Rubin NVL72 had the fastest time on six of seven benchmarks and delivered 1.4-1.6x the performance of GB300 NVL72 on most workloads. On DeepSeek-V3 671B at 1,024 GPUs, Vera Rubin finished in 4.14 minutes versus GB300's 8.03; GB300 recorded the round's fastest absolute time by scaling to 10,240 GPUs. Vera Rubin also led the new Qwen 3.5 397B GRPO benchmark (10.44 versus 13.78 minutes at 1,024 GPUs), with results using both NeMo RL with TensorRT-LLM and vLLM. The article attributes performance and scaling to the CUDA software stack, rack-level NVLink 6 and cluster networking, and Vera CPUs supporting simulated RL environments. It describes subsequent runs on newer software as unverified and outside MLCommons review.

### Source excerpt

As AI agents tackle increasingly complex workflows, reducing time-to-train is critical for rapidly iterating on both models and the agents they power. MLPerf...

## Post-Training NVIDIA Nemotron to Increase Accuracy in Your Scientific Domain

DevFeed: [Post-Training NVIDIA Nemotron to Increase Accuracy in Your Scientific Domain](<https://devfeed.tech/articles/post-training-nvidia-nemotron-to-increase-accuracy-in-your-scientific-domain-136679.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/post-training-nvidia-nemotron-to-increase-accuracy-in-your-scientific-domain/>)

Author: Gautham Dharuman

Published: 2026-11-16T16:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [post-training](<https://devfeed.tech/topics/post-training.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [rlvr](<https://devfeed.tech/topics/rlvr.md>), [grpo](<https://devfeed.tech/topics/grpo.md>), [agentic workflows](<https://devfeed.tech/topics/agentic-workflows.md>), [AI for science](<https://devfeed.tech/topics/ai-for-science.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>)

Tags: [17](<https://devfeed.tech/tags/17.md>), [adapter](<https://devfeed.tech/tags/adapter.md>), [adapters](<https://devfeed.tech/tags/adapters.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-agents](<https://devfeed.tech/tags/autonomous-agents.md>), [computational-chemistry-materials-science](<https://devfeed.tech/tags/computational-chemistry-materials-science.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [featured](<https://devfeed.tech/tags/featured.md>), [innovation](<https://devfeed.tech/tags/innovation.md>), [machine-learning-artificial-intelligence](<https://devfeed.tech/tags/machine-learning-artificial-intelligence.md>), [natural-language](<https://devfeed.tech/tags/natural-language.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-nemotron](<https://devfeed.tech/tags/nvidia-nemotron.md>), [post-training](<https://devfeed.tech/tags/post-training.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [research](<https://devfeed.tech/tags/research.md>), [sc26](<https://devfeed.tech/tags/sc26.md>), [scientific-computing](<https://devfeed.tech/tags/scientific-computing.md>), [scientific-research](<https://devfeed.tech/tags/scientific-research.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

The excerpt describes adapting Nemotron 3.5 Super VL to scientific tasks with reinforcement learning from verifiable rewards. Experimental records become prompts paired with reference outcomes; a task-specific verifier scores model submissions, so the reward comes from data without human preference labels. In the drug-metabolism example, Morgan fingerprints and Tanimoto similarity score predicted metabolites. The recipe uses NeMo Gym for the environment and NeMo RL for GRPO training with LoRA. It reports SFT improved accuracy by 12%, with RL adding 17% at a 16,384-token output budget. An optional warm start distills teacher traces that meet a similarity threshold; the excerpt reports retaining 1,123 of 1,934 prompts at a threshold of at least 0.7. It emphasizes choosing a reward that reflects the scientific outcome and evaluating on held-out data. These figures and implementation details are specific to the described example.

### Source excerpt

Agentic AI is reshaping scientific research and innovation. Researchers communicate complex scientific hypotheses in natural language and let autonomous agents...

## Faster Scientific Simulations with New FP64 Algorithms in NVIDIA cuBLAS

DevFeed: [Faster Scientific Simulations with New FP64 Algorithms in NVIDIA cuBLAS](<https://devfeed.tech/articles/faster-scientific-simulations-with-new-fp64-algorithms-in-nvidia-cublas-133565.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/faster-scientific-simulations-with-new-fp64-algorithms-in-nvidia-cublas/>)

Author: Cole Brower

Published: 2026-11-13T22:13:51Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Tensor Cores](<https://devfeed.tech/topics/tensor-cores.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [Computational Chemistry / Materials Science](<https://devfeed.tech/topics/computational-chemistry-materials-science.md>), [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Materials science and engineering](<https://devfeed.tech/topics/materials-science-and-engineering.md>), [Supercomputing](<https://devfeed.tech/topics/supercomputing.md>), [RTX PRO](<https://devfeed.tech/topics/rtx-pro.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [3m](<https://devfeed.tech/tags/3m.md>), [64-bit](<https://devfeed.tech/tags/64-bit.md>), [a100](<https://devfeed.tech/tags/a100.md>), [algorithms](<https://devfeed.tech/tags/algorithms.md>), [chemistry](<https://devfeed.tech/tags/chemistry.md>), [computing](<https://devfeed.tech/tags/computing.md>), [cublas](<https://devfeed.tech/tags/cublas.md>), [cuda-x](<https://devfeed.tech/tags/cuda-x.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [execution](<https://devfeed.tech/tags/execution.md>), [faster](<https://devfeed.tech/tags/faster.md>), [general](<https://devfeed.tech/tags/general.md>), [hpc-scientific-computing](<https://devfeed.tech/tags/hpc-scientific-computing.md>), [materials](<https://devfeed.tech/tags/materials.md>), [materials-science](<https://devfeed.tech/tags/materials-science.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [precision](<https://devfeed.tech/tags/precision.md>), [science](<https://devfeed.tech/tags/science.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [simulations](<https://devfeed.tech/tags/simulations.md>), [time](<https://devfeed.tech/tags/time.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

CUDA Toolkit 13.4.2 cuBLAS can accelerate double-precision DGEMM and complex ZGEMM on integer Tensor Cores while preserving FP64-equivalent accuracy. Ozaki-II uses the Chinese Remainder Theorem to reduce integer GEMMs relative to Ozaki-I; cuBLAS selects between them automatically and tiles residue processing to limit workspace. For complex GEMM, the 2M method reduces the work from four real GEMMs to two. ADP chooses precision at runtime; if its required mantissa width exceeds the default or user maximum, cuBLAS falls back to native FP64 instructions. Reported results include up to 5.5x DGEMM speedup on VR NVL72 and 3.9x on GB200, plus up to 5x ZGEMM speedup on GB200. Application studies report CCSD and BerkeleyGW gains, with results depending on GPU, workload, and precision mode.

### Source excerpt

Many scientific simulations, from molecular chemistry to materials science, spend the majority of their execution time computing high-precision dense general...

## Run GPU-Powered Black Hole Interferometry with NVIDIA cuPhoton

DevFeed: [Run GPU-Powered Black Hole Interferometry with NVIDIA cuPhoton](<https://devfeed.tech/articles/run-gpu-powered-black-hole-interferometry-with-nvidia-cuphoton-133566.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/run-gpu-powered-black-hole-interferometry-with-nvidia-cuphoton/>)

Author: Akhilesh Mishra

Published: 2026-11-13T21:17:17Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [GPUDirect](<https://devfeed.tech/topics/gpudirect.md>), [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>), [Image processing](<https://devfeed.tech/topics/image-processing.md>), [Image](<https://devfeed.tech/topics/image.md>), [Local AI](<https://devfeed.tech/topics/local-ai.md>)

Tags: [black-hole](<https://devfeed.tech/tags/black-hole.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cuda-x](<https://devfeed.tech/tags/cuda-x.md>), [cuphoton](<https://devfeed.tech/tags/cuphoton.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [interferometry](<https://devfeed.tech/tags/interferometry.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [supercomputing](<https://devfeed.tech/tags/supercomputing.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>)

### AI overview

NVIDIA cuPhoton.xBeam correlates radio recordings from telescope pairs into complex visibilities, which feed later calibration and image reconstruction. Its workflow indexes VDIF frames with reusable `.vdix` sidecars, applies job-specified delay and fringe corrections, channelizes voltages with FFTs, cross-multiplies and accumulates station pairs, then writes SWIN or `xbeam-v1` output. GPU processing uses the CuPy backend; data can be read through POSIX and pinned host memory or cuFile/GPUDirect Storage when supported by runtime conditions. xBeam can split scans across GPUs on one node or across nodes, then merge shards after checking job identity, time coverage, and headers. On a Vera Rubin NVL72 system, a 10 TB dataset was processed in 70 seconds on 64 GPUs, about 460 times faster than the stated x86 CPU baseline; this benchmark covers ingestion, preparation, and correlation. xBeam uses delays supplied in the job and does not calculate them from station positions or model black-hole light paths. Missing samples are not recovered; reader policy affects timing, visibilities, and reported weights. Calibration and imaging are outside the tutorial's scope.

### Source excerpt

Imaging black holes is challenging because they are distant and appear tiny in the sky--for example, M87*'s observed ring spans just 42 microarcseconds. The...

## Run Native DLA Inference in Python on NVIDIA Jetson AGX Orin Using cuDLA

DevFeed: [Run Native DLA Inference in Python on NVIDIA Jetson AGX Orin Using cuDLA](<https://devfeed.tech/articles/run-native-dla-inference-in-python-on-nvidia-jetson-agx-orin-using-cudla-133567.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/run-native-dla-inference-in-python-on-nvidia-jetson-agx-orin-using-cudla/>)

Author: Nikshay Shrivastava

Published: 2026-11-13T18:57:10Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Jetson Orin](<https://devfeed.tech/topics/jetson-orin.md>), [Jetson](<https://devfeed.tech/topics/jetson.md>), [Deep learning](<https://devfeed.tech/topics/deep-learning.md>), [On-device AI](<https://devfeed.tech/topics/on-device-ai.md>), [TensorRT](<https://devfeed.tech/topics/tensorrt.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-applications](<https://devfeed.tech/tags/ai-applications.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [applications](<https://devfeed.tech/tags/applications.md>), [compute](<https://devfeed.tech/tags/compute.md>), [computer-vision-video-analytics](<https://devfeed.tech/tags/computer-vision-video-analytics.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [edge](<https://devfeed.tech/tags/edge.md>), [inference](<https://devfeed.tech/tags/inference.md>), [jetson](<https://devfeed.tech/tags/jetson.md>), [networks](<https://devfeed.tech/tags/networks.md>), [neural-networks](<https://devfeed.tech/tags/neural-networks.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-jetson](<https://devfeed.tech/tags/nvidia-jetson.md>), [nvidia-jetson-agx-orin](<https://devfeed.tech/tags/nvidia-jetson-agx-orin.md>), [python](<https://devfeed.tech/tags/python.md>), [robotics](<https://devfeed.tech/tags/robotics.md>)

### AI overview

The excerpt describes using `cuda.bindings.cudla` 13.3.0+ to run a TensorRT-compiled DLA loadable from Python on Jetson Orin. JetPack provides `libcudla.so`; inference needs that runtime, while TensorRT is needed only to compile the model. Python 3.10 or later is required. The demonstrated workflow uses hybrid `CUDA_DLA` mode and one CUDA stream to coordinate GPU work with DLA inference: load the model bytes, query tensor descriptors, allocate and register GPU buffers, enqueue the task, synchronize, and copy results back for Python postprocessing. Descriptor fields provide sizes and layouts, but preprocessing and output interpretation remain model-specific. Not every layer is DLA-compatible, so the ONNX graph may need trimming. Standalone mode is unsupported in this release. The excerpt says the cuDLA API is identical on RTX Spark, though its detailed setup is centered on Jetson.

### Source excerpt

AI applications at the edge often need to run multiple neural networks within limited compute and power budgets. NVIDIA Deep Learning Accelerator (DLA)...

## Adapt Human Motion for Robots with NVIDIA SOMA Retargeter

DevFeed: [Adapt Human Motion for Robots with NVIDIA SOMA Retargeter](<https://devfeed.tech/articles/adapt-human-motion-for-robots-with-nvidia-soma-retargeter-132446.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/adapt-human-motion-for-robots-with-nvidia-soma-retargeter/>)

Author: John Malaska

Published: 2026-11-13T17:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Humanoid Robots](<https://devfeed.tech/topics/humanoid-robots.md>), [Isaac](<https://devfeed.tech/topics/isaac.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Isaac Sim](<https://devfeed.tech/topics/isaac-sim.md>), [3D](<https://devfeed.tech/topics/3d.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [actions](<https://devfeed.tech/tags/actions.md>), [actuator](<https://devfeed.tech/tags/actuator.md>), [after](<https://devfeed.tech/tags/after.md>), [agents](<https://devfeed.tech/tags/agents.md>), [agibot](<https://devfeed.tech/tags/agibot.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [great](<https://devfeed.tech/tags/great.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [humanoid](<https://devfeed.tech/tags/humanoid.md>), [humanoid-robots](<https://devfeed.tech/tags/humanoid-robots.md>), [isaac-lab](<https://devfeed.tech/tags/isaac-lab.md>), [motion](<https://devfeed.tech/tags/motion.md>), [newton](<https://devfeed.tech/tags/newton.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-research](<https://devfeed.tech/tags/nvidia-research.md>), [offers](<https://devfeed.tech/tags/offers.md>), [physical-ai](<https://devfeed.tech/tags/physical-ai.md>), [point](<https://devfeed.tech/tags/point.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [robotics-simulation](<https://devfeed.tech/tags/robotics-simulation.md>), [robots](<https://devfeed.tech/tags/robots.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [teaching](<https://devfeed.tech/tags/teaching.md>), [timing](<https://devfeed.tech/tags/timing.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>), [warp](<https://devfeed.tech/tags/warp.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

NVIDIA SOMA Retargeter adapts human motion to a robot's proportions and range of motion, then exports per-frame root poses and joint angles as CSV for downstream training or control. It accepts BVH animation on the SOMA skeleton; motion can come from capture, video reconstruction, or generation, but must be represented compatibly. The viewer supports configuring a robot, retargeting motion through weighted inverse kinematics, and applying post-processing such as foot-plant correction. Sample configurations and reference results cover five humanoid robots. Developers can refine weights on representative motions, then batch-retarget larger collections. For policy training, SONIC includes a SOMA CSV converter for G1, while ProtoMotions provides another physics-based tracking framework; the input representation and policy must match the target robot. The excerpt also describes simulation evaluation and a MicroDuck example, where trained controllers were compared with reference motions.

### Source excerpt

Human motion offers roboticists a great starting point for teaching humanoid robots how to move. A human demonstration captures the coordination and timing...

## When One GPU Isn't Enough: Serving GLM-5.3 Across Two NVIDIA DGX Stations with vLLM

DevFeed: [When One GPU Isn't Enough: Serving GLM-5.3 Across Two NVIDIA DGX Stations with vLLM](<https://devfeed.tech/articles/when-one-gpu-isn-t-enough-serving-glm-5-3-across-two-nvidia-dgx-stations-with-vllm-132447.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/when-one-gpu-isnt-enough-serving-glm-5-3-across-two-nvidia-dgx-stations-with-vllm/>)

Author: Fatima Fall

Published: 2026-11-13T17:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [vllm](<https://devfeed.tech/topics/vllm.md>), [DGX Station](<https://devfeed.tech/topics/dgx-station.md>), [gpudirect rdma](<https://devfeed.tech/topics/gpudirect-rdma.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [api](<https://devfeed.tech/tags/api.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [dgx](<https://devfeed.tech/tags/dgx.md>), [dgx-station](<https://devfeed.tech/tags/dgx-station.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [glm-5-3](<https://devfeed.tech/tags/glm-5-3.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-memory](<https://devfeed.tech/tags/gpu-memory.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [llm-benchmarking](<https://devfeed.tech/tags/llm-benchmarking.md>), [llms](<https://devfeed.tech/tags/llms.md>), [local-ai](<https://devfeed.tech/tags/local-ai.md>), [networking-communications](<https://devfeed.tech/tags/networking-communications.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [serving](<https://devfeed.tech/tags/serving.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

The tutorial runs the 753-billion-parameter GLM-5.3 NVFP4 model across two GB300 DGX Stations because its roughly 464 GB checkpoint exceeds one GPU's 252 GB of memory. vLLM tensor parallelism splits weights and computation across both GPUs; ConnectX-8 RDMA carries rank-to-rank traffic, and Station A exposes a single OpenAI-compatible API. The workflow covers validating the link, downloading and syncing identical checkpoint copies, launching one vLLM rank per station, checking RDMA and API health, and measuring load with AIPerf on 80 SPEED-Bench coding conversations. Prerequisites include substantial disk space on each station, SSH access, Hugging Face access to the gated dataset, and acceptance of the model and dataset terms. Reported throughput peaks at 607.8 tokens/s at concurrency 16, then drops to 385.0 tokens/s at concurrency 32, where mean latency is 453.5 seconds; mean per-user throughput declines as concurrency rises. The excerpt notes that longer prompts or more concurrent users need more KV cache, and suggests reducing context length or request concurrency if memory runs out.

### Source excerpt

Running a frontier-scale model locally means keeping all its weights in GPU memory; the largest models no longer fit on one machine. Two NVIDIA DGX Stations...

## Validating GPU Platforms with Runtime AI Inventory via the NVIDIA DSX AI Factory

DevFeed: [Validating GPU Platforms with Runtime AI Inventory via the NVIDIA DSX AI Factory](<https://devfeed.tech/articles/validating-gpu-platforms-with-runtime-ai-inventory-via-the-nvidia-dsx-ai-factory-129632.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/validating-gpu-platforms-with-runtime-ai-inventory-via-the-nvidia-dsx-ai-factory/>)

Author: Mark Chmarny

Published: 2026-11-11T17:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [NVIDIA DSX](<https://devfeed.tech/topics/nvidia-dsx.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [NVIDIA NIM](<https://devfeed.tech/topics/nvidia-nim.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-inventory](<https://devfeed.tech/tags/ai-inventory.md>), [ai-workloads](<https://devfeed.tech/tags/ai-workloads.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dsx](<https://devfeed.tech/tags/dsx.md>), [dsx-ai-factory-platform](<https://devfeed.tech/tags/dsx-ai-factory-platform.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [factory](<https://devfeed.tech/tags/factory.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inventory](<https://devfeed.tech/tags/inventory.md>), [kubeflow](<https://devfeed.tech/tags/kubeflow.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dsx](<https://devfeed.tech/tags/nvidia-dsx.md>), [nvidia-dynamo](<https://devfeed.tech/tags/nvidia-dynamo.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [platform](<https://devfeed.tech/tags/platform.md>), [requires](<https://devfeed.tech/tags/requires.md>), [runtime](<https://devfeed.tech/tags/runtime.md>), [scale](<https://devfeed.tech/tags/scale.md>), [slurm](<https://devfeed.tech/tags/slurm.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

AICR creates reproducible, version-locked GPU platform recipes and validates them against a cluster; k8s-aibom adds runtime inventory of recognized AI workloads. On supported GKE recipes, k8s-aibom is selected in the recipe, then deployed and checked through an AICR bundle. Namespace labels enable AIBOM reporting, while the controller still reads workload and pod specs cluster-wide; no sink or secret access is configured by default. AIBOMs can identify models, runtimes, and related dependencies and include confidence tiers with evidence locators. Coverage is limited to supported workload kinds with recognized AI signals. Records can exist before pods run, so readiness does not establish successful scheduling or execution. The integration does not yet correlate AICR deployment intent with observed workloads, and runtime observations are unsigned by default. Reported controller overhead was measured on CPU-only nodes with workload pods pending, so it describes inventory overhead rather than GPU workload performance.

### Source excerpt

As teams deploy and scale AI workloads using NVIDIA Dynamo, Kubeflow, or Slurm, tracking what actually runs requires visibility beyond the platform...

## Running AV Reasoning Models Within Onboard Compute and Latency Limits

DevFeed: [Running AV Reasoning Models Within Onboard Compute and Latency Limits](<https://devfeed.tech/articles/running-av-reasoning-models-within-onboard-compute-and-latency-limits-127099.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/running-av-reasoning-models-within-onboard-compute-and-latency-limits/>)

Author: Marco Pavone

Published: 2026-11-10T16:00:00Z

Content type: release

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [NVIDIA DRIVE](<https://devfeed.tech/topics/nvidia-drive.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [performance-engineering](<https://devfeed.tech/topics/performance-engineering.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>)

Tags: [autonomous-vehicles](<https://devfeed.tech/tags/autonomous-vehicles.md>), [av](<https://devfeed.tech/tags/av.md>), [compute](<https://devfeed.tech/tags/compute.md>), [cosmos](<https://devfeed.tech/tags/cosmos.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [drive-agx](<https://devfeed.tech/tags/drive-agx.md>), [latency](<https://devfeed.tech/tags/latency.md>), [models](<https://devfeed.tech/tags/models.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [reasoning-models](<https://devfeed.tech/tags/reasoning-models.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [thor](<https://devfeed.tech/tags/thor.md>)

### AI overview

Alpamayo 2 Edge combines a 2B Nemotron-based reasoning backbone with a diffusion action expert to produce causal reasoning traces and driving trajectories from surround-camera, temporal, and navigation inputs. It generates reasoning adaptively, and closed-loop reinforcement learning in AlpaGym improved closed-loop driving performance by 48.9% over the best checkpoint without that training. Deployment on DRIVE AGX Thor requires an optimization workflow including FP8 calibration, ONNX export, and TensorRT engine builds; the stated pixel-to-trajectory latency is 160-190 ms depending on reasoning. AlpaJudge-RB scores candidate reasoning against a reference, while AlpaJudge-RF needs synchronized visual evidence and meta-action context but no reference rationale. The text recommends reviewing low scores because they may mark failures or difficult cases, and reporting reasoning scores alongside separate trajectory and safety measures. These results and workflows are presented as development guidance, not a guarantee of vehicle performance.

### Source excerpt

Autonomous vehicle (AV) developers need reasoning models that can operate within the compute and latency constraints of an onboard system. Larger models provide...

## Manage Kubernetes Clusters for GPU Infrastructure with NVIDIA Kubernetes Engine

DevFeed: [Manage Kubernetes Clusters for GPU Infrastructure with NVIDIA Kubernetes Engine](<https://devfeed.tech/articles/manage-kubernetes-clusters-for-gpu-infrastructure-with-nvidia-kubernetes-engine-127098.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/manage-kubernetes-clusters-for-gpu-infrastructure-with-nvidia-kubernetes-engine/>)

Author: Nathan Taber

Published: 2026-11-10T15:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [NVIDIA DSX](<https://devfeed.tech/topics/nvidia-dsx.md>), [Ubuntu](<https://devfeed.tech/topics/ubuntu.md>)

Tags: [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [building](<https://devfeed.tech/tags/building.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dsx-ai-factory-platform](<https://devfeed.tech/tags/dsx-ai-factory-platform.md>), [engine](<https://devfeed.tech/tags/engine.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-infrastructure](<https://devfeed.tech/tags/gpu-infrastructure.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [kubecon](<https://devfeed.tech/tags/kubecon.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [kubernetes-clusters](<https://devfeed.tech/tags/kubernetes-clusters.md>), [kubernetes-services](<https://devfeed.tech/tags/kubernetes-services.md>), [manage](<https://devfeed.tech/tags/manage.md>), [managed](<https://devfeed.tech/tags/managed.md>), [managed-kubernetes](<https://devfeed.tech/tags/managed-kubernetes.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open](<https://devfeed.tech/tags/open.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-source-projects](<https://devfeed.tech/tags/open-source-projects.md>), [projects](<https://devfeed.tech/tags/projects.md>), [services](<https://devfeed.tech/tags/services.md>), [source](<https://devfeed.tech/tags/source.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

NVKE provides APIs and controllers for provisioning and operating managed Kubernetes clusters on GPU infrastructure; NVKR builds version-pinned node images, binaries, container images, and charts, recording inputs so artifacts can be inspected and rebuilt. They can be used together or independently: NVKE has no runtime dependency on NVKR, and NVKR artifacts can support other management systems. The walkthrough builds a node image, uses `nvkectl` and a temporary kind cluster to bootstrap an NVKE management cluster, then provisions a customer cluster through the NVKE API. Provisioning requires CPU servers for management and control planes, GPU worker capacity, NICo, a Linux bootstrap and build host, artifact hosting and registry, and internet access. NVKE is conformance tested on Kubernetes 1.36. Both projects are public preview; APIs, configuration, and behavior may change, and they are not recommended for production workloads.

### Source excerpt

NVIDIA is announcing two open source projects for building and operating managed Kubernetes services on GPU infrastructure--NVIDIA Kubernetes Engine (NVKE) and...

## Start and Restore GPU Workloads in Seconds with NVIDIA Snapshot

DevFeed: [Start and Restore GPU Workloads in Seconds with NVIDIA Snapshot](<https://devfeed.tech/articles/start-and-restore-gpu-workloads-in-seconds-with-nvidia-snapshot-127100.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/start-and-restore-gpu-workloads-in-seconds-with-nvidia-snapshot/>)

Author: Ron Kahn

Published: 2026-11-10T15:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [TensorRT-LLM](<https://devfeed.tech/topics/tensorrt-llm.md>), [TensorRT](<https://devfeed.tech/topics/tensorrt.md>), [NVIDIA DSX](<https://devfeed.tech/topics/nvidia-dsx.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-platforms-deployment](<https://devfeed.tech/tags/ai-platforms-deployment.md>), [checkpoint](<https://devfeed.tech/tags/checkpoint.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [component](<https://devfeed.tech/tags/component.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [dsx](<https://devfeed.tech/tags/dsx.md>), [dsx-ai-factory-platform](<https://devfeed.tech/tags/dsx-ai-factory-platform.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kubecon](<https://devfeed.tech/tags/kubecon.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [platform](<https://devfeed.tech/tags/platform.md>), [restore](<https://devfeed.tech/tags/restore.md>), [snapshot](<https://devfeed.tech/tags/snapshot.md>)

### AI overview

NVIDIA Snapshot checkpoints an initialized GPU workload's CPU and GPU memory, then restores it as a Kubernetes Pod on a node with the same GPU model and driver. This skips weight loading, compilation, and graph capture; infrastructure provisioning and container image loading remain outside the reported restore time. Across the tested vLLM, SGLang, and TensorRT LLM configurations on B200 GPUs, restores took 3.6-42.7 seconds, 8-36 times faster than cold starts. Checkpoint creation took 15 seconds to 5.5 minutes, but checkpoint plus restore was faster than one cold start in every tested configuration. Large eight-GPU MoE restores took under 43 seconds, with GPU state transfer the largest restore stage. Workloads need to meet Snapshot's compatibility requirements and provide a small pause/resume handshake. Excerpts identify ready-made examples and multi-GPU support but do not give the full requirements.

### Source excerpt

NVIDIA Snapshot, a new open-source component of the NVIDIA DSX AI Factory Platform, makes initialized GPU workloads reusable across inference...

## Agent Substrate: Advancing Kubernetes for Agents at Scale

DevFeed: [Agent Substrate: Advancing Kubernetes for Agents at Scale](<https://devfeed.tech/articles/agent-substrate-advancing-kubernetes-for-agents-at-scale-127097.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/agent-substrate-advancing-kubernetes-for-agents-at-scale/>)

Author: Ekin Karabulut

Published: 2026-11-10T15:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Agent Harness](<https://devfeed.tech/topics/agent-harness.md>), [rlvr](<https://devfeed.tech/topics/rlvr.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [human in the loop agent](<https://devfeed.tech/topics/human-in-the-loop-agent.md>)

Tags: [actor](<https://devfeed.tech/tags/actor.md>), [agent-substrate](<https://devfeed.tech/tags/agent-substrate.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agentic-infrastructure](<https://devfeed.tech/tags/agentic-infrastructure.md>), [agentic-workloads](<https://devfeed.tech/tags/agentic-workloads.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [api-server](<https://devfeed.tech/tags/api-server.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [bash](<https://devfeed.tech/tags/bash.md>), [batch](<https://devfeed.tech/tags/batch.md>), [builds](<https://devfeed.tech/tags/builds.md>), [bypass](<https://devfeed.tech/tags/bypass.md>), [cache](<https://devfeed.tech/tags/cache.md>), [checkpoint](<https://devfeed.tech/tags/checkpoint.md>), [cloud-networking](<https://devfeed.tech/tags/cloud-networking.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dsx](<https://devfeed.tech/tags/dsx.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [kubecon](<https://devfeed.tech/tags/kubecon.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [scale](<https://devfeed.tech/tags/scale.md>), [software-defined-data-center](<https://devfeed.tech/tags/software-defined-data-center.md>), [time](<https://devfeed.tech/tags/time.md>), [tool](<https://devfeed.tech/tags/tool.md>)

### AI overview

Agent Substrate addresses agent workloads that alternate brief bursts of work with long waits: it multiplexes stateful agent sessions across a smaller pool of warm Kubernetes worker Pods, checkpointing idle sessions' memory and filesystems and restoring them onto available workers without creating a new Pod for each turn. The source identifies coding assistants, bursty reinforcement learning environments, and short-lived GPU research sandboxes as target workloads. Described work includes bounded request parking when workers are busy, per-container CPU and memory limits for microVM sandboxes, and GPU device support built on Kubernetes DRA. GPU checkpoint restoration may require a matching GPU model and driver; if none is available, the proposed design falls back to a cold start. Integration with NVIDIA Dynamo is intended to use inference queue, cache, and progress signals to coordinate sandbox lifecycle with model serving; KAI Scheduler places the ordinary worker Pods. The project is evolving: APIs are changing, GPU support is being rebuilt on DRA, and parts of the Dynamo integration are experimental.

### Source excerpt

AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn't built for that. Running one Pod per...

## Make a Robot Arm Feel Weightless with NVIDIA Holoscan 5

DevFeed: [Make a Robot Arm Feel Weightless with NVIDIA Holoscan 5](<https://devfeed.tech/articles/make-a-robot-arm-feel-weightless-with-nvidia-holoscan-5-123907.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/make-a-robot-arm-feel-weightless-with-nvidia-holoscan-5/>)

Author: Elizabeth Goodman

Published: 2026-11-09T19:09:32Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Holoscan](<https://devfeed.tech/topics/holoscan.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [robot sense of touch](<https://devfeed.tech/topics/robot-sense-of-touch.md>), [Isaac](<https://devfeed.tech/topics/isaac.md>)

Tags: [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [clara](<https://devfeed.tech/tags/clara.md>), [control](<https://devfeed.tech/tags/control.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [healthcare-life-sciences](<https://devfeed.tech/tags/healthcare-life-sciences.md>), [holoscan](<https://devfeed.tech/tags/holoscan.md>), [medical-devices](<https://devfeed.tech/tags/medical-devices.md>), [monai](<https://devfeed.tech/tags/monai.md>), [nvidia-holoscan](<https://devfeed.tech/tags/nvidia-holoscan.md>), [robot](<https://devfeed.tech/tags/robot.md>), [robot-arm](<https://devfeed.tech/tags/robot-arm.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [video-analytics](<https://devfeed.tech/tags/video-analytics.md>)

### AI overview

The tutorial builds a hand-guidable gravity-compensation loop for the Seeed reBot Arm B601-DM using three Holoscan operators: clock-triggered motor-state reads, Pinocchio inverse dynamics, and motor commands. A single-thread partition and depth-one drop-oldest queues limit handoffs and stale samples; graph compilation checks the execution plan before motor startup, while watchdog and shutdown callbacks disable the motors. Nsight Systems annotations expose timing without custom instrumentation. In profiled runs, pinning and CPU isolation reduced observed p99.99 latency roughly 5x for C++ and 9.6x for Python. Python adds interpreter, allocation, and GIL costs relevant to microsecond-budget CPU control; the article notes C++ offers more critical-path control, though its example is not zero-allocation or zero-syscall. The walkthrough was tested on Jetson Orin Nano, Jetson Thor, and x86 Ubuntu 24.04; it also points to a C++ implementation and a Python example extending the loop with kinematics and impedance control.

### Source excerpt

Picture guiding a robot arm by hand while its motors supply just enough torque to support its weight and keep the robot upright. This simple interaction, a...

## Speed Up Image Generation with FLUX 3 Image Klein on NVIDIA Blackwell GPUs

DevFeed: [Speed Up Image Generation with FLUX 3 Image Klein on NVIDIA Blackwell GPUs](<https://devfeed.tech/articles/speed-up-image-generation-with-flux-3-image-klein-on-nvidia-blackwell-gpus-121823.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/speed-up-image-generation-with-flux-3-image-klein-on-nvidia-blackwell-gpus/>)

Author: Olivia Stoner

Published: 2026-11-06T22:20:20Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [flux](<https://devfeed.tech/topics/flux.md>), [TensorRT-LLM](<https://devfeed.tech/topics/tensorrt-llm.md>), [NVIDIA Blackwell](<https://devfeed.tech/topics/nvidia-blackwell.md>), [ai-image-generator](<https://devfeed.tech/topics/ai-image-generator.md>), [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [RTX PRO](<https://devfeed.tech/topics/rtx-pro.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [content-creation-rendering](<https://devfeed.tech/tags/content-creation-rendering.md>), [cuda-graphs](<https://devfeed.tech/tags/cuda-graphs.md>), [diffusion-models](<https://devfeed.tech/tags/diffusion-models.md>), [flux-3-image](<https://devfeed.tech/tags/flux-3-image.md>), [image](<https://devfeed.tech/tags/image.md>), [image-generation](<https://devfeed.tech/tags/image-generation.md>), [latency](<https://devfeed.tech/tags/latency.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [nvidia-blackwell](<https://devfeed.tech/tags/nvidia-blackwell.md>)

### AI overview

TensorRT LLM VisualGen combines compilation, NVFP4, fused GEMM kernels, attention optimizations, and caching to accelerate FLUX 3 Image Klein on NVIDIA Blackwell GPUs. In 2048x2048 tests on one B200, the combined setup reduced Base latency from 22.36 to 6.46 seconds for text-to-image and from 54.64 to 12.28 seconds for image-to-image, up to 3.46x and 4.45x faster than uncompiled BF16. NVFP4 alone was up to 1.62x faster for text-to-image and 1.58x for image-to-image. Further options trade output similarity against speed: VC-Attention FP8 improved generation speed by 1.16-1.18x with reported LPIPS differences, while Sol-Attention and Cache-DiT reduced denoising work or reused intermediate outputs. Cache-DiT nearly halved Base text-to-image latency at tested resolutions, with smaller gains for the 16-step distilled model. Eight-GPU execution and CUDA Graphs provide additional gains, though non-denoising work limits some end-to-end scaling. The tutorial supplies YAML settings and commands for offline generation and serving; reported results focus on B200 and RTX PRO 6000 Blackwell GPUs.

### Source excerpt

When deploying diffusion models in design tools, image editors, and visual production workflows, developers must account for inference latency. Generating an...

## Accelerating Reinforcement Learning Weight Refit with the Reshard Collective

DevFeed: [Accelerating Reinforcement Learning Weight Refit with the Reshard Collective](<https://devfeed.tech/articles/accelerating-reinforcement-learning-weight-refit-with-the-reshard-collective-121550.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/accelerating-reinforcement-learning-weight-refit-with-the-reshard-collective/>)

Author: Tanya Lenz

Published: 2026-11-06T18:03:26Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [distributed-training](<https://devfeed.tech/topics/distributed-training.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [post-training](<https://devfeed.tech/topics/post-training.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [abstraction](<https://devfeed.tech/tags/abstraction.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [collective](<https://devfeed.tech/tags/collective.md>), [communication](<https://devfeed.tech/tags/communication.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [inference](<https://devfeed.tech/tags/inference.md>), [low-latency-inference](<https://devfeed.tech/tags/low-latency-inference.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [networking-communications](<https://devfeed.tech/tags/networking-communications.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [training](<https://devfeed.tech/tags/training.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>)

### AI overview

Reshard refit moves model weights directly between training and inference GPU layouts, avoiding the gather-and-broadcast method's redundant transfers. NCCL M2N Reshard derives the intersections between source and destination shards, sends each contribution once across the network, and uses NVLink exchanges among replicas to assemble destination shards; network transfers and local exchanges are pipelined. In NeMo RL, the reference implementation applies resharding to feed-forward projection weights, which account for around 95% of model parameters, while other weights retain gather-and-broadcast for broader functional coverage. Benchmarks report 2.7x-5.7x speedups, and a Qwen3.8 2.4T BF16 refit took 4.3 seconds in a refit-only microbenchmark. Enable the path with `refit_transport: nccl_reshard` and `colocated.enabled: false`. The post points readers to separate guidance for supported backends, layouts, and precision modes.

### Source excerpt

During reinforcement learning (RL) post-training, training trajectories are generated on the fly by running inference with the current policy model. For...

## Configure, Certify, and Operate Kubernetes GPU Clusters with NVIDIA DSX OS

DevFeed: [Configure, Certify, and Operate Kubernetes GPU Clusters with NVIDIA DSX OS](<https://devfeed.tech/articles/configure-certify-and-operate-kubernetes-gpu-clusters-with-nvidia-dsx-os-119476.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/configure-certify-and-operate-kubernetes-gpu-clusters-with-nvidia-dsx-os/>)

Author: Sowmyan Soman

Published: 2026-11-05T17:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [gpu monitoring](<https://devfeed.tech/topics/gpu-monitoring.md>), [NVIDIA DSX](<https://devfeed.tech/topics/nvidia-dsx.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [basic](<https://devfeed.tech/tags/basic.md>), [can](<https://devfeed.tech/tags/can.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [configure](<https://devfeed.tech/tags/configure.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [dsx](<https://devfeed.tech/tags/dsx.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-clusters](<https://devfeed.tech/tags/gpu-clusters.md>), [health](<https://devfeed.tech/tags/health.md>), [health-checks](<https://devfeed.tech/tags/health-checks.md>), [job](<https://devfeed.tech/tags/job.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [leaving](<https://devfeed.tech/tags/leaving.md>), [node](<https://devfeed.tech/tags/node.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dsx](<https://devfeed.tech/tags/nvidia-dsx.md>), [one](<https://devfeed.tech/tags/one.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [os](<https://devfeed.tech/tags/os.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

NVIDIA DSX OS combines three open source tools to keep Kubernetes GPU clusters configured, workload-certified, and healthy through changes and repairs. AICR builds version-locked configuration recipes, renders them for existing deployers, and can detect drift; it generates artifacts but does not apply them. NVCRE runs GPU, network, storage, and AI workload tests, reports measurements and suspected faulty nodes, and applies performance thresholds only when configured. NVSentinel continuously monitors existing health signals without using GPU time. It starts in reporting-only mode; when configured, it can quarantine or drain unhealthy nodes and coordinate NVCRE revalidation before they return to service. The tools divide responsibility: NVCRE records failures and attribution, while NVSentinel handles quarantine and repair. Lifecycle automation can validate new and remediated nodes, but driver, operator, or fabric changes need a separate pipeline-triggered validation process. The excerpt assumes the tools, cluster dependencies, and NVCRE test provider are installed and configured.

### Source excerpt

One underperforming GPU can slow an entire distributed training job. The node may pass basic health checks and show normal utilization, leaving operators to...

## Five Ways NVIDIA Co-Design Maximizes the Value of Every Byte in the AI Factory

DevFeed: [Five Ways NVIDIA Co-Design Maximizes the Value of Every Byte in the AI Factory](<https://devfeed.tech/articles/five-ways-nvidia-co-design-maximizes-the-value-of-every-byte-in-the-ai-factory-119477.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/five-ways-nvidia-co-design-maximizes-the-value-of-every-byte-in-the-ai-factory/>)

Author: Shara Tibken

Published: 2026-11-05T16:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI Factory](<https://devfeed.tech/topics/ai-factory.md>), [AI Architecture](<https://devfeed.tech/topics/ai-architecture.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>), [vllm](<https://devfeed.tech/topics/vllm.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agentic-workloads](<https://devfeed.tech/tags/agentic-workloads.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [arithmetic](<https://devfeed.tech/tags/arithmetic.md>), [attention](<https://devfeed.tech/tags/attention.md>), [batch](<https://devfeed.tech/tags/batch.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [better](<https://devfeed.tech/tags/better.md>), [bits](<https://devfeed.tech/tags/bits.md>), [block](<https://devfeed.tech/tags/block.md>), [bluefield-dpu](<https://devfeed.tech/tags/bluefield-dpu.md>), [cache](<https://devfeed.tech/tags/cache.md>), [cached-context](<https://devfeed.tech/tags/cached-context.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [co-design](<https://devfeed.tech/tags/co-design.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [doca](<https://devfeed.tech/tags/doca.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [ethernet](<https://devfeed.tech/tags/ethernet.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gb300](<https://devfeed.tech/tags/gb300.md>), [gb300-nvl72](<https://devfeed.tech/tags/gb300-nvl72.md>), [gpudirect](<https://devfeed.tech/tags/gpudirect.md>), [h100](<https://devfeed.tech/tags/h100.md>), [hbm](<https://devfeed.tech/tags/hbm.md>), [high-bandwidth-memory](<https://devfeed.tech/tags/high-bandwidth-memory.md>), [memory](<https://devfeed.tech/tags/memory.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [rubin-gpu](<https://devfeed.tech/tags/rubin-gpu.md>), [spectrum-x](<https://devfeed.tech/tags/spectrum-x.md>), [tensorrt-llm](<https://devfeed.tech/tags/tensorrt-llm.md>), [vera-cpu](<https://devfeed.tech/tags/vera-cpu.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>), [vera-rubin-nvl72](<https://devfeed.tech/tags/vera-rubin-nvl72.md>)

### AI overview

The excerpt describes five ways NVIDIA's AI factory design aims to increase useful work per memory byte: NVFP4 shrinks model weights and KV cache; TensorRT-LLM Wide-EP spreads MoE experts across GPUs to free per-GPU memory and improve weight reuse; Dynamo routes requests to cached prefixes and manages KV cache across GPU, CPU, and storage; Vera CPU memory provides a place to stage context during tool-call gaps; and CMX offers pod-level shared flash for context reuse across nodes. The article reports benchmark-specific gains, including up to 4x throughput over an FP8 baseline for NVFP4 and up to 30x throughput per megawatt for Vera Rubin NVL72 versus GB300 NVL72 at the same 288 GB per GPU. It also notes that KV offloading helps when retrieval is faster than recomputation; storage performance examples are vendor validation tests.

### Source excerpt

In an AI factory, high bandwidth memory (HBM)is the fastest, most expensive, and most contested memory tier. Every byte spent on a redundant weight copy, an...

## How NVIDIA Uses AI Agents to Streamline AI Factory Operations

DevFeed: [How NVIDIA Uses AI Agents to Streamline AI Factory Operations](<https://devfeed.tech/articles/how-nvidia-uses-ai-agents-to-streamline-ai-factory-operations-117988.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-nvidia-uses-ai-agents-to-streamline-ai-factory-operations/>)

Author: Shara Tibken

Published: 2026-11-04T22:00:17Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI in IT operations](<https://devfeed.tech/topics/ai-in-it-operations.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [OpenShell](<https://devfeed.tech/topics/openshell.md>), [AIOps for Kubernetes](<https://devfeed.tech/topics/aiops-for-kubernetes.md>), [control-plane](<https://devfeed.tech/topics/control-plane.md>), [NemoClaw](<https://devfeed.tech/topics/nemoclaw.md>), [Production Engineering](<https://devfeed.tech/topics/production-engineering.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Grafana](<https://devfeed.tech/topics/grafana.md>), [digital sovereignty](<https://devfeed.tech/topics/digital-sovereignty.md>), [DGX Spark](<https://devfeed.tech/topics/dgx-spark.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [build-ai-agents](<https://devfeed.tech/tags/build-ai-agents.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [compute](<https://devfeed.tech/tags/compute.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [dgx](<https://devfeed.tech/tags/dgx.md>), [engineers](<https://devfeed.tech/tags/engineers.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gb300](<https://devfeed.tech/tags/gb300.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-clusters](<https://devfeed.tech/tags/gpu-clusters.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [hgx](<https://devfeed.tech/tags/hgx.md>), [hpc-scientific-computing](<https://devfeed.tech/tags/hpc-scientific-computing.md>), [machine-learning-artificial-intelligence](<https://devfeed.tech/tags/machine-learning-artificial-intelligence.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [nemoclaw](<https://devfeed.tech/tags/nemoclaw.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [network](<https://devfeed.tech/tags/network.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [openshell](<https://devfeed.tech/tags/openshell.md>), [operations](<https://devfeed.tech/tags/operations.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [scale](<https://devfeed.tech/tags/scale.md>), [scheduling](<https://devfeed.tech/tags/scheduling.md>), [site-reliability](<https://devfeed.tech/tags/site-reliability.md>)

### AI overview

NVIDIA's AI Factory Operations Agent correlates signals across compute, network, hardware, and scheduling so SREs can investigate failures through a chat interface. Specialized agents detect issues, analyze cross-layer causes, and recommend actions; examples include job recovery, hardware triage, observability, documentation search, Kubernetes awareness, and cluster management. The framework uses MCP tools and can connect to existing infrastructure integrations. It runs as a Kubernetes control-plane application, with OpenShell creating per-session sandboxes; Kubernetes inspection uses a separate read-only tool with scoped credentials, and the excerpt's example permissions deny access to secrets and pod creation or updates. NVIDIA emphasizes clear agent boundaries, read-only investigation, precise tools, and visible evidence and tool calls. A dedicated GPU-accelerated control plane can isolate orchestration from production workloads, while tenant-specific permissions and sandboxes limit visibility. The framework is experimental open source software, so APIs and deployment requirements may change.

### Source excerpt

As GPU clusters scale, operations span compute, network, hardware, and scheduling. Site reliability engineers (SREs) often have to examine multiple dashboards...

## NVIDIA CUDA 13.5 Brings NVIDIA Vera Rubin GA Support

DevFeed: [NVIDIA CUDA 13.5 Brings NVIDIA Vera Rubin GA Support](<https://devfeed.tech/articles/nvidia-cuda-13-5-brings-nvidia-vera-rubin-ga-support-117642.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/nvidia-cuda-13-5-brings-nvidia-vera-rubin-ga-support/>)

Author: Shara Tibken

Published: 2026-11-04T18:46:07Z

Content type: release

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [CUDA](<https://devfeed.tech/topics/cuda.md>), [CUDA Tile](<https://devfeed.tech/topics/cuda-tile.md>), [NVIDIA Vera Rubin](<https://devfeed.tech/topics/nvidia-vera-rubin.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [CUDA Graphs](<https://devfeed.tech/topics/cuda-graphs.md>), [Tool](<https://devfeed.tech/topics/tool.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [64-bit](<https://devfeed.tech/tags/64-bit.md>), [accelerated-computing](<https://devfeed.tech/tags/accelerated-computing.md>), [acceleration](<https://devfeed.tech/tags/acceleration.md>), [accounting](<https://devfeed.tech/tags/accounting.md>), [agent-skill](<https://devfeed.tech/tags/agent-skill.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-coding-agents](<https://devfeed.tech/tags/ai-coding-agents.md>), [ai-workloads](<https://devfeed.tech/tags/ai-workloads.md>), [arm](<https://devfeed.tech/tags/arm.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [attention](<https://devfeed.tech/tags/attention.md>), [automatic](<https://devfeed.tech/tags/automatic.md>), [backend](<https://devfeed.tech/tags/backend.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cuda-tile](<https://devfeed.tech/tags/cuda-tile.md>), [cutile](<https://devfeed.tech/tags/cutile.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [featured](<https://devfeed.tech/tags/featured.md>), [machine-learning-artificial-intelligence](<https://devfeed.tech/tags/machine-learning-artificial-intelligence.md>), [nsight-tools-compute](<https://devfeed.tech/tags/nsight-tools-compute.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-vera-rubin](<https://devfeed.tech/tags/nvidia-vera-rubin.md>), [python](<https://devfeed.tech/tags/python.md>), [release](<https://devfeed.tech/tags/release.md>), [rubin](<https://devfeed.tech/tags/rubin.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>)

### AI overview

CUDA Toolkit 13.5 makes NVIDIA Vera Rubin support generally available and adds platform and workload controls across CUDA. CUDA 13.5 can partition all SMs across locality domains, with discovery mode reporting potentially unequal partition sizes. MPS v3 adds weighted timeslicing, borrowable SM capacity, cgroup routing, namespace assignments, and polling as a memory-accounting fallback; polling adds work during eviction decisions. CUDA Graphs can capture batched 1D copies, and CUDA Tile adds multi-GPU communication plus preview support for calling selected SIMT library functions; custom device-function calls remain planned. CUDA Python and CCCL add batch copies, graph updates, public CUB tuning, batched Top-K, reproducible scans, and reductions that can consume GPU-resident counts. The release also updates profiling and debugging tools, math libraries, compiler controls, PTX, and binary inspection. On Rubin, WDDM and MCDM are supported; TCC is not. The excerpt describes many enhancements but directs readers to release notes for full compatibility details.

### Source excerpt

As artificial intelligence and accelerated computing continue to push the boundaries of what's possible, the latest NVIDIA CUDA release arrives to unlock...

[Next page](<https://devfeed.tech/sources/nvidia-developer.md?cursor=WyIyMDI2LTExLTA0VDE4OjQ2OjA3KzAwOjAwIiwgImI5MTc1NjM2LTMwNTktNGNkMy1hNmU5LTgxY2I2NzUwMzdlOSJd>)