# NVIDIA Technical Blog

News and tutorials for developers, data scientists, and IT admins

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## How to Use AI Agents to Prepare 3D Scenes for Simulation

DevFeed: [How to Use AI Agents to Prepare 3D Scenes for Simulation](<https://devfeed.tech/articles/how-to-use-ai-agents-to-prepare-3d-scenes-for-simulation-31484.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-to-use-ai-agents-to-prepare-3d-scenes-for-simulation/>)

Author: Tanya Lenz

Published: 2026-09-16T23:20:33Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Simulation](<https://devfeed.tech/topics/simulation.md>), [Physical AI](<https://devfeed.tech/topics/physical-ai.md>), [Simulation and Design](<https://devfeed.tech/topics/simulation-and-design.md>), [blender](<https://devfeed.tech/topics/blender.md>), [Isaac Sim](<https://devfeed.tech/topics/isaac-sim.md>), [Omniverse](<https://devfeed.tech/topics/omniverse.md>), [Robotics Simulation](<https://devfeed.tech/topics/robotics-simulation.md>), [Robotics](<https://devfeed.tech/topics/robotics.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [blender](<https://devfeed.tech/tags/blender.md>), [gpt-6-astra](<https://devfeed.tech/tags/gpt-6-astra.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [isaac-sim](<https://devfeed.tech/tags/isaac-sim.md>), [nemoclaw](<https://devfeed.tech/tags/nemoclaw.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [omniverse](<https://devfeed.tech/tags/omniverse.md>), [openai](<https://devfeed.tech/tags/openai.md>), [openusd](<https://devfeed.tech/tags/openusd.md>), [physical-ai](<https://devfeed.tech/tags/physical-ai.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [robotics-simulation](<https://devfeed.tech/tags/robotics-simulation.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>)

### AI overview

This tutorial describes an agentic workflow for preparing Blender 3D scenes for robotics simulation. It covers scene inspection, OpenUSD metadata, physics properties, rendering preflight views, and validation for simulation-ready handoff to NVIDIA Isaac Sim or Isaac Lab.

### Source excerpt

Agentic AI workflows can be used to prepare and validate digital twins for physical AI systems. Agents can inspect 3D scenes, author simulation-relevant data in...

## TensorRT Edge-LLM Completes the MLPerf Edge Agentic Benchmark 6.4x Faster on Jetson AGX Thor

DevFeed: [TensorRT Edge-LLM Completes the MLPerf Edge Agentic Benchmark 6.4x Faster on Jetson AGX Thor](<https://devfeed.tech/articles/tensorrt-edge-llm-completes-the-mlperf-edge-agentic-benchmark-6-4x-faster-on-jetson-agx-thor-31485.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/tensorrt-edge-llm-completes-the-mlperf-edge-agentic-benchmark-6-4x-faster-on-jetson-agx-thor/>)

Author: Elizabeth Goodman

Published: 2026-09-16T20:37:07Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Jetson AGX Thor Developer Kit](<https://devfeed.tech/topics/jetson-agx-thor-developer-kit.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [TensorRT](<https://devfeed.tech/topics/tensorrt.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [jetson](<https://devfeed.tech/tags/jetson.md>), [jetson-agx-thor-developer-kit](<https://devfeed.tech/tags/jetson-agx-thor-developer-kit.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-benchmarking](<https://devfeed.tech/tags/llm-benchmarking.md>), [mlperf](<https://devfeed.tech/tags/mlperf.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [performance](<https://devfeed.tech/tags/performance.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [tensorrt](<https://devfeed.tech/tags/tensorrt.md>), [tensorrt-llm](<https://devfeed.tech/tags/tensorrt-llm.md>), [thor](<https://devfeed.tech/tags/thor.md>)

### AI overview

This article reports that NVIDIA TensorRT Edge-LLM ran Qwen3.6-27B on a single NVIDIA Jetson AGX Thor Developer Kit for the MLPerf Inference v6.1 Edge Agentic benchmark. Using NVFP4 quantization, tree-based multi-token prediction, and KV cache reuse, it achieved 52.33 tokens per second and completed 1,007 turns in 24 minutes and 36 seconds, 6.4 times faster than the llama.cpp reference submission.

### Source excerpt

AI agents are moving from cloud data centers to vehicles, robots, and other edge devices. Unlike a chatbot that answers a single prompt, an agent works through...

## Translating CUDA Tile Operations from Python to Rust Using Agentic AI

DevFeed: [Translating CUDA Tile Operations from Python to Rust Using Agentic AI](<https://devfeed.tech/articles/translating-cuda-tile-operations-from-python-to-rust-using-agentic-ai-31486.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/translating-cuda-tile-operations-from-python-to-rust-using-agentic-ai/>)

Author: Tanya Lenz

Published: 2026-09-16T16:28:59Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [CUDA Tile](<https://devfeed.tech/topics/cuda-tile.md>), [Rust](<https://devfeed.tech/topics/rust.md>), [Agent Skill](<https://devfeed.tech/topics/agent-skill.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [Compiler](<https://devfeed.tech/topics/compiler.md>)

Tags: [agent-skill](<https://devfeed.tech/tags/agent-skill.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cuda-tile](<https://devfeed.tech/tags/cuda-tile.md>), [cutile](<https://devfeed.tech/tags/cutile.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [python](<https://devfeed.tech/tags/python.md>), [rust](<https://devfeed.tech/tags/rust.md>)

### AI overview

This NVIDIA developer article explains a multi-agent workflow for translating cuTile Python and Triton-TileIR GPU kernels into cuTile Rust. The team ported 24 public TileGym operators, covering about 40 kernels, and achieved 99.5% of cuTile Python performance on average, with correctness and performance checks at each stage.

### Source excerpt

cuTile Rust (cutile-rs) is a tile-based system for safe, idiomatic GPU kernel authoring in the Rust programming language. Extending the Rust ownership model to...

## Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each

DevFeed: [Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each](<https://devfeed.tech/articles/dense-vs-moe-models-active-parameters-throughput-and-when-to-choose-each-26912.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/dense-vs-moe-models-active-parameters-throughput-and-when-to-choose-each/>)

Author: Elizabeth Goodman

Published: 2026-09-15T17:00:11Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [llms](<https://devfeed.tech/tags/llms.md>), [memory](<https://devfeed.tech/tags/memory.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [models](<https://devfeed.tech/tags/models.md>), [moe](<https://devfeed.tech/tags/moe.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [performance](<https://devfeed.tech/tags/performance.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This article explains how dense and Mixture-of-Experts models activate parameters, compares their effects on throughput, memory cost, and serving complexity, and discusses when each architecture fits different deployment constraints. It uses Nemotron 3.5 Lightning as an example of an MoE model.

### Source excerpt

How can a 30B-parameter model activate only 3B parameters per token, and still use the capacity of the larger model? Nemotron 3.5 Lightning illustrates the...

## How NVIDIA Groq 3 LPX Deterministic Execution Drives Power-Efficient High-Interactivity Inference on NVIDIA Vera Rubin

DevFeed: [How NVIDIA Groq 3 LPX Deterministic Execution Drives Power-Efficient High-Interactivity Inference on NVIDIA Vera Rubin](<https://devfeed.tech/articles/how-nvidia-groq-3-lpx-deterministic-execution-drives-power-efficient-high-interactivity-inference-on-nvidia-vera-rubin-26913.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-nvidia-groq-3-lpx-deterministic-execution-drives-power-efficient-high-interactivity-inference-on-nvidia-vera-rubin/>)

Author: Tanya Lenz

Published: 2026-09-15T16:55:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Groq 3 LPX](<https://devfeed.tech/topics/groq-3-lpx.md>), [LPX](<https://devfeed.tech/topics/lpx.md>), [NVIDIA Vera Rubin](<https://devfeed.tech/topics/nvidia-vera-rubin.md>), [Vera Rubin NVL72](<https://devfeed.tech/topics/vera-rubin-nvl72.md>), [groq](<https://devfeed.tech/topics/groq.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Low Latency](<https://devfeed.tech/topics/low-latency.md>), [long-context](<https://devfeed.tech/topics/long-context.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-platform](<https://devfeed.tech/tags/ai-platform.md>), [drive](<https://devfeed.tech/tags/drive.md>), [dsx](<https://devfeed.tech/tags/dsx.md>), [groq](<https://devfeed.tech/tags/groq.md>), [groq-3-lpx](<https://devfeed.tech/tags/groq-3-lpx.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [latency](<https://devfeed.tech/tags/latency.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [lpx](<https://devfeed.tech/tags/lpx.md>), [nvidia-vera-rubin](<https://devfeed.tech/tags/nvidia-vera-rubin.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [performance](<https://devfeed.tech/tags/performance.md>), [power-management](<https://devfeed.tech/tags/power-management.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>), [vera-rubin-nvl72](<https://devfeed.tech/tags/vera-rubin-nvl72.md>)

### AI overview

This NVIDIA developer article explains how Groq 3 LPX uses deterministic execution across 256 LPU chips to support low-latency inference on NVIDIA Vera Rubin. It describes compiler-scheduled execution and power-management techniques including Preemptive Power and Clock Period Synthesis.

### Source excerpt

Power is a defining constraint for AI factories. As AI workloads demand a full compute platform to serve them, each component of that platform must maximize...

## How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories

DevFeed: [How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories](<https://devfeed.tech/articles/how-nvidia-nvlink-6-delivers-multi-layer-resiliency-for-ai-factories-26914.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-nvidia-nvlink-6-delivers-multi-layer-resiliency-for-ai-factories/>)

Author: Elizabeth Goodman

Published: 2026-09-15T16:55:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [NVLink](<https://devfeed.tech/topics/nvlink.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [AI Factory](<https://devfeed.tech/topics/ai-factory.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [industry](<https://devfeed.tech/tags/industry.md>), [networking](<https://devfeed.tech/tags/networking.md>), [networking-communications](<https://devfeed.tech/tags/networking-communications.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [resiliency](<https://devfeed.tech/tags/resiliency.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>)

### AI overview

The article describes how NVIDIA NVLink 6 supports resiliency in large-scale AI factories. It explains that Vera Rubin NVL72 connects 72 Rubin GPUs into a single scale-up domain and outlines a multilayer approach using lossless networking, error correction, retry, flow control, and error containment to support continuous training and inference operations.

### Source excerpt

For operators of large-scale AI factories, maximizing continuous output is essential for productivity. In massive-scale AI training, every GPU in the cluster...

## Scaling Federated Learning Across Docker, Kubernetes, and Slurm with NVIDIA FLARE

DevFeed: [Scaling Federated Learning Across Docker, Kubernetes, and Slurm with NVIDIA FLARE](<https://devfeed.tech/articles/scaling-federated-learning-across-docker-kubernetes-and-slurm-with-nvidia-flare-26915.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/scaling-federated-learning-across-docker-kubernetes-and-slurm-with-nvidia-flare/>)

Author: Elizabeth Goodman

Published: 2026-09-15T15:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Federated Learning](<https://devfeed.tech/topics/federated-learning.md>), [Docker](<https://devfeed.tech/topics/docker.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Server](<https://devfeed.tech/topics/server.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [compute](<https://devfeed.tech/tags/compute.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [container](<https://devfeed.tech/tags/container.md>), [data-analytics-processing](<https://devfeed.tech/tags/data-analytics-processing.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [docker](<https://devfeed.tech/tags/docker.md>), [docker-container](<https://devfeed.tech/tags/docker-container.md>), [federated-learning](<https://devfeed.tech/tags/federated-learning.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [job](<https://devfeed.tech/tags/job.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-flare](<https://devfeed.tech/tags/nvidia-flare.md>), [server](<https://devfeed.tech/tags/server.md>)

### AI overview

This article explains how NVIDIA FLARE scales federated learning across sites with different infrastructure, including Docker, Kubernetes, and Slurm. Its two-layer architecture separates persistent federation services from on-demand job execution, while allowing each site to retain local control over compute, data, secrets, and scheduling.

### Source excerpt

Federated learning (FL) projects often begin with a straightforward setup: one server, a few clients, and one dataset at each site. As those projects grow, the...

## Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine

DevFeed: [Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine](<https://devfeed.tech/articles/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine-21079.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine/>)

Author: Tanya Lenz

Published: 2026-09-14T16:39:15Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [Network](<https://devfeed.tech/topics/network.md>), [Python](<https://devfeed.tech/topics/python.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>), [mixtral](<https://devfeed.tech/topics/mixtral.md>), [qwen](<https://devfeed.tech/topics/qwen.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [communication](<https://devfeed.tech/tags/communication.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [mixtral](<https://devfeed.tech/tags/mixtral.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [moe](<https://devfeed.tech/tags/moe.md>), [networks](<https://devfeed.tech/tags/networks.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [performance](<https://devfeed.tech/tags/performance.md>), [python](<https://devfeed.tech/tags/python.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tensors](<https://devfeed.tech/tags/tensors.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>)

### AI overview

This article explains how NVIDIA Transformer Engine and JAX kernel optimizations accelerate dropless Mixture of Experts (MoE) training. It describes bottlenecks from token routing, expert dispatch and gathering, all-to-all communication, and ragged expert matrix operations. In DeepSeek-V3 training on NVIDIA GB200, the optimized approach increased performance from 103 to 1,068 TFLOPS per GPU, a 10.4x improvement.

### Source excerpt

Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE...

## How Full-Stack NIM Optimizations Deliver 2.5x More Users on Nemotron 3 Ultra

DevFeed: [How Full-Stack NIM Optimizations Deliver 2.5x More Users on Nemotron 3 Ultra](<https://devfeed.tech/articles/how-full-stack-nim-optimizations-deliver-2-5x-more-users-on-nemotron-3-ultra-6840.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-full-stack-nim-optimizations-deliver-2-5x-more-users-on-nemotron-3-ultra/>)

Author: Elizabeth Goodman

Published: 2026-09-10T16:55:32Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Language models](<https://devfeed.tech/topics/language-models.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [build-ai-agents](<https://devfeed.tech/tags/build-ai-agents.md>), [cache](<https://devfeed.tech/tags/cache.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [latency](<https://devfeed.tech/tags/latency.md>), [mamba](<https://devfeed.tech/tags/mamba.md>), [mixture-of-experts](<https://devfeed.tech/tags/mixture-of-experts.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nim](<https://devfeed.tech/tags/nim.md>), [nvidia-blackwell](<https://devfeed.tech/tags/nvidia-blackwell.md>), [optimization](<https://devfeed.tech/tags/optimization.md>)

### AI overview

The article explains how NVIDIA NIM bundles serving optimizations to improve throughput for Nemotron 3 Ultra while meeting latency targets on GPU infrastructure.

### Source excerpt

Deploying a large language model is only the first step toward production-ready serving. Production teams also need to serve as many concurrent users as...

## High-Throughput Structure Prediction with BioNeMo Inference Runtime

DevFeed: [High-Throughput Structure Prediction with BioNeMo Inference Runtime](<https://devfeed.tech/articles/high-throughput-structure-prediction-with-bionemo-inference-runtime-6836.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/high-throughput-structure-prediction-with-bionemo-inference-runtime/>)

Author: Elizabeth Goodman

Published: 2026-09-10T15:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>)

Tags: [bionemo](<https://devfeed.tech/tags/bionemo.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cuda-graphs](<https://devfeed.tech/tags/cuda-graphs.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [drug-discovery](<https://devfeed.tech/tags/drug-discovery.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [healthcare-life-sciences](<https://devfeed.tech/tags/healthcare-life-sciences.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [hpc-scientific-computing](<https://devfeed.tech/tags/hpc-scientific-computing.md>), [inference](<https://devfeed.tech/tags/inference.md>), [integration](<https://devfeed.tech/tags/integration.md>), [kernels](<https://devfeed.tech/tags/kernels.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [node](<https://devfeed.tech/tags/node.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [python](<https://devfeed.tech/tags/python.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [resource](<https://devfeed.tech/tags/resource.md>), [scale](<https://devfeed.tech/tags/scale.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [tokenization](<https://devfeed.tech/tags/tokenization.md>), [torch](<https://devfeed.tech/tags/torch.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

A tutorial on using NVIDIA BioNeMo Inference Runtime to accelerate biomolecular structure-prediction models on GPUs. It covers the end-to-end Boltz2 workflow, PyTorch integration, input requirements, and Ray-based single-node throughput scaling.

### Source excerpt

Biomolecular structure prediction is now often run at proteome scale, where the goal is to move an entire worklist through the pipeline efficiently. NVIDIA...

## From Wafer-Out to First Token: Codifying Supply Chain Expertise with Nemotron and Palantir Foundry

DevFeed: [From Wafer-Out to First Token: Codifying Supply Chain Expertise with Nemotron and Palantir Foundry](<https://devfeed.tech/articles/from-wafer-out-to-first-token-codifying-supply-chain-expertise-with-nemotron-and-palantir-foundry-6824.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/from-wafer-out-to-first-token-codifying-supply-chain-expertise-with-nemotron-and-palantir-foundry/>)

Author: Elizabeth Goodman

Published: 2026-09-10T09:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [datacenter](<https://devfeed.tech/topics/datacenter.md>), [networking](<https://devfeed.tech/topics/networking.md>), [Software](<https://devfeed.tech/topics/software.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [blackwell](<https://devfeed.tech/tags/blackwell.md>), [compute](<https://devfeed.tech/tags/compute.md>), [cuopt](<https://devfeed.tech/tags/cuopt.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [llms](<https://devfeed.tech/tags/llms.md>), [manufacturing](<https://devfeed.tech/tags/manufacturing.md>), [memory](<https://devfeed.tech/tags/memory.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [networking](<https://devfeed.tech/tags/networking.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-blackwell](<https://devfeed.tech/tags/nvidia-blackwell.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [performance](<https://devfeed.tech/tags/performance.md>), [production](<https://devfeed.tech/tags/production.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [software](<https://devfeed.tech/tags/software.md>), [supply-chain](<https://devfeed.tech/tags/supply-chain.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>)

### AI overview

NVIDIA describes how it measures and reduces the time from wafer-out to first token across complex Grace Blackwell and Vera Rubin supply chains. The article focuses on time-to-rack, critical material allocation, real-time visibility, redundancy, reliability, and codifying human expertise.

### Source excerpt

NVIDIA has one of the largest and most complex supply chains in the world, and its performance is measured from wafer-out to first token. The interval is in two...

## When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving

DevFeed: [When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving](<https://devfeed.tech/articles/when-to-use-encode-prefill-decode-disaggregation-to-accelerate-multimodal-model-serving-6945.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/when-to-use-encode-prefill-decode-disaggregation-to-accelerate-multimodal-model-serving/>)

Author: Tanya Lenz

Published: 2026-09-09T20:31:04Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Optimization](<https://devfeed.tech/topics/optimization.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Dynamo](<https://devfeed.tech/topics/dynamo.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [computer-vision-video-analytics](<https://devfeed.tech/tags/computer-vision-video-analytics.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [low-latency-inference](<https://devfeed.tech/tags/low-latency-inference.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [optimization](<https://devfeed.tech/tags/optimization.md>)

### AI overview

This article explains when encode-prefill-decode disaggregation improves multimodal model serving. Using NVIDIA Dynamo, it separates vision encoding from LLM prefill and decode so the stages can batch, schedule, and scale independently. The approach is most effective for image-heavy prompts, short-to-medium outputs, and quantized mixture-of-experts models, with reported gains of up to 5x in time to first token and 7x in end-to-end response time.

### Source excerpt

Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the prefill...

## CUDA Toolkit 13.4 Adds Windows on Arm Support and Greater Control over Shared GPUs

DevFeed: [CUDA Toolkit 13.4 Adds Windows on Arm Support and Greater Control over Shared GPUs](<https://devfeed.tech/articles/cuda-toolkit-13-4-adds-windows-on-arm-support-and-greater-control-over-shared-gpus-6789.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/cuda-toolkit-13-4-adds-windows-on-arm-support-and-greater-control-over-shared-gpus/>)

Author: Jonathan Bentz

Published: 2026-09-09T20:24:12Z

Content type: release

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [CUDA](<https://devfeed.tech/topics/cuda.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>)

Tags: [cli](<https://devfeed.tech/tags/cli.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cuda-tile](<https://devfeed.tech/tags/cuda-tile.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [nsight-tools-compute](<https://devfeed.tech/tags/nsight-tools-compute.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [release](<https://devfeed.tech/tags/release.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [top-stories](<https://devfeed.tech/tags/top-stories.md>), [windows](<https://devfeed.tech/tags/windows.md>)

### AI overview

CUDA Toolkit 13.4 adds Windows on Arm support, preview support for the NVIDIA Rubin GPU architecture, and new GPU-sharing controls through MPS V3. It also introduces CUDA Compute Fabric Transport for data movement across NVIDIA NVLink fabric.

### Source excerpt

Every NVIDIA CUDA Toolkit release adds functionality and performance improvements that help developers get more from NVIDIA GPUs and the broader NVIDIA software...

## Introducing CUDA Rust: Two Tracks for Writing GPU Kernels

DevFeed: [Introducing CUDA Rust: Two Tracks for Writing GPU Kernels](<https://devfeed.tech/articles/introducing-cuda-rust-two-tracks-for-writing-gpu-kernels-6871.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/introducing-cuda-rust-two-tracks-for-writing-gpu-kernels/>)

Author: Elizabeth Goodman

Published: 2026-09-08T12:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [GPU](<https://devfeed.tech/topics/gpu.md>), [Code generation](<https://devfeed.tech/topics/code-generation.md>), [toolchain](<https://devfeed.tech/topics/toolchain.md>), [C++](<https://devfeed.tech/topics/c-plus-plus.md>)

Tags: [c-plus-plus](<https://devfeed.tech/tags/c-plus-plus.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cuda-tile](<https://devfeed.tech/tags/cuda-tile.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [kernels](<https://devfeed.tech/tags/kernels.md>), [nemo-retriever](<https://devfeed.tech/tags/nemo-retriever.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [programming-languages-compilers](<https://devfeed.tech/tags/programming-languages-compilers.md>), [rust](<https://devfeed.tech/tags/rust.md>), [toolchains](<https://devfeed.tech/tags/toolchains.md>)

### AI overview

NVIDIA introduces CUDA Rust for writing GPU kernels natively in Rust and compiling them to PTX. The article explains the SIMT and Tile programming tracks, recommends Tile as the default, and describes cuda-oxide's Rust-based code-generation path.

### Source excerpt

In September 2026, NVIDIA announced it is leaning into native GPU programming in Rust. CUDA C++ and CUDA Python are mature, enterprise-grade toolchains, and...

## Building a Memory-Driven Agent with NVIDIA NemoClaw

DevFeed: [Building a Memory-Driven Agent with NVIDIA NemoClaw](<https://devfeed.tech/articles/building-a-memory-driven-agent-with-nvidia-nemoclaw-6768.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/building-a-memory-driven-agent-with-nvidia-nemoclaw/>)

Author: Tanya Lenz

Published: 2026-09-04T18:04:55Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Architecture & Design](<https://devfeed.tech/topics/architecture-design.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [Markdown](<https://devfeed.tech/topics/markdown.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [build-ai-agents](<https://devfeed.tech/tags/build-ai-agents.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [llms](<https://devfeed.tech/tags/llms.md>), [memory](<https://devfeed.tech/tags/memory.md>), [nemoclaw](<https://devfeed.tech/tags/nemoclaw.md>), [openshell](<https://devfeed.tech/tags/openshell.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [retrieval-augmented-generation-rag](<https://devfeed.tech/tags/retrieval-augmented-generation-rag.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

This tutorial describes building a memory-driven AI agent with NVIDIA NemoClaw for enterprise work. It presents a structured self model, separates evidence from derived knowledge and governed execution, and emphasizes retrieval, user corrections, security, and authorization.

### Source excerpt

Enterprise work spans messages, decisions, projects, and obligations that change over time. An AI agent that starts without this context must reconstruct it...

## Frontier Reasoning Reaches the Edge: How to Deploy and Optimize Models on NVIDIA Jetson

DevFeed: [Frontier Reasoning Reaches the Edge: How to Deploy and Optimize Models on NVIDIA Jetson](<https://devfeed.tech/articles/frontier-reasoning-reaches-the-edge-how-to-deploy-and-optimize-models-on-nvidia-jetson-6826.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/frontier-reasoning-reaches-the-edge-how-to-deploy-and-optimize-models-on-nvidia-jetson/>)

Author: Elizabeth Goodman

Published: 2026-09-04T16:21:04Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Jetson](<https://devfeed.tech/topics/jetson.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [edge](<https://devfeed.tech/tags/edge.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [jetpack](<https://devfeed.tech/tags/jetpack.md>), [jetson](<https://devfeed.tech/tags/jetson.md>), [jetson-orin](<https://devfeed.tech/tags/jetson-orin.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [physical-ai](<https://devfeed.tech/tags/physical-ai.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [thor](<https://devfeed.tech/tags/thor.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

A tutorial on deploying and optimizing compact reasoning and agentic AI models on NVIDIA Jetson. It covers choosing models, improving inference with NVFP4 quantization and speculative decoding, serving example models with vLLM, and validating a configuration for a workload.

### Source excerpt

Running reasoning and agentic AI at the edge has been harder than it needs to be. Until recently, models capable of multi-step reasoning were too large to run...

## How to Carry User Identity Across Federated Kubernetes and AI Platforms

DevFeed: [How to Carry User Identity Across Federated Kubernetes and AI Platforms](<https://devfeed.tech/articles/how-to-carry-user-identity-across-federated-kubernetes-and-ai-platforms-6845.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-to-carry-user-identity-across-federated-kubernetes-and-ai-platforms/>)

Author: Elizabeth Goodman

Published: 2026-09-03T22:36:02Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI Platform](<https://devfeed.tech/topics/ai-platform.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>)

Tags: [ai-platform](<https://devfeed.tech/tags/ai-platform.md>), [ai-platforms-deployment](<https://devfeed.tech/tags/ai-platforms-deployment.md>), [api](<https://devfeed.tech/tags/api.md>), [aws](<https://devfeed.tech/tags/aws.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [data](<https://devfeed.tech/tags/data.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [identity](<https://devfeed.tech/tags/identity.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [software-defined-data-center](<https://devfeed.tech/tags/software-defined-data-center.md>)

### AI overview

The article presents a central identity-gateway pattern for carrying user identity across federated Kubernetes, data, and AI platforms. It uses OIDC, a shared session store, stateless data-plane gateways, and an identity-validation API to establish trusted local identity context without distributing raw tokens to every application.

### Source excerpt

Modern AI platforms are no longer a single application behind one login screen. A user may start in a central portal, open a governed dataset, launch a notebook...

## NVIDIA PAIR Virtual Inference Router Expands Available Compute on Your Local Network

DevFeed: [NVIDIA PAIR Virtual Inference Router Expands Available Compute on Your Local Network](<https://devfeed.tech/articles/nvidia-pair-virtual-inference-router-expands-available-compute-on-your-local-network-6907.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/nvidia-pair-virtual-inference-router-expands-available-compute-on-your-local-network/>)

Author: Tanya Lenz

Published: 2026-09-03T16:00:00Z

Content type: release

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Inference](<https://devfeed.tech/topics/inference.md>), [Local AI](<https://devfeed.tech/topics/local-ai.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>)

Tags: [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [compute](<https://devfeed.tech/tags/compute.md>), [content-creation-rendering](<https://devfeed.tech/tags/content-creation-rendering.md>), [dgx-spark](<https://devfeed.tech/tags/dgx-spark.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [gaming](<https://devfeed.tech/tags/gaming.md>), [geforce](<https://devfeed.tech/tags/geforce.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [inference](<https://devfeed.tech/tags/inference.md>), [local](<https://devfeed.tech/tags/local.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open-source](<https://devfeed.tech/tags/open-source.md>)

### AI overview

NVIDIA PAIR is a beta virtual inference router that distributes independent local inference requests across eligible machines on a home network. It works through compatible Ollama and LM Studio interfaces without requiring changes to an agent harness.

### Source excerpt

AI agents are learning to do more by working together. A lead agent can break a complex task into smaller jobs and assign those jobs to specialized subagents....

## The Modern CUDA Toolbox in Practice: A Step-by-Step Optimization Walkthrough

DevFeed: [The Modern CUDA Toolbox in Practice: A Step-by-Step Optimization Walkthrough](<https://devfeed.tech/articles/the-modern-cuda-toolbox-in-practice-a-step-by-step-optimization-walkthrough-6944.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/the-modern-cuda-toolbox-in-practice-a-step-by-step-optimization-walkthrough/>)

Author: Elizabeth Goodman

Published: 2026-09-02T17:15:57Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [CUDA](<https://devfeed.tech/topics/cuda.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [toolchain](<https://devfeed.tech/topics/toolchain.md>), [debug](<https://devfeed.tech/topics/debug.md>), [Instrumentation](<https://devfeed.tech/topics/instrumentation.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>)

Tags: [algorithms](<https://devfeed.tech/tags/algorithms.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [debug](<https://devfeed.tech/tags/debug.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [image-processing](<https://devfeed.tech/tags/image-processing.md>), [instrumentation](<https://devfeed.tech/tags/instrumentation.md>), [memory](<https://devfeed.tech/tags/memory.md>), [optimization](<https://devfeed.tech/tags/optimization.md>)

### AI overview

A step-by-step CUDA optimization walkthrough that improves an image-processing pipeline with debugging, benchmarking, optimized algorithms, GPU memory management, pinned transfers, streams, and asynchronous transfers.

### Source excerpt

NVIDIA CUDA remains the foundation of GPU-accelerated computing, powering everything from scientific simulations to large-scale AI training. But writing...

## Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference

DevFeed: [Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference](<https://devfeed.tech/articles/co-designing-ai-models-using-speculative-decoding-for-faster-llm-inference-6781.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/co-designing-ai-models-using-speculative-decoding-for-faster-llm-inference/>)

Author: Tanya Lenz

Published: 2026-09-02T16:04:19Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Inference](<https://devfeed.tech/topics/inference.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [accelerate](<https://devfeed.tech/tags/accelerate.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [batch](<https://devfeed.tech/tags/batch.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llms](<https://devfeed.tech/tags/llms.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>)

### AI overview

The article explains speculative decoding as a way to speed up LLM inference while preserving standard-decoding outputs. A smaller draft model proposes several tokens, which the larger target model verifies in parallel; it also defines draft and acceptance lengths and gives a speedup formula.

### Source excerpt

This post is the third in a series on AI model co-design. It explores how to accelerate LLM inference while maintaining accuracy using speculative decoding and...

## Building an Adaptive Agentic Cybersecurity System with NVIDIA Nemotron

DevFeed: [Building an Adaptive Agentic Cybersecurity System with NVIDIA Nemotron](<https://devfeed.tech/articles/building-an-adaptive-agentic-cybersecurity-system-with-nvidia-nemotron-6770.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/building-an-adaptive-agentic-cybersecurity-system-with-nvidia-nemotron/>)

Author: Michelle Horton

Published: 2026-09-01T17:00:04Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI Bots](<https://devfeed.tech/topics/ai-bots.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [attacks](<https://devfeed.tech/tags/attacks.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [models](<https://devfeed.tech/tags/models.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open](<https://devfeed.tech/tags/open.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [security-for-ai](<https://devfeed.tech/tags/security-for-ai.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>), [testing](<https://devfeed.tech/tags/testing.md>), [top-stories](<https://devfeed.tech/tags/top-stories.md>), [traces](<https://devfeed.tech/tags/traces.md>), [trustworthy-ai-cybersecurity](<https://devfeed.tech/tags/trustworthy-ai-cybersecurity.md>)

### AI overview

The article describes an agentic cybersecurity system that uses red and blue agents to continuously test attacks, analyze telemetry, generate detections, and retest them in an isolated representative environment. It discusses NVIDIA Nemotron models used with CrowdStrike SafeMind for defensive orchestration and detection generation.

### Source excerpt

AI is changing the pace of cybersecurity. Agentic systems can coordinate work and pursue complex objectives over long horizons. Security teams are beginning to...

## How to Size GPUs for AI Inference and TCO Without Overspending

DevFeed: [How to Size GPUs for AI Inference and TCO Without Overspending](<https://devfeed.tech/articles/how-to-size-gpus-for-ai-inference-and-tco-without-overspending-6859.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-to-size-gpus-for-ai-inference-and-tco-without-overspending/>)

Author: Elizabeth Goodman

Published: 2026-09-01T15:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [quantization](<https://devfeed.tech/tags/quantization.md>)

### AI overview

A practical guide to sizing GPU infrastructure for AI inference workloads while balancing latency, concurrency, model choice, deployment strategy, and total cost of ownership.

### Source excerpt

The surge in AI adoption is transforming everything from chatbots to content generation. Still, a common pain point remains: How can organizations confidently...

## Run NVIDIA BioNeMo NIM Microservices for Protein Structure Prediction in Claude Science

DevFeed: [Run NVIDIA BioNeMo NIM Microservices for Protein Structure Prediction in Claude Science](<https://devfeed.tech/articles/run-nvidia-bionemo-nim-microservices-for-protein-structure-prediction-in-claude-science-6934.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/run-nvidia-bionemo-nim-microservices-for-protein-structure-prediction-in-claude-science/>)

Author: Michelle Horton

Published: 2026-08-31T16:30:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI research agents](<https://devfeed.tech/topics/ai-research-agents.md>), [OpenSSH](<https://devfeed.tech/topics/openssh.md>)

Tags: [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [bionemo](<https://devfeed.tech/tags/bionemo.md>), [claude](<https://devfeed.tech/tags/claude.md>), [code](<https://devfeed.tech/tags/code.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [drug-discovery](<https://devfeed.tech/tags/drug-discovery.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [microservices](<https://devfeed.tech/tags/microservices.md>), [nim](<https://devfeed.tech/tags/nim.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [science](<https://devfeed.tech/tags/science.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

A tutorial for running NVIDIA BioNeMo NIM microservices with Claude Science to perform protein-structure prediction using multiple-sequence alignment and multiple folding models.

### Source excerpt

Agentic AI is changing how research is done. AI scientists can read papers, propose hypotheses, call models, and determine which experiments to prioritize next....

## Scale AV Perception Across Vehicle Platforms with NVIDIA Omniverse NuRec

DevFeed: [Scale AV Perception Across Vehicle Platforms with NVIDIA Omniverse NuRec](<https://devfeed.tech/articles/scale-av-perception-across-vehicle-platforms-with-nvidia-omniverse-nurec-6936.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/scale-av-perception-across-vehicle-platforms-with-nvidia-omniverse-nurec/>)

Author: Michelle Horton

Published: 2026-08-31T16:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [synthetic-data](<https://devfeed.tech/topics/synthetic-data.md>), [Simulation and Design](<https://devfeed.tech/topics/simulation-and-design.md>), [data](<https://devfeed.tech/topics/data.md>), [configuration](<https://devfeed.tech/topics/configuration.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-vehicles](<https://devfeed.tech/tags/autonomous-vehicles.md>), [data](<https://devfeed.tech/tags/data.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [developers](<https://devfeed.tech/tags/developers.md>), [development](<https://devfeed.tech/tags/development.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [omniverse](<https://devfeed.tech/tags/omniverse.md>), [performance](<https://devfeed.tech/tags/performance.md>), [physical-ai](<https://devfeed.tech/tags/physical-ai.md>), [post](<https://devfeed.tech/tags/post.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [scale](<https://devfeed.tech/tags/scale.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [synthetic-data](<https://devfeed.tech/tags/synthetic-data.md>), [training](<https://devfeed.tech/tags/training.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>)

### AI overview

This tutorial explains how to adapt an autonomous-vehicle perception stack across carline and sensor-rig variants using existing real-world drives. It presents a four-step workflow with NVIDIA Omniverse NuRec: pair a reconstructed drive with a target rig, render target camera views, refine the frames with NVIDIA Harmonizer, and train a perception model on the output.

### Source excerpt

A perception stack is shaped by the vehicle that carries it. Move the same software to a new carline--for example, from an SUV to a sedan or another vehicle...

[Next page](<https://devfeed.tech/sources/nvidia-technical-blog.md?cursor=WyIyMDI2LTA4LTMxVDE2OjAwOjAwKzAwOjAwIiwgIjUwNjc2ZjFjLThmMjMtNGU5NS05ODYxLWE5MjE4ZTg0OGY2MCJd>)