# NVIDIA DGX

Published articles for NVIDIA DGX.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Perplexity Portable Computer Is Now Available on Windows, Powered by NVIDIA RTX

DevFeed: [Perplexity Portable Computer Is Now Available on Windows, Powered by NVIDIA RTX](<https://devfeed.tech/articles/perplexity-portable-computer-is-now-available-on-windows-powered-by-nvidia-rtx-21586.md>)

Original publisher: [Read original article](<https://blogs.nvidia.com/blog/local-ai-perplexity-windows-pcs/>)

Author: Gerardo Delgado

Published: 2026-09-14T15:00:52Z

Content type: news

Language: en

Sources: [NVIDIA Blog](<https://devfeed.tech/sources/nvidia-blog.md>)

Topics: [Local AI](<https://devfeed.tech/topics/local-ai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [NVIDIA RTX](<https://devfeed.tech/topics/nvidia-rtx.md>), [Windows](<https://devfeed.tech/topics/windows.md>), [GeForce](<https://devfeed.tech/topics/geforce.md>), [qwen](<https://devfeed.tech/topics/qwen.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [GitHub](<https://devfeed.tech/topics/github.md>), [Slack](<https://devfeed.tech/topics/slack.md>), [Google](<https://devfeed.tech/topics/google.md>), [Microsoft](<https://devfeed.tech/topics/microsoft.md>)

Tags: [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [dgx-spark](<https://devfeed.tech/tags/dgx-spark.md>), [drive](<https://devfeed.tech/tags/drive.md>), [geforce](<https://devfeed.tech/tags/geforce.md>), [github](<https://devfeed.tech/tags/github.md>), [google](<https://devfeed.tech/tags/google.md>), [local-ai](<https://devfeed.tech/tags/local-ai.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [nvidia-rtx](<https://devfeed.tech/tags/nvidia-rtx.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [rtx-pro](<https://devfeed.tech/tags/rtx-pro.md>), [rtx-spark](<https://devfeed.tech/tags/rtx-spark.md>), [slack](<https://devfeed.tech/tags/slack.md>), [windows](<https://devfeed.tech/tags/windows.md>)

### AI overview

Perplexity is adding Portable Computer to its Windows app for compatible NVIDIA GeForce RTX PCs and NVIDIA RTX PRO Workstations. The local agent uses NVIDIA-accelerated models to plan multistep tasks, analyze files, and keep sensitive information on the device, while users can authorize cloud support for more advanced research and reasoning.

### Source excerpt

As local models become more capable, AI agents can handle more work directly on a PC while keeping sensitive information on the device. Portable Computer is a local version of the agent Perplexity Computer that plans and carries out multistep tasks. Accelerated by NVIDIA GPUs, it uses local models to analyze data, bring together information [...]

## Physical AI Takes the Wheel: How the World's Robotaxi Leaders Are Building With NVIDIA Technologies

DevFeed: [Physical AI Takes the Wheel: How the World's Robotaxi Leaders Are Building With NVIDIA Technologies](<https://devfeed.tech/articles/physical-ai-takes-the-wheel-how-the-world-s-robotaxi-leaders-are-building-with-nvidia-technologies-6959.md>)

Original publisher: [Read original article](<https://blogs.nvidia.com/blog/robotaxi-leaders-full-stack-open-platform/>)

Author: Ali Kani

Published: 2026-09-10T16:00:04Z

Content type: article

Language: en

Sources: [NVIDIA Blog](<https://devfeed.tech/sources/nvidia-blog.md>)

Topics: [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>)

Tags: [ai-models](<https://devfeed.tech/tags/ai-models.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [autonomous-vehicles](<https://devfeed.tech/tags/autonomous-vehicles.md>), [cosmos](<https://devfeed.tech/tags/cosmos.md>), [customer-stories](<https://devfeed.tech/tags/customer-stories.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [driving](<https://devfeed.tech/tags/driving.md>), [mobility](<https://devfeed.tech/tags/mobility.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-blackwell](<https://devfeed.tech/tags/nvidia-blackwell.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [nvidia-drive](<https://devfeed.tech/tags/nvidia-drive.md>), [nvidia-halos](<https://devfeed.tech/tags/nvidia-halos.md>), [omniverse](<https://devfeed.tech/tags/omniverse.md>), [physical-ai](<https://devfeed.tech/tags/physical-ai.md>), [simulation-and-design](<https://devfeed.tech/tags/simulation-and-design.md>)

### AI overview

NVIDIA describes an open robotaxi platform for training AI driving models, simulation and safety validation, and real-time in-vehicle computing.

### Source excerpt

The global robotaxi market -- physical AI's first commercial breakthrough -- is projected to reach $400 billion by 2035, with over 6 million commercial vehicles in operation as driverless fleets are already moving people through some of the world's busiest and most complex streets. Deploying a driverless vehicle is one challenge. Scaling a fleet is [...]

## Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things

DevFeed: [Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things](<https://devfeed.tech/articles/qwen-3-8-27b-is-excellent-but-it-defaults-to-wildly-overthinking-things-30498.md>)

Original publisher: [Read original article](<https://simonwillison.net/2026/Aug/16/qwen-38-27b/>)

Author: Simon Willison

Published: 2026-08-16T22:00:39Z

Content type: opinion

Language: en

Sources: [Simon Willison](<https://devfeed.tech/sources/simon-willison.md>)

Topics: [qwen](<https://devfeed.tech/topics/qwen.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>), [DGX Spark](<https://devfeed.tech/topics/dgx-spark.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [SVG](<https://devfeed.tech/topics/svg.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-2-235](<https://devfeed.tech/tags/ai-2-235.md>), [ai-in-china](<https://devfeed.tech/tags/ai-in-china.md>), [ai-in-china-108](<https://devfeed.tech/tags/ai-in-china-108.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [coding-agents-248](<https://devfeed.tech/tags/coding-agents-248.md>), [cost](<https://devfeed.tech/tags/cost.md>), [dgx-spark](<https://devfeed.tech/tags/dgx-spark.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [generative-ai-1-981](<https://devfeed.tech/tags/generative-ai-1-981.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [llama-cpp-29](<https://devfeed.tech/tags/llama-cpp-29.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-reasoning](<https://devfeed.tech/tags/llm-reasoning.md>), [llm-reasoning-103](<https://devfeed.tech/tags/llm-reasoning-103.md>), [llm-release](<https://devfeed.tech/tags/llm-release.md>), [llm-release-231](<https://devfeed.tech/tags/llm-release-231.md>), [llms](<https://devfeed.tech/tags/llms.md>), [llms-1-947](<https://devfeed.tech/tags/llms-1-947.md>), [lm-studio](<https://devfeed.tech/tags/lm-studio.md>), [lm-studio-23](<https://devfeed.tech/tags/lm-studio-23.md>), [local-llms](<https://devfeed.tech/tags/local-llms.md>), [local-llms-164](<https://devfeed.tech/tags/local-llms-164.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [nvidia-spark](<https://devfeed.tech/tags/nvidia-spark.md>), [nvidia-spark-6](<https://devfeed.tech/tags/nvidia-spark-6.md>), [pelican-riding-a-bicycle](<https://devfeed.tech/tags/pelican-riding-a-bicycle.md>), [pelican-riding-a-bicycle-142](<https://devfeed.tech/tags/pelican-riding-a-bicycle-142.md>), [pi](<https://devfeed.tech/tags/pi.md>), [pi-6](<https://devfeed.tech/tags/pi-6.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [qwen-61](<https://devfeed.tech/tags/qwen-61.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [speed](<https://devfeed.tech/tags/speed.md>), [svg](<https://devfeed.tech/tags/svg.md>)

### AI overview

Simon Willison evaluates Qwen 3.8 27B, a vision-capable 27-billion-parameter LLM that can run locally on suitable hardware. He finds that its default xhigh reasoning setting consumes substantial context and time, while adjusting the reasoning effort and increasing the context limit improves practicality. He also reports strong results generating an SVG locally.

### Source excerpt

Friday's big release was Qwen 3.8 27B, an Apache 2 licensed 27B parameter vision-capable LLM from Alibaba's Qwen research lab. I've been looking forward to this one: 27B is an excellent size for running a model on a reasonably specced laptop, and its predecessor Qwen 3.6 27B was impressive. Qwen's self-reported benchmarks for this model are eye-opening. They show a boost from both Qwen 3.6 27B and the closed-weight Qwen 3.7-Plus, which was one of Qwen's strongest models of any size as recently as May this year. It will be interesting to hear what independent benchmarks have to say about the model. I've been running the model on two different machines: my 128GB M5 Max MacBook Pro, and an NVIDIA DGX Spark. On both machines I'm running LM Studio and their 17GB Q4_K_M quantized build. I also tried using llama-server directly on the Spark. The default of extra high results in spectacular over-thinking Qwen's documentation describes the model as defaulting to xhigh for the reasoning effort, and the LM Studio GGUF I've been trying preserves that default: Qwen3.8 comes with official support for reasoning_effort, which can be used to adjust reasoning depth and control cost: xhigh (default): for complex tasks demanding thorough analysis medium: balancing accuracy and speed low: efficient reasoning optimizing for speed and cost This is a hilarious default. It's absolutely not a good way to run the model, especially on consumer hardware. I've been finding the results extremely entertaining. I quickly ran into problems with LM Studio's default context limit of 8,192 tokens - Qwen was using them all up thinking about even the most mundane of problems. I loaded the model with the full 262,144 maximum context length and that problem went away. Here's the pelican riding a bicycle SVG I got from my first attempt with that increased context length. It took 21 minutes to generate, using 22,276 reasoning tokens to produce 3,223 tokens of output. You can read the reasoning trace here. Th

## How to Choose Full-Stack Observability for NVIDIA AI Factories

DevFeed: [How to Choose Full-Stack Observability for NVIDIA AI Factories](<https://devfeed.tech/articles/how-to-choose-full-stack-observability-for-nvidia-ai-factories-6847.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-to-choose-full-stack-observability-for-nvidia-ai-factories/>)

Author: Jorge Cardoso

Published: 2026-08-12T16:13:47Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [observability](<https://devfeed.tech/topics/observability.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [InfiniBand](<https://devfeed.tech/topics/infiniband.md>), [telemetry](<https://devfeed.tech/topics/telemetry.md>), [dashboards](<https://devfeed.tech/topics/dashboards.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>)

Tags: [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [featured](<https://devfeed.tech/tags/featured.md>), [infiniband](<https://devfeed.tech/tags/infiniband.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [nccl](<https://devfeed.tech/tags/nccl.md>), [networking](<https://devfeed.tech/tags/networking.md>), [networking-communications](<https://devfeed.tech/tags/networking-communications.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [observability](<https://devfeed.tech/tags/observability.md>), [operations](<https://devfeed.tech/tags/operations.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [performance](<https://devfeed.tech/tags/performance.md>), [storage](<https://devfeed.tech/tags/storage.md>), [systems](<https://devfeed.tech/tags/systems.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>)

### AI overview

A practical guide to choosing a full-stack observability strategy for NVIDIA AI infrastructure. It explains how to connect telemetry across compute, networking, storage, orchestration, and applications, using an InfiniBand gray-failure example to show how degraded hardware and NCCL collective-operation delays can reduce distributed-training throughput.

### Source excerpt

AI infrastructure spans multiple layers, from compute and networking to storage, orchestration, and applications. When performance degrades, identifying the...

## Run Local Agentic AI Workflows with Meta's Muse Glimmer on NVIDIA

DevFeed: [Run Local Agentic AI Workflows with Meta's Muse Glimmer on NVIDIA](<https://devfeed.tech/articles/run-local-agentic-ai-workflows-with-meta-s-muse-glimmer-on-nvidia-6932.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/run-local-agentic-ai-workflows-with-metas-muse-glimmer-on-nvidia/>)

Author: Michelle Horton

Published: 2026-08-10T13:27:19Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Local AI](<https://devfeed.tech/topics/local-ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [long-context](<https://devfeed.tech/topics/long-context.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Meta](<https://devfeed.tech/topics/meta.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [Jetson](<https://devfeed.tech/topics/jetson.md>), [Automation](<https://devfeed.tech/topics/automation.md>)

Tags: [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [automation](<https://devfeed.tech/tags/automation.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [dgx-spark](<https://devfeed.tech/tags/dgx-spark.md>), [dgx-station](<https://devfeed.tech/tags/dgx-station.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [jetson](<https://devfeed.tech/tags/jetson.md>), [local-ai](<https://devfeed.tech/tags/local-ai.md>), [nemoclaw](<https://devfeed.tech/tags/nemoclaw.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [top-stories](<https://devfeed.tech/tags/top-stories.md>)

### AI overview

Meta's Muse Glimmer is a 30B open-weight dense model designed for local agentic AI workflows. With a 120K+ context window and performance of up to 20K tokens per second on a single GPU, it supports sustained, multi-step tool use and local processing of sensitive data.

### Source excerpt

Meta returns to the open source ecosystem with the release of Muse Glimmer, a 30B open-weight dense model with a 120K+ context window built for local AI...

## Running Low-Latency Analytical Workloads with GPU-Accelerated Presto on NVIDIA GB200 NVL72

DevFeed: [Running Low-Latency Analytical Workloads with GPU-Accelerated Presto on NVIDIA GB200 NVL72](<https://devfeed.tech/articles/running-low-latency-analytical-workloads-with-gpu-accelerated-presto-on-nvidia-gb200-nvl72-6935.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/running-low-latency-analytical-workloads-with-gpu-accelerated-presto-on-nvidia-gb200-nvl72/>)

Author: Tanya Lenz

Published: 2026-07-08T16:05:25Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [GPU](<https://devfeed.tech/topics/gpu.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [GPUDirect](<https://devfeed.tech/topics/gpudirect.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [C++](<https://devfeed.tech/topics/c-plus-plus.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>)

Tags: [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [c-plus-plus](<https://devfeed.tech/tags/c-plus-plus.md>), [cache](<https://devfeed.tech/tags/cache.md>), [communication](<https://devfeed.tech/tags/communication.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [data](<https://devfeed.tech/tags/data.md>), [data-analytics](<https://devfeed.tech/tags/data-analytics.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpudirect](<https://devfeed.tech/tags/gpudirect.md>), [latency](<https://devfeed.tech/tags/latency.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [multi-gpu](<https://devfeed.tech/tags/multi-gpu.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [performance](<https://devfeed.tech/tags/performance.md>)

### AI overview

This article presents GPU-accelerated Presto for low-latency analytical SQL workloads on large datasets. It compares single-node multi-GPU execution on NVIDIA DGX B200 and multinode NVIDIA GB200 NVL72 systems with CPU-based Presto, highlighting NVLink communication, GPUDirect Storage, cuDF algorithms, Parquet data, and benchmark results.

### Source excerpt

Presto is an open source, distributed SQL engine for running fast, interactive queries on very large datasets. On NVIDIA GPUs, Presto delivers peak performance...

## Ubuntu Server on the NVIDIA DGX Spark (Without the Desktop)

DevFeed: [Ubuntu Server on the NVIDIA DGX Spark (Without the Desktop)](<https://devfeed.tech/articles/ubuntu-server-on-the-nvidia-dgx-spark-without-the-desktop-10683.md>)

Original publisher: [Read original article](<https://technotim.com/posts/ubuntu-gb10/>)

Author: Techno Tim

Published: 2026-06-22T13:00:00Z

Content type: tutorial

Language: en

Sources: [Techno Tim](<https://devfeed.tech/sources/techno-tim.md>)

Topics: [DGX Spark](<https://devfeed.tech/topics/dgx-spark.md>), [Ubuntu](<https://devfeed.tech/topics/ubuntu.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [Docker](<https://devfeed.tech/topics/docker.md>), [Ansible](<https://devfeed.tech/topics/ansible.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [Blackwell](<https://devfeed.tech/topics/blackwell.md>), [networking](<https://devfeed.tech/topics/networking.md>), [GitHub](<https://devfeed.tech/topics/github.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ansible](<https://devfeed.tech/tags/ansible.md>), [blackwell](<https://devfeed.tech/tags/blackwell.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [dell](<https://devfeed.tech/tags/dell.md>), [dgx-spark](<https://devfeed.tech/tags/dgx-spark.md>), [docker](<https://devfeed.tech/tags/docker.md>), [github](<https://devfeed.tech/tags/github.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [homelab](<https://devfeed.tech/tags/homelab.md>), [networking](<https://devfeed.tech/tags/networking.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [ubuntu](<https://devfeed.tech/tags/ubuntu.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

A guide to replacing DGX OS with a minimized Ubuntu 24.04 Server installation on GB10 systems such as the NVIDIA DGX Spark and ASUS Ascent GX10. It explains the memory and power benefits of removing GNOME while retaining the NVIDIA drivers, CUDA, Docker, and NVIDIA Container Toolkit, and covers ConnectX-7 networking, dual-node setup, and Ansible automation.

### Source excerpt

When you buy an NVIDIA DGX Spark or an ASUS Ascent GX10, it ships with DGX OS. DGX OS is NVIDIA's managed Ubuntu image, and it is fine - if you want a full GNOME desktop on an AI box. I did not want that. The GB10 has 128 GB of unified memory shared between the CPU and GPU over NVLink-C2C. Every gigabyte the OS and desktop environment consume is a gigabyte not available to your model. On the ...

## Running the Latest vLLM on the NVIDIA DGX Spark

DevFeed: [Running the Latest vLLM on the NVIDIA DGX Spark](<https://devfeed.tech/articles/running-the-latest-vllm-on-the-nvidia-dgx-spark-10704.md>)

Original publisher: [Read original article](<https://technotim.com/posts/vllm-gb10-docker/>)

Author: Techno Tim

Published: 2026-05-21T13:00:00Z

Content type: tutorial

Language: en

Sources: [Techno Tim](<https://devfeed.tech/sources/techno-tim.md>)

Topics: [vllm](<https://devfeed.tech/topics/vllm.md>), [DGX Spark](<https://devfeed.tech/topics/dgx-spark.md>), [Docker](<https://devfeed.tech/topics/docker.md>), [Dockerfile](<https://devfeed.tech/topics/dockerfile.md>), [GitHub Actions](<https://devfeed.tech/topics/github-actions.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>), [GitHub](<https://devfeed.tech/topics/github.md>), [NGC](<https://devfeed.tech/topics/ngc.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Ubuntu](<https://devfeed.tech/topics/ubuntu.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [dgx-spark](<https://devfeed.tech/tags/dgx-spark.md>), [docker](<https://devfeed.tech/tags/docker.md>), [docker-image](<https://devfeed.tech/tags/docker-image.md>), [github](<https://devfeed.tech/tags/github.md>), [github-actions](<https://devfeed.tech/tags/github-actions.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [homelab](<https://devfeed.tech/tags/homelab.md>), [nccl](<https://devfeed.tech/tags/nccl.md>), [ngc](<https://devfeed.tech/tags/ngc.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [self-hosted](<https://devfeed.tech/tags/self-hosted.md>), [ubuntu](<https://devfeed.tech/tags/ubuntu.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

This tutorial presents a reproducible Docker image pipeline for running current vLLM releases on the NVIDIA DGX Spark's GB10 ARM64 platform. It explains why NVIDIA's NGC images can lag upstream and describes a GitHub Actions build on a self-hosted Spark runner with pinned inputs and generated lockfiles.

### Source excerpt

When I built my local AI cluster on a pair of ASUS Ascent GX10s, the hard part was not serving a model. The hard part was getting a working vLLM image with current components. NVIDIA's official image was already over a month behind by the time I needed it, and waiting on their release schedule was not an option. If you saw that post, you know the GX10 is an ARM64 machine built around NVIDIA's ...

## Serverless Inference with Hugging Face and NVIDIA NIM

DevFeed: [Serverless Inference with Hugging Face and NVIDIA NIM](<https://devfeed.tech/articles/serverless-inference-with-hugging-face-and-nvidia-nim-7276.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/inference-dgx-cloud>)

Author: Philipp Schmid; Jeff Boudier

Published: 2024-07-29T00:00:00Z

Content type: release

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [NVIDIA NIM](<https://devfeed.tech/topics/nvidia-nim.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [DGX Cloud](<https://devfeed.tech/topics/dgx-cloud.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [API](<https://devfeed.tech/topics/api.md>), [llama](<https://devfeed.tech/topics/llama.md>), [Access Control](<https://devfeed.tech/topics/access-control.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [api](<https://devfeed.tech/tags/api.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [dgx-cloud](<https://devfeed.tech/tags/dgx-cloud.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dgx](<https://devfeed.tech/tags/nvidia-dgx.md>), [nvidia-nim](<https://devfeed.tech/tags/nvidia-nim.md>), [partnerships](<https://devfeed.tech/tags/partnerships.md>), [pricing](<https://devfeed.tech/tags/pricing.md>), [serverless](<https://devfeed.tech/tags/serverless.md>)

### AI overview

Hugging Face announces a serverless NVIDIA NIM API on the Hugging Face Hub for Enterprise Hub organizations. The service provides API access to open generative AI models, including Llama and Mistral, on NVIDIA DGX Cloud infrastructure, with pay-as-you-go pricing and a guide for creating fine-grained organization tokens. The article notes that the service was deprecated and unavailable as of April 10, 2025.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.