# NeMo

NVIDIA NeMo is a modular software suite of APIs and libraries for building, deploying, and optimizing AI agents, including an open-source Python framework for generative AI models.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Presentation: Decision Models in Agentic Architectures: From Production to Agent Skills

DevFeed: [Presentation: Decision Models in Agentic Architectures: From Production to Agent Skills](<https://devfeed.tech/articles/presentation-decision-models-in-agentic-architectures-from-production-to-agent-skills-17397.md>)

Original publisher: [Read original article](<https://www.infoq.com/presentations/decision-models-agentic-ai/>)

Author: Alex Porcelli

Published: 2026-09-14T11:00:00Z

Content type: article

Language: en

Sources: [InfoQ](<https://devfeed.tech/sources/infoq.md>)

Topics: [Agent Skills](<https://devfeed.tech/topics/agent-skills.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-skills](<https://devfeed.tech/tags/agent-skills.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai-architecture](<https://devfeed.tech/tags/agentic-ai-architecture.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-architecture](<https://devfeed.tech/tags/ai-architecture.md>), [ai-ml-data-engineering](<https://devfeed.tech/tags/ai-ml-data-engineering.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [architecture-design](<https://devfeed.tech/tags/architecture-design.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [business](<https://devfeed.tech/tags/business.md>), [decision-models-agentic-ai](<https://devfeed.tech/tags/decision-models-agentic-ai.md>), [development](<https://devfeed.tech/tags/development.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-architecture](<https://devfeed.tech/tags/enterprise-architecture.md>), [governance](<https://devfeed.tech/tags/governance.md>), [infoq](<https://devfeed.tech/tags/infoq.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [llms](<https://devfeed.tech/tags/llms.md>), [ml-data-engineering](<https://devfeed.tech/tags/ml-data-engineering.md>), [models](<https://devfeed.tech/tags/models.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [presentation](<https://devfeed.tech/tags/presentation.md>), [production](<https://devfeed.tech/tags/production.md>), [qcon-ai-boston-2026](<https://devfeed.tech/tags/qcon-ai-boston-2026.md>), [qcon-software-development-conference](<https://devfeed.tech/tags/qcon-software-development-conference.md>), [skills](<https://devfeed.tech/tags/skills.md>), [transcripts](<https://devfeed.tech/tags/transcripts.md>)

### AI overview

Alex Porcelli explains how DMN decision models can be integrated with LLMs, agent skills, and NeMo guardrails to create auditable and deterministic agentic architectures for high-stakes enterprise decisions.

### Source excerpt

Alex Porcelli discusses the critical gap in enterprise AI: non-deterministic output and lack of accountability in high-stakes decisions. He shares how integrating DMN decision models with LLMs, agent skills, and NeMo guardrails creates auditable, deterministic agentic architectures - allowing business leaders to own decision logic while engineers maintain robust architectural governance. By Alex Porcelli

## Deploy NeMo Guardrails on Red Hat OpenShift AI

DevFeed: [Deploy NeMo Guardrails on Red Hat OpenShift AI](<https://devfeed.tech/articles/deploy-nemo-guardrails-on-red-hat-openshift-ai-12349.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/09/deploy-nemo-guardrails-on-red-hat-openshift-ai>)

Author: Rob Geada

Published: 2026-09-09T15:05:01Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [NeMo](<https://devfeed.tech/topics/nemo.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [ai safety](<https://devfeed.tech/topics/ai-safety.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [prompt injection](<https://devfeed.tech/topics/prompt-injection.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [developer](<https://devfeed.tech/tags/developer.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [operator](<https://devfeed.tech/tags/operator.md>), [platform](<https://devfeed.tech/tags/platform.md>), [prompt-injection](<https://devfeed.tech/tags/prompt-injection.md>), [red-hat](<https://devfeed.tech/tags/red-hat.md>), [safety](<https://devfeed.tech/tags/safety.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

This tutorial explains how to deploy an evaluated NeMo Guardrails configuration on a Red Hat OpenShift AI cluster. It covers prerequisites, creating a ConfigMap from the configuration files, and creating a NeMoGuardrails custom resource for a managed deployment.

### Source excerpt

This is part 3 in a 3-part series on local guardrail development and evaluation. In the 1st article, I looked at how to design and develop a guardrail configuration on a local machine, and then tried some manual testing. In the 2nd article, I explored how to rigorously test a guardrail against popular large-scale risk datasets. The post Deploy NeMo Guardrails on Red Hat OpenShift AI appeared first on Red Hat Developer.

## Experiment with Qwen3.8-Flash-Next on NVIDIA GB300 NVL72 for Agentic Coding

DevFeed: [Experiment with Qwen3.8-Flash-Next on NVIDIA GB300 NVL72 for Agentic Coding](<https://devfeed.tech/articles/experiment-with-qwen3-8-flash-next-on-nvidia-gb300-nvl72-for-agentic-coding-6819.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/experiment-with-qwen3-8-flash-next-on-nvidia-gb300-nvl72-for-agentic-coding/>)

Author: Michelle Horton

Published: 2026-08-26T17:07:12Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [qwen](<https://devfeed.tech/topics/qwen.md>), [long-context](<https://devfeed.tech/topics/long-context.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [agentic-coding](<https://devfeed.tech/topics/agentic-coding.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [sglang](<https://devfeed.tech/topics/sglang.md>), [TensorRT-LLM](<https://devfeed.tech/topics/tensorrt-llm.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [rust-ai](<https://devfeed.tech/topics/rust-ai.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agentic-coding](<https://devfeed.tech/tags/agentic-coding.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gb300-nvl72](<https://devfeed.tech/tags/gb300-nvl72.md>), [inference](<https://devfeed.tech/tags/inference.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [sglang](<https://devfeed.tech/tags/sglang.md>), [tensorrt-llm](<https://devfeed.tech/tags/tensorrt-llm.md>), [top-stories](<https://devfeed.tech/tags/top-stories.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

This NVIDIA developer article introduces Qwen3.8-Flash-Next, a multimodal mixture-of-experts model released by Alibaba for experimentation and evaluation. It explains the model's long-context hybrid architecture, including Gated DeltaNet and Qwen Sparse Attention, and discusses reported efficiency improvements for million-token workloads. The article also covers inference support through SGLang, vLLM, TensorRT-LLM, and NVIDIA NeMo, plus performance on the NVIDIA GB300 NVL72 platform.

### Source excerpt

Alibaba released the model weights for Qwen3.8-Flash-Next as a preview of the upcoming Qwen4 architecture for developers to experiment with and evaluate. It's...

## The future of AI-native Is open source

DevFeed: [The future of AI-native Is open source](<https://devfeed.tech/articles/the-future-of-ai-native-is-open-source-12236.md>)

Original publisher: [Read original article](<https://platformengineering.org/blog/the-future-of-ai-native-is-open-source>)

Author: Sam Barlien

Published: 2026-07-23T05:40:01Z

Content type: opinion

Language: en

Sources: [Platform Engineering Blog](<https://devfeed.tech/sources/platform-engineering-blog.md>)

Topics: [Open Source](<https://devfeed.tech/topics/open-source.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Platform Engineering](<https://devfeed.tech/topics/platform-engineering.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Dynamo](<https://devfeed.tech/topics/dynamo.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [rocm](<https://devfeed.tech/topics/rocm.md>), [Linux](<https://devfeed.tech/topics/linux.md>), [OpenClaw](<https://devfeed.tech/topics/openclaw.md>)

Tags: [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [linux](<https://devfeed.tech/tags/linux.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [openclaw](<https://devfeed.tech/tags/openclaw.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>), [rocm](<https://devfeed.tech/tags/rocm.md>)

### AI overview

The article argues that AI infrastructure is undergoing a structural shift as NVIDIA and AMD open-source software for running and optimizing their hardware. It presents this as a platform engineering decision: ecosystem adoption and open software stacks may matter more than proprietary software control.

### Source excerpt

Chip vendors like NVIDIA and AMD are open sourcing the software that runs their AI hardware. Here is why that shift is a platform engineering decision.

## Deploy a Production-Ready NVIDIA AI-Q Blueprint on Oracle Cloud Infrastructure

DevFeed: [Deploy a Production-Ready NVIDIA AI-Q Blueprint on Oracle Cloud Infrastructure](<https://devfeed.tech/articles/deploy-a-production-ready-nvidia-ai-q-blueprint-on-oracle-cloud-infrastructure-6795.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/deploy-a-production-ready-nvidia-ai-q-blueprint-on-oracle-cloud-infrastructure/>)

Author: Anurag Kuppala

Published: 2026-06-26T19:00:45Z

Content type: tutorial

Language: en

Sources: [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Terraform](<https://devfeed.tech/topics/terraform.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [API keys](<https://devfeed.tech/topics/api-keys.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [api-keys](<https://devfeed.tech/tags/api-keys.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [featured](<https://devfeed.tech/tags/featured.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [langchain](<https://devfeed.tech/tags/langchain.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [oracle](<https://devfeed.tech/tags/oracle.md>), [rag](<https://devfeed.tech/tags/rag.md>), [terraform](<https://devfeed.tech/tags/terraform.md>)

### AI overview

A tutorial for deploying the open-source NVIDIA AI-Q 2.0 multi-agent blueprint on Oracle Cloud Infrastructure. It uses Terraform to provision OCI resources and Helm to install workloads on OKE, resulting in an AI-Q endpoint with a teardown command.

### Source excerpt

AI agents have changed a lot in the last two years. The first could only answer one question at a time. Then came multi-turn chat, where the model could keep...

## Accelerating Transformers Fine-Tuning with NVIDIA NeMo AutoModel

DevFeed: [Accelerating Transformers Fine-Tuning with NVIDIA NeMo AutoModel](<https://devfeed.tech/articles/accelerating-transformers-fine-tuning-with-nvidia-nemo-automodel-7374.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nvidia/accelerating-fine-tuning-nvidia-nemo-automodel>)

Author: Adil Asif; Alexandros Koumparoulis; Wenwen Gao; Sylendran Arunagiri; David Messina; Bernard Nguyen

Published: 2026-06-24T16:00:13Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [NeMo](<https://devfeed.tech/topics/nemo.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [distributed-training](<https://devfeed.tech/topics/distributed-training.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [sglang](<https://devfeed.tech/topics/sglang.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [building](<https://devfeed.tech/tags/building.md>), [compute](<https://devfeed.tech/tags/compute.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generative](<https://devfeed.tech/tags/generative.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [kernels](<https://devfeed.tech/tags/kernels.md>), [memory](<https://devfeed.tech/tags/memory.md>), [model](<https://devfeed.tech/tags/model.md>), [moe](<https://devfeed.tech/tags/moe.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open](<https://devfeed.tech/tags/open.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

This article explains how NVIDIA NeMo AutoModel accelerates fine-tuning of mixture-of-experts models by extending Transformers v5 with Expert Parallelism, DeepEP fused all-to-all dispatch, and TransformerEngine kernels. It describes API compatibility, distributed execution, dynamic weight loading, and reported gains of 3.4-3.7x higher training throughput and 29-32% lower GPU memory use.

### Source excerpt

NVIDIA NeMo AutoModel is an open library part of the NVIDIA NeMo framework for building custom generative AI models at scale. NeMo AutoModel builds cleanly on top of v5, adding Expert Parallelism, DeepEP fused all-to-all dispatch, and TransformerEngine kernels, and it leans on v5's dynamic weight loading to bring those optimizations to a broad and growing set of model families.

## Build a Domain-Specific Embedding Model in Under a Day

DevFeed: [Build a Domain-Specific Embedding Model in Under a Day](<https://devfeed.tech/articles/build-a-domain-specific-embedding-model-in-under-a-day-7379.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nvidia/domain-specific-embedding-finetune>)

Author: Steve Han; Rucha Apte; Sean Sodha; Oliver Holworthy

Published: 2026-03-20T19:38:16Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [synthetic-data](<https://devfeed.tech/topics/synthetic-data.md>), [Synthetic Data Generation](<https://devfeed.tech/topics/synthetic-data-generation.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [NVIDIA NIM](<https://devfeed.tech/topics/nvidia-nim.md>), [TensorRT](<https://devfeed.tech/topics/tensorrt.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [API keys](<https://devfeed.tech/topics/api-keys.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nim](<https://devfeed.tech/tags/nim.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-nim](<https://devfeed.tech/tags/nvidia-nim.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [synthetic-data](<https://devfeed.tech/tags/synthetic-data.md>), [synthetic-data-generation](<https://devfeed.tech/tags/synthetic-data-generation.md>)

### AI overview

A tutorial showing how to fine-tune a general-purpose embedding model for a specific domain in less than a day using synthetic question-answer pairs generated from domain documents. It covers data generation, contrastive training, retrieval evaluation, and deployment, using NVIDIA NeMo components and a Llama-Nemotron embedding model.

### Source excerpt

With a single GPU and less than a day of training time, you can transform a general-purpose embedding model into one that truly understands your domain, no manual labeling required. To help you hit the ground running, we are also releasing a ready-to-use synthetic training dataset generated from NVIDIA's public documentation using this exact pipeline.

## Mistral AI partners with NVIDIA to accelerate open frontier models

DevFeed: [Mistral AI partners with NVIDIA to accelerate open frontier models](<https://devfeed.tech/articles/mistral-ai-partners-with-nvidia-to-accelerate-open-frontier-models-7044.md>)

Original publisher: [Read original article](<https://mistral.ai/news/mistral-ai-and-nvidia-partner-to-accelerate-open-frontier-models/>)

Published: 2026-03-16T20:00:00Z

Content type: news

Language: en

Sources: [Mistral AI Blog](<https://devfeed.tech/sources/mistral-ai-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [DGX Cloud](<https://devfeed.tech/topics/dgx-cloud.md>), [Synthetic Data Generation](<https://devfeed.tech/topics/synthetic-data-generation.md>), [model architecture](<https://devfeed.tech/topics/model-architecture.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [dgx-cloud](<https://devfeed.tech/tags/dgx-cloud.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [models](<https://devfeed.tech/tags/models.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open](<https://devfeed.tech/tags/open.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [post-training](<https://devfeed.tech/tags/post-training.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [synthetic-data-generation](<https://devfeed.tech/tags/synthetic-data-generation.md>)

### AI overview

Mistral AI announces a partnership with NVIDIA and its founding membership in the NVIDIA Nemotron Coalition. The collaboration will develop open frontier AI models using Mistral AI's model expertise and NVIDIA's compute, development tools, and synthetic-data pipelines. The coalition's first initiative will support the NVIDIA Nemotron 4 family, while Mistral AI also releases Mistral Small 4 for developers, researchers, and organizations.

### Source excerpt

The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.

## The Open Evaluation Standard: Benchmarking NVIDIA Nemotron 3 Nano with NeMo Evaluator

DevFeed: [The Open Evaluation Standard: Benchmarking NVIDIA Nemotron 3 Nano with NeMo Evaluator](<https://devfeed.tech/articles/the-open-evaluation-standard-benchmarking-nvidia-nemotron-3-nano-with-nemo-evaluator-7393.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nvidia/nemotron-3-nano-evaluation-recipe>)

Author: Seph Mard; Isabel Hulseman; Besmira Nushi; Piotr Januszewski; Grzegorz Chlebus; VivienneZhang; Wojciech Prazuch; Pablo Ribalta; Nik Spirin; Ferenc Galko

Published: 2025-12-17T13:22:18Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [configuration](<https://devfeed.tech/topics/configuration.md>), [Library](<https://devfeed.tech/topics/library.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [build](<https://devfeed.tech/tags/build.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [inference](<https://devfeed.tech/tags/inference.md>), [library](<https://devfeed.tech/tags/library.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open](<https://devfeed.tech/tags/open.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [reuse](<https://devfeed.tech/tags/reuse.md>), [validation](<https://devfeed.tech/tags/validation.md>), [verify](<https://devfeed.tech/tags/verify.md>)

### AI overview

This article presents an open, reproducible evaluation recipe for NVIDIA Nemotron 3 Nano 30B A3B using the NeMo Evaluator library. It explains how complete configurations, prompts, runtime settings, harness versions, logs, and artifacts enable independent verification and consistent model comparisons across inference backends and infrastructure.

### Source excerpt

NVIDIA released Nemotron 3 Nano 30B A3B with an explicitly open evaluation approach to make that distinction clear. Alongside the model card, we are publishing the complete evaluation recipe used to generate the results, built with the NVIDIA NeMo Evaluator library, so anyone can rerun the evaluation pipeline, inspect the artifacts, and analyze the outcomes independently. We believe that open innovation is the foundation of AI progress.

## Nemotron-Personas-India: Synthesized Data for Sovereign AI

DevFeed: [Nemotron-Personas-India: Synthesized Data for Sovereign AI](<https://devfeed.tech/articles/nemotron-personas-india-synthesized-data-for-sovereign-ai-7397.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nvidia/nemotron-personas-india>)

Author: Kiran Praveen; Utkarsh Vaidya; Evan A; Lipika Ramaswamy; Dhruv Nathawani; Dane Corneil; Yev Meyer

Published: 2025-10-13T23:00:42Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Synthetic Data Generation](<https://devfeed.tech/topics/synthetic-data-generation.md>), [synthetic-data](<https://devfeed.tech/topics/synthetic-data.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Sovereign AI](<https://devfeed.tech/topics/sovereign-ai.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [LLMs](<https://devfeed.tech/topics/llms.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-adoption](<https://devfeed.tech/tags/ai-adoption.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [generation](<https://devfeed.tech/tags/generation.md>), [india](<https://devfeed.tech/tags/india.md>), [language](<https://devfeed.tech/tags/language.md>), [llms](<https://devfeed.tech/tags/llms.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [synthetic-data](<https://devfeed.tech/tags/synthetic-data.md>), [synthetic-data-generation](<https://devfeed.tech/tags/synthetic-data-generation.md>)

### AI overview

NVIDIA releases Nemotron-Personas-India, an open synthetic dataset of Indic personas designed to address the lack of multilingual and culturally representative data for Indian AI systems. Built with NeMo Data Designer and licensed under CC BY 4.0, it contains 21 million personas across English and Hindi in Devanagari and Latin scripts, with demographic, geographic, occupational, and cultural attributes.

### Source excerpt

India represents one of the world's largest AI opportunities -- with over 700 million internet users, a multitude of languages, and a rapidly growing developer ecosystem. Yet, most open datasets reflect Western norms and English-only contexts, creating a data gap that limits AI adoption in India's multilingual, multi-script environment.

## Nemotron-Personas-Japan: ソブリン AI のための合成データセット

DevFeed: [Nemotron-Personas-Japan: ソブリン AI のための合成データセット](<https://devfeed.tech/articles/nemotron-personas-japan-ai-7398.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nvidia/nemotron-personas-japan-ja>)

Author: Atsunori Fujita; Masaya Ogushi; Vincent Gong; Kotaro Yamamoto; Yoshi Suhara; Dane Corneil; Yev Meyer

Published: 2025-09-26T06:25:50Z

Content type: article

Language: ja

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [datasets](<https://devfeed.tech/topics/datasets.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [data](<https://devfeed.tech/topics/data.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [gpt-oss](<https://devfeed.tech/topics/gpt-oss.md>), [pii](<https://devfeed.tech/topics/pii.md>), [Pydantic](<https://devfeed.tech/topics/pydantic.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [apache](<https://devfeed.tech/tags/apache.md>), [data](<https://devfeed.tech/tags/data.md>), [gpt-oss](<https://devfeed.tech/tags/gpt-oss.md>), [japan](<https://devfeed.tech/tags/japan.md>), [llm](<https://devfeed.tech/tags/llm.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [oss](<https://devfeed.tech/tags/oss.md>), [pii](<https://devfeed.tech/tags/pii.md>)

### AI overview

NVIDIA has released Nemotron-Personas-Japan, an open synthetic dataset of Japanese personas designed to support culturally grounded and privacy-preserving AI development. Built with NeMo Data Designer, it contains six million Japanese-language personas aligned with Japanese demographic, geographic, cultural, and labor statistics, without including personally identifiable information.

### Source excerpt

高品質で多様なトレーニングデータなしに、日本文化を真に理解するAIを構築することはこれまでほぼ不可能でした。これを変えるため、NVIDIAは、日本の人口統計、地理的分布、文化的特性に沿ったペルソナを含む初のオープン合成データセット、Nemotron-Personas-Japan を公開しました。CC BY 4.0 ライセンスのもと提供される本データセットは、機微な個人データに依存することなく日本社会を反映した AI システム構築のための、プライバシー保護と規制対応を両立した基盤を提供します。 NVIDIA のエンタープライズ向け合成データ生成システム、NeMo Data Designer を用いて作成されたNemotron-Personas-Japan は、すでに広く利用されている US Personas データセットの成功を機に日本版として開発されました。本リリースは、各国・地域におけるソブリン AI 開発を支援する合成ペルソナデータセットとデータ構築方法のグローバルコレクションの第一弾です。

## Welcome the NVIDIA Llama Nemotron Nano VLM to Hugging Face Hub

DevFeed: [Welcome the NVIDIA Llama Nemotron Nano VLM to Hugging Face Hub](<https://devfeed.tech/articles/welcome-the-nvidia-llama-nemotron-nano-vlm-to-hugging-face-hub-7384.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nvidia/llama-nemotron-nano-vl>)

Author: Amanda Saunders; Amala Sanjay Deshmukh; Kateryna Chumachenko; Annie Surla; Karan; Tuomas Rintamaki; Matthieu Le; Yu Yao; Chen Cui; Timo Roman; Zhiding Yu; Mike Ranzinger

Published: 2025-06-27T21:09:27Z

Content type: release

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [vlm](<https://devfeed.tech/topics/vlm.md>), [llama](<https://devfeed.tech/topics/llama.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [datasets](<https://devfeed.tech/topics/datasets.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [idp](<https://devfeed.tech/tags/idp.md>), [llama](<https://devfeed.tech/tags/llama.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [ocr](<https://devfeed.tech/tags/ocr.md>), [performance](<https://devfeed.tech/tags/performance.md>), [recognition](<https://devfeed.tech/tags/recognition.md>), [train](<https://devfeed.tech/tags/train.md>), [use-cases](<https://devfeed.tech/tags/use-cases.md>), [vision](<https://devfeed.tech/tags/vision.md>), [vlm](<https://devfeed.tech/tags/vlm.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

NVIDIA Llama Nemotron Nano VL is an 8B vision-language model for intelligent document processing. Available on Hugging Face, it extracts and interprets text, tables, charts, diagrams, and other information from complex documents.

### Source excerpt

NVIDIA Llama Nemotron Nano VL is a state-of-the-art 8B Vision Language Model (VLM) designed for intelligent document processing, offering high accuracy and multimodal understanding. Available on Hugging Face, it excels in extracting and understanding information from complex documents like invoices, receipts, contracts, and more.

## AI in abundance

DevFeed: [AI in abundance](<https://devfeed.tech/articles/ai-in-abundance-7120.md>)

Original publisher: [Read original article](<https://mistral.ai/news/september-24-release/>)

Published: 2024-09-17T03:00:00Z

Content type: release

Language: en

Sources: [Mistral AI Blog](<https://devfeed.tech/sources/mistral-ai-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Platform](<https://devfeed.tech/topics/ai-platform.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [API](<https://devfeed.tech/topics/api.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Frontier Model](<https://devfeed.tech/topics/frontier-model.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [api](<https://devfeed.tech/tags/api.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [frontier-model](<https://devfeed.tech/tags/frontier-model.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [platform](<https://devfeed.tech/tags/platform.md>), [pricing](<https://devfeed.tech/tags/pricing.md>), [prototyping](<https://devfeed.tech/tags/prototyping.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [vision](<https://devfeed.tech/tags/vision.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

Mistral announces a free tier for La Plateforme, broad price reductions, an updated Mistral Small v24.09 model, and free vision capabilities on le Chat with Pixtral 12B. The platform supports tuning and deploying Mistral models as API endpoints, while the updated model targets tasks such as translation, summarization, sentiment analysis, and code-related use cases.

### Source excerpt

The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.

## Announcing Pixtral 12B

DevFeed: [Announcing Pixtral 12B](<https://devfeed.tech/articles/announcing-pixtral-12b-7105.md>)

Original publisher: [Read original article](<https://mistral.ai/news/pixtral-12b/>)

Published: 2024-09-17T02:00:00Z

Content type: news

Language: en

Sources: [Mistral AI Blog](<https://devfeed.tech/sources/mistral-ai-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [coding](<https://devfeed.tech/topics/coding.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [apache](<https://devfeed.tech/tags/apache.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [claude](<https://devfeed.tech/tags/claude.md>), [coding](<https://devfeed.tech/tags/coding.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [long-context](<https://devfeed.tech/tags/long-context.md>), [math](<https://devfeed.tech/tags/math.md>), [models](<https://devfeed.tech/tags/models.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [performance](<https://devfeed.tech/tags/performance.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

Mistral AI announces Pixtral 12B, an open-source multimodal model trained on interleaved image and text data. It combines a new 400M-parameter vision encoder with a 12B-parameter decoder based on Mistral Nemo, supports variable image sizes and multiple images in a 128K-token context window, and is released under the Apache 2.0 license. The article reports strong multimodal reasoning and instruction-following performance while maintaining text, coding, and math capabilities.

### Source excerpt

Pixtral 12B is deprecated. Discover Mistral AI's latest vision models and capabilities in our updated documentation.

## We're Cutting L40S Prices In Half

DevFeed: [We're Cutting L40S Prices In Half](<https://devfeed.tech/articles/we-re-cutting-l40s-prices-in-half-1693.md>)

Original publisher: [Read original article](<https://fly.io/blog/cutting-prices-for-l40s-gpus-in-half/>)

Published: 2024-08-15T00:00:00Z

Content type: news

Language: en

Sources: [The Fly Blog](<https://devfeed.tech/sources/the-fly-blog.md>)

Topics: [fly.io](<https://devfeed.tech/topics/fly-io.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [fly](<https://devfeed.tech/topics/fly.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [NeMo](<https://devfeed.tech/topics/nemo.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [stable-diffusion](<https://devfeed.tech/topics/stable-diffusion.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [cdn](<https://devfeed.tech/tags/cdn.md>), [close-to-users](<https://devfeed.tech/tags/close-to-users.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [deploy-app-servers](<https://devfeed.tech/tags/deploy-app-servers.md>), [docker](<https://devfeed.tech/tags/docker.md>), [elixir](<https://devfeed.tech/tags/elixir.md>), [fly](<https://devfeed.tech/tags/fly.md>), [fly-io](<https://devfeed.tech/tags/fly-io.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [heroku-alternative](<https://devfeed.tech/tags/heroku-alternative.md>), [heroku-competitor](<https://devfeed.tech/tags/heroku-competitor.md>), [hosting](<https://devfeed.tech/tags/hosting.md>), [i](<https://devfeed.tech/tags/i.md>), [inference](<https://devfeed.tech/tags/inference.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [networking](<https://devfeed.tech/tags/networking.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [postgresql-clusters](<https://devfeed.tech/tags/postgresql-clusters.md>), [servers](<https://devfeed.tech/tags/servers.md>), [stable-diffusion](<https://devfeed.tech/tags/stable-diffusion.md>)

### AI overview

Fly.io announces that it has cut the price of NVIDIA L40S GPUs to $1.25 per hour. The article explains that customers most often choose the less powerful A10 for inference and mid-sized generative AI workloads such as Mistral Nemo and Stable Diffusion, while Fly.io's earlier GPU strategy focused on more demanding ideas involving A100 partitioning, NVLink clusters, and training.

### Source excerpt

We're Fly.io, a new public cloud with simple, developer-friendly ergonomics. And as of today, cheaper GPUs. Try it out; you'll be deployed in just minutes. We just lowered the prices on NVIDIA L40s GPUs to $1.25 per hour. Why? Because our feet are cold and we burn processor cycles for heat. But also other reasons. Let's back up. We offer 4 different NVIDIA GPU models; in increasing order of performance, they're the A10, the L40S, the 40G PCI A100, and the 80G SXM A100. Guess which one is most popular. We guessed wrong, and spent a lot of time working out how to maximize the amount of GPU power we could deliver to a single Fly Machine. Users surprised us. By a wide margin, the most popular GPU in our inventory is the A10. The A10 is an older generation of NVIDIA GPU with fewer, slower cores and less memory. It's the least capable GPU we offer. But that doesn't matter, because it's capable enough. It's solid for random inference tasks, and handles mid-sized generative AI stuff like Mistral Nemo or Stable Diffusion. For those workloads, there's not that much benefit in getting a beefier GPU. As a result, we can't get new A10s in fast enough for our users. If there's one thing we've learned by talking to our customers over the last 4 years, it's that y'all love a peek behind the curtain. So we're going to let you in on a little secret about how a hardware provider like Fly.io formulates GPU strategy: none of us know what the hell we're doing. If you had asked us in 2023 what the biggest GPU problem we could solve was, we'd have said "selling fractional A100 slices". We burned a whole quarter trying to get MIG, or at least vGPUs, working through IOMMU PCI passthrough on Fly Machines, in a project so cursed that Thomas has forsworn ever programming again. Then we went to market selling whole A100s, and for several more months it looked like the biggest problem we needed to solve was finding a secure way to expose NVLink-ganged A100 clusters to VMs so users could run train

## Mistral NeMo

DevFeed: [Mistral NeMo](<https://devfeed.tech/articles/mistral-nemo-7068.md>)

Original publisher: [Read original article](<https://mistral.ai/news/mistral-nemo/>)

Published: 2024-07-18T08:00:00Z

Content type: release

Language: en

Sources: [Mistral AI Blog](<https://devfeed.tech/sources/mistral-ai-blog.md>)

Topics: [NeMo](<https://devfeed.tech/topics/nemo.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [long-context](<https://devfeed.tech/topics/long-context.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [compression](<https://devfeed.tech/tags/compression.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [function-calling](<https://devfeed.tech/tags/function-calling.md>), [models](<https://devfeed.tech/tags/models.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

Mistral NeMo is a 12B multilingual model developed with NVIDIA, offering a 128k-token context window, strong reasoning and coding performance, function calling, and Apache 2.0 licensing. The release highlights its efficient Tekken tokenizer, FP8 inference, instruction fine-tuning, and comparisons with Gemma 2 9B and Llama 3 8B.

### Source excerpt

The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.