# MLOps

Published articles for MLOps.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine

DevFeed: [Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine](<https://devfeed.tech/articles/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine-21079.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/accelerating-dropless-moe-training-in-jax-with-nvidia-transformer-engine/>)

Author: Tanya Lenz

Published: 2026-09-14T16:39:15Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [Network](<https://devfeed.tech/topics/network.md>), [Python](<https://devfeed.tech/topics/python.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>), [mixtral](<https://devfeed.tech/topics/mixtral.md>), [qwen](<https://devfeed.tech/topics/qwen.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [communication](<https://devfeed.tech/tags/communication.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [mixtral](<https://devfeed.tech/tags/mixtral.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [moe](<https://devfeed.tech/tags/moe.md>), [networks](<https://devfeed.tech/tags/networks.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [performance](<https://devfeed.tech/tags/performance.md>), [python](<https://devfeed.tech/tags/python.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tensors](<https://devfeed.tech/tags/tensors.md>), [token](<https://devfeed.tech/tags/token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [training-ai-models](<https://devfeed.tech/tags/training-ai-models.md>)

### AI overview

This article explains how NVIDIA Transformer Engine and JAX kernel optimizations accelerate dropless Mixture of Experts (MoE) training. It describes bottlenecks from token routing, expert dispatch and gathering, all-to-all communication, and ragged expert matrix operations. In DeepSeek-V3 training on NVIDIA GB200, the optimized approach increased performance from 103 to 1,068 TFLOPS per GPU, a 10.4x improvement.

### Source excerpt

Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE...

## Creating an AI Platform for classic ML online inference

DevFeed: [Creating an AI Platform for classic ML online inference](<https://devfeed.tech/articles/creating-an-ai-platform-for-classic-ml-online-inference-22589.md>)

Original publisher: [Read original article](<https://medium.com/amex-gbt-technology/creating-an-ai-platform-for-classic-ml-online-inference-e2165d68e18a?source=rss----60a0578f4096---4>)

Author: Rohith Leeladharan

Published: 2026-09-10T07:26:46Z

Content type: tutorial

Language: en

Sources: [Amex GBT Technology](<https://devfeed.tech/sources/amex-gbt-technology.md>)

Topics: [AI Platform](<https://devfeed.tech/topics/ai-platform.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-platform](<https://devfeed.tech/tags/ai-platform.md>), [ai-platform-engineering](<https://devfeed.tech/tags/ai-platform-engineering.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [feature-store](<https://devfeed.tech/tags/feature-store.md>), [inference](<https://devfeed.tech/tags/inference.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [ml](<https://devfeed.tech/tags/ml.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [predictions](<https://devfeed.tech/tags/predictions.md>)

### AI overview

This article describes how American Express Global Business Travel built an AI platform for deploying classic machine-learning systems and supporting online inference. It explains the platform's requirements--simplicity, self-service, experimentation, and continuous improvement--and details the pre-process, predict, post-process pattern used by inference engines.

### Source excerpt

Introduction In 2021, we were given the mission to have AI Systems running in production. The team, instead of just following a classical MLOps process, that involves transforming a Jupyter notebook into a product running in production, decided to go further by creating a platform to deploy AI systems in production. The team decided the platform should respect these requirements: Simplicity: The code powering AI systems should be simple, readable, and easy to maintain -- less intricacy means fewer bugs in production and greater reliability. Self-service: Anyone should be able to build and deploy AI systems autonomously, without depending on a central team. Experimentation: The platform should make it easy to run and iterate on experiments. Continuous improvement: Data related to events and interactions within AI systems must be captured, enabling monitoring and continuous improvement over time. In this article, we will walk through the work done to build a platform that fulfills these four requirements. Background At American Express Global Business Travel, we use machine learning (ML) models for a variety of user experiences like ranking hotel and flight search results. Our ML models are wrapped in inference engines that handle both pre-processing of input data before we run a prediction with the model, and post-processing of output data before returning the output to the caller. The overall flow looks something like this: Figure 1: Handling an inference request A client service that would like the ML model's predictions provides necessary context about the request like which user the request is for. Then, optionally, the inference engine fetches any necessary features for inference from our feature store [part 1][part 2]. Finally, it pre-processes the data, runs the predictions using the trained ML model, and does any necessary post-processing of the model output before returning the response to the caller. We call this the pre-process, predict, post-process patter

## ASUS Lays Out a Full AI Factory Platform: Vera Rubin NVL72 Racks, STX Storage, and a Governance Layer

DevFeed: [ASUS Lays Out a Full AI Factory Platform: Vera Rubin NVL72 Racks, STX Storage, and a Governance Layer](<https://devfeed.tech/articles/asus-lays-out-a-full-ai-factory-platform-vera-rubin-nvl72-racks-stx-storage-and-a-governance-layer-12358.md>)

Original publisher: [Read original article](<https://www.storagereview.com/news/asus-lays-out-a-full-ai-factory-platform-vera-rubin-nvl72-racks-stx-storage-and-a-governance-layer>)

Author: Lyle Smith

Published: 2026-09-04T17:54:45Z

Content type: article

Language: en

Sources: [StorageReview.com](<https://devfeed.tech/sources/storagereview-com.md>)

Topics: [AI Factory](<https://devfeed.tech/topics/ai-factory.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AI Platform](<https://devfeed.tech/topics/ai-platform.md>), [NVIDIA Vera Rubin](<https://devfeed.tech/topics/nvidia-vera-rubin.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [NVIDIA Vera](<https://devfeed.tech/topics/nvidia-vera.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [NVIDIA DSX](<https://devfeed.tech/topics/nvidia-dsx.md>), [ai-governance](<https://devfeed.tech/topics/ai-governance.md>), [Server](<https://devfeed.tech/topics/server.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-governance](<https://devfeed.tech/tags/ai-governance.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [asus](<https://devfeed.tech/tags/asus.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [nvidia-dsx](<https://devfeed.tech/tags/nvidia-dsx.md>), [nvidia-vera](<https://devfeed.tech/tags/nvidia-vera.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [platform](<https://devfeed.tech/tags/platform.md>), [storage](<https://devfeed.tech/tags/storage.md>), [vera-rubin-nvl72](<https://devfeed.tech/tags/vera-rubin-nvl72.md>)

### AI overview

ASUS is broadening its AI infrastructure business from individual servers to a full AI factory platform covering accelerated computing, networking, storage, deployment, infrastructure management, MLOps, and governance. The article describes NVIDIA DSX-based planning, ASUS deployment and management tools, governance for AI services and autonomous agents, and server systems based on NVIDIA Vera Rubin hardware.

### Source excerpt

ASUS is expanding its role in AI infrastructure, moving from individual AI servers to platforms for building, deploying, and operating entire AI factories. At AI Tech 2026 in Seoul, the company laid out a broader strategy that brings accelerated computing, networking, storage, deployment software, infrastructure management, and AI governance together under one platform. That puts The post ASUS Lays Out a Full AI Factory Platform: Vera Rubin NVL72 Racks, STX Storage, and a Governance Layer appeared first on StorageReview.com.

## How to Size GPUs for AI Inference and TCO Without Overspending

DevFeed: [How to Size GPUs for AI Inference and TCO Without Overspending](<https://devfeed.tech/articles/how-to-size-gpus-for-ai-inference-and-tco-without-overspending-6859.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-to-size-gpus-for-ai-inference-and-tco-without-overspending/>)

Author: Elizabeth Goodman

Published: 2026-09-01T15:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [quantization](<https://devfeed.tech/tags/quantization.md>)

### AI overview

A practical guide to sizing GPU infrastructure for AI inference workloads while balancing latency, concurrency, model choice, deployment strategy, and total cost of ownership.

### Source excerpt

The surge in AI adoption is transforming everything from chatbots to content generation. Still, a common pain point remains: How can organizations confidently...

## Using ArgoCD to Manage AI Model Deployments with GitOps

DevFeed: [Using ArgoCD to Manage AI Model Deployments with GitOps](<https://devfeed.tech/articles/using-argocd-to-manage-ai-model-deployments-with-gitops-17479.md>)

Original publisher: [Read original article](<https://kodekloud.com/blog/argocd-gitops-ai-model-deployments/>)

Author: Pramodh Kumar M

Published: 2026-07-28T18:24:57Z

Content type: tutorial

Language: en

Sources: [Kubernetes - KodeKloud Blog | DevOps, Cloud, Kubernetes, AI Tutorials & More](<https://devfeed.tech/sources/kubernetes-kodekloud-blog-devops-cloud-kubernetes-ai-tutorials-more.md>)

Topics: [GitOps](<https://devfeed.tech/topics/gitops.md>), [argocd](<https://devfeed.tech/topics/argocd.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [Architecture & Design](<https://devfeed.tech/topics/architecture-design.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [argo-rollouts-model-promotion](<https://devfeed.tech/tags/argo-rollouts-model-promotion.md>), [argocd](<https://devfeed.tech/tags/argocd.md>), [argocd-ai-model-deployment](<https://devfeed.tech/tags/argocd-ai-model-deployment.md>), [argocd-applicationset](<https://devfeed.tech/tags/argocd-applicationset.md>), [argocd-sync-waves](<https://devfeed.tech/tags/argocd-sync-waves.md>), [automation](<https://devfeed.tech/tags/automation.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [declarative-model-serving](<https://devfeed.tech/tags/declarative-model-serving.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [devops](<https://devfeed.tech/tags/devops.md>), [gitops](<https://devfeed.tech/tags/gitops.md>), [gitops-for-ai-model-deployments](<https://devfeed.tech/tags/gitops-for-ai-model-deployments.md>), [gitops-mlops](<https://devfeed.tech/tags/gitops-mlops.md>), [kserve](<https://devfeed.tech/tags/kserve.md>), [kserve-canary-deployment](<https://devfeed.tech/tags/kserve-canary-deployment.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [kubernetes-model-deployment-rollback](<https://devfeed.tech/tags/kubernetes-model-deployment-rollback.md>), [ml-model-deployment](<https://devfeed.tech/tags/ml-model-deployment.md>), [ml-model-versioning](<https://devfeed.tech/tags/ml-model-versioning.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [model-deployment](<https://devfeed.tech/tags/model-deployment.md>), [model-registry-to-git-automation](<https://devfeed.tech/tags/model-registry-to-git-automation.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>), [pull-requests](<https://devfeed.tech/tags/pull-requests.md>), [standard](<https://devfeed.tech/tags/standard.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>)

### AI overview

This tutorial explains how to use ArgoCD and GitOps to deploy AI models while accounting for model weights stored outside container images. It covers pinned model references, rollback and recovery, synchronization ordering, readiness probes, evaluation-based promotion gates, and KServe status handling.

### Source excerpt

Your microservices deploy through pull requests with full audit trails. Your models deploy because someone ran a script. Here is how to close that gap with ArgoCD, and what changes when the artifact weighs four gigabytes.

## Инференс LLM: от KV-кэша до продакшен-деплоя

DevFeed: [Инференс LLM: от KV-кэша до продакшен-деплоя](<https://devfeed.tech/articles/llm-kv-30672.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/hh/articles/1062318/>)

Author: a\_ryzhov (hh.ru, Конференции Олега Бунина (Онтико))

Published: 2026-07-27T05:30:45Z

Content type: tutorial

Language: ru

Sources: [HeadHunter RU](<https://devfeed.tech/sources/headhunter-ru.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [on-prem](<https://devfeed.tech/topics/on-prem.md>), [genai](<https://devfeed.tech/topics/genai.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [sglang](<https://devfeed.tech/topics/sglang.md>), [vllm](<https://devfeed.tech/topics/vllm.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [compute](<https://devfeed.tech/tags/compute.md>), [genai](<https://devfeed.tech/tags/genai.md>), [http](<https://devfeed.tech/tags/http.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kv-cache](<https://devfeed.tech/tags/kv-cache.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [on-prem](<https://devfeed.tech/tags/on-prem.md>), [sglang](<https://devfeed.tech/tags/sglang.md>), [sram](<https://devfeed.tech/tags/sram.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

This Russian-language developer article explains how LLM inference behaves in on-premises production environments in 2026. It argues that GPU memory management is the main efficiency constraint, describes how KV caching shifts decoding from compute-bound to memory-bandwidth-bound work, and introduces vLLM and SGLang as ways to address the problem.

### Source excerpt

Привет! Я Саша Рыжов, MLOps-инженер в hh.ru, уже три года занимаюсь развитием инфраструктуры для искусственного интеллекта. Компании, которые развивают GenAI, рано или поздно приходят к задачам по запуску LLM на собственном железе. В статье я расскажу, как обстоят дела с движками инференса в 2026 году и как запустить on-prem-прод и не изобрести при этом велосипед. Читать далее

## KubeCon + CloudNativeCon India 2026: Our Kubeflow Community Experience

DevFeed: [KubeCon + CloudNativeCon India 2026: Our Kubeflow Community Experience](<https://devfeed.tech/articles/kubecon-cloudnativecon-india-2026-our-kubeflow-community-experience-17608.md>)

Original publisher: [Read original article](<https://blog.kubeflow.org/kubecon/community/2026/07/27/kubecon-2026-india-kubeflow.html>)

Author: Khushi Agrawal

Published: 2026-07-27T05:00:00Z

Content type: article

Language: en

Sources: [Kubeflow](<https://devfeed.tech/sources/kubeflow.md>)

Topics: [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [distributed-training](<https://devfeed.tech/topics/distributed-training.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [ai](<https://devfeed.tech/tags/ai.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [community](<https://devfeed.tech/tags/community.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [india](<https://devfeed.tech/tags/india.md>), [kubecon](<https://devfeed.tech/tags/kubecon.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [llms](<https://devfeed.tech/tags/llms.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>), [model-training](<https://devfeed.tech/tags/model-training.md>), [rag](<https://devfeed.tech/tags/rag.md>)

### AI overview

A Kubeflow community recap of KubeCon + CloudNativeCon India 2026 in Mumbai. It describes Kubeflow's presence at the CNCF Project Pavilion, common architecture questions, featured talks, booth discussions about production machine learning workflows, distributed training, model serving, GPU resource allocation, LLMs, and RAG pipelines, and efforts to onboard contributors.

### Source excerpt

Introduction

## Announcing the State of Platform Engineering Report Vol 4

DevFeed: [Announcing the State of Platform Engineering Report Vol 4](<https://devfeed.tech/articles/announcing-the-state-of-platform-engineering-report-vol-4-12133.md>)

Original publisher: [Read original article](<https://platformengineering.org/blog/announcing-the-state-of-platform-engineering-vol-4>)

Author: Sam Barlien

Published: 2026-07-23T05:40:01Z

Content type: article

Language: en

Sources: [Platform Engineering Blog](<https://devfeed.tech/sources/platform-engineering-blog.md>)

Topics: [Platform Engineering](<https://devfeed.tech/topics/platform-engineering.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [supply-chain-security](<https://devfeed.tech/topics/supply-chain-security.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [finops](<https://devfeed.tech/topics/finops.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [platform](<https://devfeed.tech/tags/platform.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>), [platforms](<https://devfeed.tech/tags/platforms.md>), [report](<https://devfeed.tech/tags/report.md>), [scale](<https://devfeed.tech/tags/scale.md>), [software-supply-chain](<https://devfeed.tech/tags/software-supply-chain.md>), [speed](<https://devfeed.tech/tags/speed.md>)

### AI overview

The State of Platform Engineering Report Volume 4 presents platform engineering as a foundational discipline for modern enterprises. Based on insights from 518 engineers, it describes a shift from the cloud-native era to an AI-native era, emphasizing "shifting down," AI-powered platforms, platforms for AI, specialized GPU infrastructure, governance, and MLOps requirements.

### Source excerpt

Insights from over 500 engineers. Explore the shift to 'AI-native,' the 'dual mandate,' 'shifting down,' and key trends for 2026.

## AI Engineer vs. Platform Engineer: Differences in AI Roles

DevFeed: [AI Engineer vs. Platform Engineer: Differences in AI Roles](<https://devfeed.tech/articles/ai-engineer-or-platform-engineer-nobody-explains-this-confusing-new-job-title-problem-2026-guide-22849.md>)

Original publisher: [Read original article](<https://medium.com/google-developer-experts/ai-engineer-or-platform-engineer-nobody-explains-this-confusing-new-job-title-problem-2026-guide-484a010b2cea?source=rss----a67bd6fa7d58---4>)

Author: Geeta Kakrani

Published: 2026-07-22T00:21:05Z

Content type: comparison

Language: en

Sources: [Google Developer Experts - Medium](<https://devfeed.tech/sources/google-developer-experts-medium.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Platform](<https://devfeed.tech/topics/ai-platform.md>), [Prompt Engineering](<https://devfeed.tech/topics/prompt-engineering.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>)

Tags: [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-engineer](<https://devfeed.tech/tags/ai-engineer.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [career](<https://devfeed.tech/tags/career.md>), [generative-ai-tools](<https://devfeed.tech/tags/generative-ai-tools.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [platform](<https://devfeed.tech/tags/platform.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>)

### AI overview

The article compares AI Engineer and Platform Engineer roles amid overlapping job titles. It describes AI Engineers as working on model choice, prompts, and agent behavior, while Platform Engineers focus on the infrastructure and operations needed to run AI systems.

### Source excerpt

By Geeta Kakrani (GDE in AI & TPU) Open any job board right now and search "AI." Within a few listings, you'll notice something odd: the roles don't line up. Two postings with almost identical requirements have completely different titles. One company's "AI Engineer" is another company's "AI Platform Engineer" is a third company's "MLOps Engineer." This isn't a small naming quirk. For anyone trying to plan a career -- or even just understand where they fit -- it's a real, growing source of confusion. Not because AI itself is hard to understand, but because nobody clearly explains who is responsible for what anymore. The job title problem nobody talks about You'll find titles like: AI Engineer AI Platform Engineer AI Infrastructure Engineer MLOps Engineer LLM Platform Engineer Applied AI Engineer These titles overlap heavily. They pay in similar ranges. They list nearly identical skills. And most of them didn't exist as separate roles even three years ago. This isn't because companies are confused. It's because the industry is still figuring out what to call a very real, very new job -- one that sits between two older disciplines that used to be completely separate. If you're a student or early-career professional trying to plan your path, this title chaos makes it genuinely hard to know what to learn, what to apply for, and what a company actually expects from you on day one. So what's the actual difference? Strip away the job titles, and there are really two different jobs hiding underneath the AI buzzword. The AI Engineer works on the intelligence itself. Choosing which model to use. Designing prompts and instructions. Deciding how an agent should behave, what it should refuse to do, when it should use a tool versus answer directly. This is the "thinking" layer. The Platform Engineer works on everything that lets that intelligence actually run in the real world. Servers, deployment, scaling, security, monitoring, cost control. This is the layer most people never see

## Laguna S 2.1 is now available on AI Gateway

DevFeed: [Laguna S 2.1 is now available on AI Gateway](<https://devfeed.tech/articles/laguna-s-2-1-is-now-available-on-ai-gateway-995.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/laguna-s-2-1-is-now-available-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-07-21T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [AI Models](<https://devfeed.tech/topics/ai-models.md>), [agentic-coding](<https://devfeed.tech/topics/agentic-coding.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [API](<https://devfeed.tech/topics/api.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [AI Research](<https://devfeed.tech/topics/ai-research.md>), [API keys](<https://devfeed.tech/topics/api-keys.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>)

Tags: [agentic-coding](<https://devfeed.tech/tags/agentic-coding.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [ai-research](<https://devfeed.tech/tags/ai-research.md>), [api-keys](<https://devfeed.tech/tags/api-keys.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cost](<https://devfeed.tech/tags/cost.md>), [mixture-of-experts](<https://devfeed.tech/tags/mixture-of-experts.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [routing](<https://devfeed.tech/tags/routing.md>), [sdk](<https://devfeed.tech/tags/sdk.md>), [support](<https://devfeed.tech/tags/support.md>)

### AI overview

Poolside's Laguna S 2.1 is now available through Vercel AI Gateway in free and paid versions, with context windows of 256K and 1M tokens. The open-weight Mixture-of-Experts model supports thinking and no-thinking modes and is designed for agentic coding, long-running tasks, browser tooling, MLOps pipelines, and AI research.

### Source excerpt

Laguna S 2.1 from Poolside is now available on AI Gateway. There are 2 versions of the model available: Free version (256K context window): poolside/laguna-s-2.1-free Paid version (1M context window): poolside/laguna-s-2.1 Laguna S 2.1 is an open-weight Mixture-of-Experts model that supports a context window of up to 1M tokens and runs in thinking and no-thinking modes. The model specializes in agentic coding and long-running tasks, including writing and debugging code, running tests, building browser-based tooling, and working on MLOps pipelines and AI research. In thinking mode, Laguna S 2.1 reports 70.2% on Terminal-Bench 2.1, 78.5% on SWE-bench Multilingual, and 59.4% on SWE-Bench Pro. To use Laguna S 2.1, set model to poolside/laguna-s-2.1-free or poolside/laguna-s-2.1 in the AI SDK: AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. Try Laguna S 2.1 in the model playground. Read more

## Как оптимизировать инференс LLM: кеширование, время ответа и GPU-ресурсы

DevFeed: [Как оптимизировать инференс LLM: кеширование, время ответа и GPU-ресурсы](<https://devfeed.tech/articles/llm-gpu-24867.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/yandex/articles/1056694/>)

Author: hotckisss (Яндекс, Yandex Cloud & Yandex Infrastructure)

Published: 2026-07-08T07:04:08Z

Content type: tutorial

Language: ru

Sources: [Яндекс - Как мы делаем Яндекс / Статьи](<https://devfeed.tech/sources/source.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Low-Latency Inference](<https://devfeed.tech/topics/low-latency-inference.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [ml](<https://devfeed.tech/tags/ml.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [tag-b92bf5906bbd](<https://devfeed.tech/tags/tag-b92bf5906bbd.md>), [time](<https://devfeed.tech/tags/time.md>), [token](<https://devfeed.tech/tags/token.md>)

### AI overview

This article explains how to optimize LLM inference in production under mixed workloads. It examines causes of increased Time to First Token, including scheduling, GPU memory allocation, streaming output queues, networking, long contexts, and KV-cache growth, and outlines optimizations such as separating prefill and decode, contextual parallelism, speculative decoding, cache-aware load balancing, and large-model delivery.

### Source excerpt

Вы запустили LLM-инференс в продакшене. Поток запросов не менялся, нагрузка та же, что вчера, -- а Time to First Token внезапно вырос в три раза. Первая мысль: что-то с моделью. На деле причина почти никогда не в модели -- она прячется в планировщике, аллокаторе GPU-памяти, очереди стримингового вывода или сети. Чем длиннее контекст, тем больнее. Для классического attention вычислительная сложность растёт очень быстро. KV-кеш раздувается до десятков и сотен гигабайт, а в облаке всё это происходит на совершенно произвольном трафике: у одного клиента кодовый ассистент, у другого -- аналитика на миллион запросов в день, у третьего -- голосовой робот. На таких смешанных нагрузках всплывает то, чего не видно на референсных замерах вендора. Читать далее

## Enhancing Goodput in Large-Scale LLM Training with Nonuniform Tensor Parallelism

DevFeed: [Enhancing Goodput in Large-Scale LLM Training with Nonuniform Tensor Parallelism](<https://devfeed.tech/articles/enhancing-goodput-in-large-scale-llm-training-with-nonuniform-tensor-parallelism-6815.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/enhancing-goodput-in-large-scale-llm-training-with-nonuniform-tensor-parallelism/>)

Author: Michelle Horton

Published: 2026-07-06T21:44:23Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [GPU](<https://devfeed.tech/topics/gpu.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [Availability](<https://devfeed.tech/topics/availability.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>), [Network](<https://devfeed.tech/topics/network.md>), [systems](<https://devfeed.tech/topics/systems.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [availability](<https://devfeed.tech/tags/availability.md>), [blackwell](<https://devfeed.tech/tags/blackwell.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-techniques](<https://devfeed.tech/tags/llm-techniques.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [network](<https://devfeed.tech/tags/network.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-blackwell](<https://devfeed.tech/tags/nvidia-blackwell.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [performance](<https://devfeed.tech/tags/performance.md>), [scale](<https://devfeed.tech/tags/scale.md>), [training](<https://devfeed.tech/tags/training.md>), [work](<https://devfeed.tech/tags/work.md>)

### AI overview

This article explains how Nonuniform Tensor Parallelism can improve Goodput in large-scale LLM training by adapting tensor parallelism to changing GPU availability and overlapping data resharding. The experimental approach aims to reduce interruptions, lost throughput, and computational waste in tightly interconnected GPU clusters.

### Source excerpt

Training LLMs at massive scale brings unique infrastructure challenges, especially as jobs span thousands of GPUs and run for extended periods. The longer these...

## How to Govern Autonomous Agents in Enterprise AI Factories

DevFeed: [How to Govern Autonomous Agents in Enterprise AI Factories](<https://devfeed.tech/articles/how-to-govern-autonomous-agents-in-enterprise-ai-factories-6851.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/how-to-govern-autonomous-agents-in-enterprise-ai-factories/>)

Author: Michelle Horton

Published: 2026-06-29T15:50:13Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Factory](<https://devfeed.tech/topics/ai-factory.md>), [systems](<https://devfeed.tech/topics/systems.md>), [vulnerability management](<https://devfeed.tech/topics/vulnerability-management.md>), [configuration](<https://devfeed.tech/topics/configuration.md>), [Network](<https://devfeed.tech/topics/network.md>), [SOC](<https://devfeed.tech/topics/soc.md>), [ide](<https://devfeed.tech/topics/ide.md>), [browser](<https://devfeed.tech/topics/browser.md>), [Terminal](<https://devfeed.tech/topics/terminal.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-agents](<https://devfeed.tech/tags/autonomous-agents.md>), [browser](<https://devfeed.tech/tags/browser.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [featured](<https://devfeed.tech/tags/featured.md>), [ide](<https://devfeed.tech/tags/ide.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [network](<https://devfeed.tech/tags/network.md>), [openshell](<https://devfeed.tech/tags/openshell.md>), [policy](<https://devfeed.tech/tags/policy.md>), [soc](<https://devfeed.tech/tags/soc.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>), [vulnerability-management](<https://devfeed.tech/tags/vulnerability-management.md>)

### AI overview

This tutorial presents NVIDIA's Secure Agent Workspace Reference Design for governing autonomous AI agents in enterprise environments. It explains how to separate the presentation layer from managed agent execution and enforce identity, network access, credentials, runtime policy, auditing, human review, and workspace isolation.

### Source excerpt

AI agents are quickly moving beyond chat. They inspect code, run tests, read documents, search knowledge bases, query internal systems, and operate for hours on...

## Best AI Infrastructure Tools in 2026

DevFeed: [Best AI Infrastructure Tools in 2026](<https://devfeed.tech/articles/best-ai-infrastructure-tools-in-2026-18987.md>)

Original publisher: [Read original article](<https://www.pulumi.com/blog/ai-infrastructure-tools/>)

Author: Alex Leventer

Published: 2026-05-25T00:00:00Z

Content type: article

Language: en

Sources: [Pulumi](<https://devfeed.tech/sources/pulumi.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [devops](<https://devfeed.tech/tags/devops.md>), [general](<https://devfeed.tech/tags/general.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [infrastructure-as-code](<https://devfeed.tech/tags/infrastructure-as-code.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>), [tools](<https://devfeed.tech/tags/tools.md>)

### AI overview

This guide distinguishes infrastructure for AI, including GPU clouds and MLOps platforms, from AI-powered infrastructure management. It surveys tools in both categories and highlights options such as CoreWeave, Modal, MLflow, Pulumi Neo, and other infrastructure agents and assistants.

### Source excerpt

"AI infrastructure tools" covers two distinct markets: infrastructure for AI (GPU clouds like CoreWeave, MLOps platforms like Weights & Biases) and AI for infrastructure (agentic platforms like Pulumi Neo that generate, deploy, and govern cloud resources for you). Most teams need tools from both categories, and picking the wrong one wastes budget and adoption goodwill. The pressure to get this right is real. McKinsey research puts the productivity lift from generative AI in software development at 20-45%, which is great for application teams and a problem for platform teams trying to keep up with the resulting feature flow. Infrastructure investment is climbing on both fronts: more spend on the compute that trains and serves models, more spend on AI tools that manage everything else. This guide covers both categories: the compute and MLOps stack in Part 1, and AI-powered infrastructure management in Part 2, where the more interesting product shift is happening. AI infrastructure tools overview Tools for building AI infrastructure CoreWeave: GPU cloud built for AI workloads Lambda Labs: straightforward GPU cloud for research and startups Modal: serverless GPU compute Weights & Biases: ML experiment tracking and model management MLflow: open-source ML lifecycle platform Hyperscaler AI platforms: AWS SageMaker, Google's Gemini Enterprise Agent Platform, Azure ML AI-powered infrastructure management tools Pulumi Neo: infrastructure agent with policy automation Firefly: asset codification with an emerging agent layer env zero: multi-IaC insights, now with an agent CLI Spacelift Intelligence: conversational Q&A and natural-language provisioning Crossplane with Upbound: Kubernetes-native infrastructure Hyperscaler infrastructure agents: Azure SRE Agent, Gemini Cloud Assist General-purpose code assistants: Copilot, Claude Code, Cursor, Gemini AWS Infrastructure Composer: visual builder for CloudFormation templates Quick picks If you only have two minutes: Enterprise complia

## A Practical Guide to Choosing Among Six AI Career Roles

DevFeed: [A Practical Guide to Choosing Among Six AI Career Roles](<https://devfeed.tech/articles/the-ai-role-that-fits-you-best-39803.md>)

Original publisher: [Read original article](<https://newsletter.bigtechcareers.com/p/the-ai-role-that-fits-you-best>)

Author: Prasad Rao

Published: 2026-05-07T15:01:02Z

Content type: article

Language: en

Sources: [Big Tech Careers](<https://devfeed.tech/sources/big-tech-careers.md>)

Topics: [Tech Careers](<https://devfeed.tech/topics/tech-careers.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-engineer](<https://devfeed.tech/tags/ai-engineer.md>), [article](<https://devfeed.tech/tags/article.md>), [career](<https://devfeed.tech/tags/career.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [llm](<https://devfeed.tech/tags/llm.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [prompt](<https://devfeed.tech/tags/prompt.md>)

### AI overview

This career guide maps six AI roles--AI Engineer, Machine Learning Engineer, AI Product Manager, AI Platform or MLOps Engineer, AI Forward Deployed Engineer, and AI Solutions Architect or AI Consultant--to different strengths, interests, and working styles. It explains that AI Engineers focus on building features and applications, while Machine Learning Engineers focus on model behavior, data, performance, training, evaluation, and deployment.

### Source excerpt

The hottest AI roles in 2026, mapped to your skills, interests, and working style

## Kubeflow SDK v0.4.0: Model Registry, SparkConnect, and Enhanced Developer Experience

DevFeed: [Kubeflow SDK v0.4.0: Model Registry, SparkConnect, and Enhanced Developer Experience](<https://devfeed.tech/articles/kubeflow-sdk-v0-4-0-model-registry-sparkconnect-and-enhanced-developer-experience-17610.md>)

Original publisher: [Read original article](<https://blog.kubeflow.org/kubeflow-sdk-0.4.0-release/>)

Author: Kubeflow SDK Team

Published: 2026-03-19T05:00:00Z

Content type: release

Language: en

Sources: [Kubeflow](<https://devfeed.tech/sources/kubeflow.md>)

Topics: [SDKs](<https://devfeed.tech/topics/sdks.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [Hyperparameter optimization](<https://devfeed.tech/topics/hyperparameter-optimization.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [hyperparameter-optimization](<https://devfeed.tech/tags/hyperparameter-optimization.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [python](<https://devfeed.tech/tags/python.md>), [release](<https://devfeed.tech/tags/release.md>), [sdk](<https://devfeed.tech/tags/sdk.md>)

### AI overview

Kubeflow SDK v0.4.0 introduces a Model Registry Client, SparkClient with SparkConnect support, namespaced TrainingRuntimes, dataset and model initializers, and new documentation. The release targets a unified Python interface for AI workloads on Kubernetes across data processing, model management, and ML pipelines.

### Source excerpt

Explore the full documentation at sdk.kubeflow.org

## Protect your AI workloads from supply chain attacks

DevFeed: [Protect your AI workloads from supply chain attacks](<https://devfeed.tech/articles/protect-your-ai-workloads-from-supply-chain-attacks-13205.md>)

Original publisher: [Read original article](<https://www.chainguard.dev/unchained/protect-your-ai-workloads-from-supply-chain-attacks>)

Published: 2026-01-30T00:00:00Z

Content type: article

Language: en

Sources: [Chainguard: Unchained](<https://devfeed.tech/sources/chainguard-unchained.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Containers](<https://devfeed.tech/topics/containers.md>), [chainguard](<https://devfeed.tech/topics/chainguard.md>), [Vulnerabilities](<https://devfeed.tech/topics/vulnerabilities.md>), [AI Strategy](<https://devfeed.tech/topics/ai-strategy.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Security](<https://devfeed.tech/topics/security.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>), [Tensorflow](<https://devfeed.tech/topics/tensorflow.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-containers](<https://devfeed.tech/tags/ai-containers.md>), [chainguard](<https://devfeed.tech/tags/chainguard.md>), [chainguard-containers](<https://devfeed.tech/tags/chainguard-containers.md>), [chainguard-for-ai](<https://devfeed.tech/tags/chainguard-for-ai.md>), [chainguard-libraries](<https://devfeed.tech/tags/chainguard-libraries.md>), [containers](<https://devfeed.tech/tags/containers.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [cves](<https://devfeed.tech/tags/cves.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [kserve](<https://devfeed.tech/tags/kserve.md>), [legacy](<https://devfeed.tech/tags/legacy.md>), [libraries](<https://devfeed.tech/tags/libraries.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [ollama](<https://devfeed.tech/tags/ollama.md>), [python](<https://devfeed.tech/tags/python.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [security](<https://devfeed.tech/tags/security.md>), [security-vulnerabilities](<https://devfeed.tech/tags/security-vulnerabilities.md>), [supply-chain](<https://devfeed.tech/tags/supply-chain.md>), [supply-chain-attacks](<https://devfeed.tech/tags/supply-chain-attacks.md>), [zero-cve-containers](<https://devfeed.tech/tags/zero-cve-containers.md>)

### AI overview

The article discusses security and operational challenges in AI/ML workloads, including complex dependencies, bloated artifacts, infrastructure sprawl, and unremediated CVEs. It presents Chainguard Containers' minimal images for AI workloads as a way to reduce attack surface, storage needs, and deployment overhead, and cites a 50 MB gpu-operator image compared with a 170 MB upstream equivalent.

### Source excerpt

Chainguard secures AI adoption with minimal, zero-CVE containers and source-built libraries that prevent supply chain malware while keeping developers fast.

## Hands-On MLOps Course Using Databricks Free Edition

DevFeed: [Hands-On MLOps Course Using Databricks Free Edition](<https://devfeed.tech/articles/your-free-guide-to-learn-mlops-on-databricks-28616.md>)

Original publisher: [Read original article](<https://www.marvelousmlops.io/p/your-free-guide-to-learn-mlops-on>)

Author: Maria Vechtomova

Published: 2025-08-29T13:57:23Z

Content type: tutorial

Language: en

Sources: [MarvelousMLOps](<https://devfeed.tech/sources/marvelousmlops.md>)

Topics: [MLOps](<https://devfeed.tech/topics/mlops.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [GitHub Actions](<https://devfeed.tech/topics/github-actions.md>), [GitHub](<https://devfeed.tech/topics/github.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>)

Tags: [course](<https://devfeed.tech/tags/course.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [github-actions](<https://devfeed.tech/tags/github-actions.md>), [mlops](<https://devfeed.tech/tags/mlops.md>)

### AI overview

An overview of a hands-on MLOps course using Databricks Free Edition. It covers moving machine learning prototypes toward production pipelines, including automated deployment with Databricks Asset Bundles and GitHub Actions, plus monitoring with drift detection.

### Source excerpt

A full overview of the course

## Implementing Model Monitoring on Databricks

DevFeed: [Implementing Model Monitoring on Databricks](<https://devfeed.tech/articles/implementing-model-monitoring-on-databricks-28604.md>)

Original publisher: [Read original article](<https://www.marvelousmlops.io/p/lecture-10-implementing-model-monitoring>)

Author: Başak Tuğçe Eskili

Published: 2025-08-06T16:55:23Z

Content type: tutorial

Language: en

Sources: [MarvelousMLOps](<https://devfeed.tech/sources/marvelousmlops.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [dashboards](<https://devfeed.tech/topics/dashboards.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Logging](<https://devfeed.tech/topics/logging.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [databricks](<https://devfeed.tech/tags/databricks.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [model-monitoring](<https://devfeed.tech/tags/model-monitoring.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [request](<https://devfeed.tech/tags/request.md>), [table](<https://devfeed.tech/tags/table.md>)

### AI overview

Lecture 10 in an MLOps with Databricks course demonstrates model monitoring using inference tables and Lakehouse Monitoring. It covers collecting inference logs, creating a structured monitoring table, scheduling refreshes, and building a dashboard to visualize metrics and detect drift.

### Source excerpt

Lecture 10 of MLOps with Databricks course

## Introduction to ML monitoring

DevFeed: [Introduction to ML monitoring](<https://devfeed.tech/articles/introduction-to-ml-monitoring-28602.md>)

Original publisher: [Read original article](<https://www.marvelousmlops.io/p/introduction-to-ml-monitoring>)

Author: Başak Tuğçe Eskili

Published: 2025-08-05T21:56:29Z

Content type: tutorial

Language: en

Sources: [MarvelousMLOps](<https://devfeed.tech/sources/marvelousmlops.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [course](<https://devfeed.tech/tags/course.md>), [data](<https://devfeed.tech/tags/data.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [errors](<https://devfeed.tech/tags/errors.md>), [introduction](<https://devfeed.tech/tags/introduction.md>), [latency](<https://devfeed.tech/tags/latency.md>), [ml](<https://devfeed.tech/tags/ml.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [model](<https://devfeed.tech/tags/model.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [performance](<https://devfeed.tech/tags/performance.md>), [predictions](<https://devfeed.tech/tags/predictions.md>), [production](<https://devfeed.tech/tags/production.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

An introductory lecture in the MLOps with Databricks course explains why machine learning systems require monitoring beyond system health, errors, latency, KPIs, and infrastructure costs. It introduces data drift and concept drift as causes of model performance degradation, even when code and infrastructure remain unchanged.

### Source excerpt

Lecture 9 of MLOps with Databricks course

## CI/CD & Deployment Strategies

DevFeed: [CI/CD & Deployment Strategies](<https://devfeed.tech/articles/ci-cd-deployment-strategies-28597.md>)

Original publisher: [Read original article](<https://www.marvelousmlops.io/p/cicd-and-deployment-strategies>)

Author: Başak Tuğçe Eskili

Published: 2025-08-04T19:12:07Z

Content type: tutorial

Language: en

Sources: [MarvelousMLOps](<https://devfeed.tech/sources/marvelousmlops.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [Access Control](<https://devfeed.tech/topics/access-control.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [ci](<https://devfeed.tech/tags/ci.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [permissions](<https://devfeed.tech/tags/permissions.md>)

### AI overview

Lecture 8 in an MLOps with Databricks course explains how to organize machine learning data and assets with Unity Catalog, Workspaces, catalogs, schemas, and access controls. It also introduces CI/CD pipelines for automating deployments.

### Source excerpt

Lecture 8 of MLOps with Databricks course

## From siloed DataOps, MLOps, and LLMOps to a unified data-intelligence platform

DevFeed: [From siloed DataOps, MLOps, and LLMOps to a unified data-intelligence platform](<https://devfeed.tech/articles/from-siloed-dataops-mlops-and-llmops-to-a-unified-data-intelligence-platform-26354.md>)

Original publisher: [Read original article](<https://medium.com/udemy-engineering/from-siloed-dataops-mlops-and-llmops-to-a-unified-data-intelligence-platform-4400be283641?source=rss----19c6d3367ed4---4>)

Author: Rajit Saha

Published: 2025-08-04T18:03:19Z

Content type: opinion

Language: en

Sources: [Udemy Engineering](<https://devfeed.tech/sources/udemy-engineering.md>)

Topics: [DataOps](<https://devfeed.tech/topics/dataops.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [apache-flink](<https://devfeed.tech/topics/apache-flink.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [aiops](<https://devfeed.tech/tags/aiops.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache-flink](<https://devfeed.tech/tags/apache-flink.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [bedrock](<https://devfeed.tech/tags/bedrock.md>), [dataops](<https://devfeed.tech/tags/dataops.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [llmops](<https://devfeed.tech/tags/llmops.md>), [mlops](<https://devfeed.tech/tags/mlops.md>)

### AI overview

The article describes how DataOps, MLOps, and AI/LLM Ops commonly rely on separate systems and teams for data processing, model deployment, inference, evaluation, orchestration, governance, and monitoring. It then introduces Databricks' Data Intelligence Platform as a unified environment intended to bring these domains together.

### Source excerpt

Introduction In modern data-driven businesses, the pace of innovation in analytics and artificial intelligence has outstripped the capacity of many teams. Three distinct disciplines emerged to handle this expansion: Data platform (DataOps) teams built data lakes on cloud storage such as Amazon S3, processed them with Apache Spark and Hive on EMR, ingested streaming data with Spark Structured Streaming or Apache Flink, and loaded tabular copies into MPP warehouses like Redshift for interactive SQL and BI. Cataloguing and governance were offloaded to external tools such as DataHub, and fine-grained access controls required third-party services like Privacera. This architecture worked, but it required separate workflows for batch and streaming, extra systems for lineage and governance, and a mosaic of operational teams. MLOps teams provided an additional layer. Data scientists used notebook environments (for example, Amazon SageMaker) to preprocess data, train, and evaluate models. Deploying models meant writing integration code to move features into a serving layer, to register models in disparate registries and to build custom APIs for inference. Feature stores and model registries were bought from additional vendors. Updates and monitoring were often manual processes. AI/LLM Ops teams are a new addition because generative AI requires specialized components: LLM gateways (e.g., Amazon Bedrock) to proxy access to foundation models; evaluation tooling to compare large language models; orchestration frameworks for agents; vector databases for retrieval augmented generation; and of course another layer of security, access management and cost control. These tools seldom integrate seamlessly with existing data and ML pipelines. This fragmented state makes it difficult to react quickly when product requirements change. Each new capability requires another system, another integration, and another team. Meanwhile, budgets tighten and go-to-market timelines shrink. The questio

## Databricks Asset Bundles

DevFeed: [Databricks Asset Bundles](<https://devfeed.tech/articles/databricks-asset-bundles-28606.md>)

Original publisher: [Read original article](<https://www.marvelousmlops.io/p/lecture-7-databricks-asset-bundles>)

Author: Başak Tuğçe Eskili

Published: 2025-08-03T14:50:17Z

Content type: tutorial

Language: en

Sources: [MarvelousMLOps](<https://devfeed.tech/sources/marvelousmlops.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [Infrastructure as code](<https://devfeed.tech/topics/infrastructure-as-code.md>), [YAML](<https://devfeed.tech/topics/yaml.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>)

Tags: [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [infrastructure-as-code](<https://devfeed.tech/tags/infrastructure-as-code.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [yaml](<https://devfeed.tech/tags/yaml.md>)

### AI overview

Lecture 7 in an MLOps with Databricks course explains Databricks Asset Bundles (DAB) as a declarative, YAML-based way to package and deploy code, jobs, configuration, and dependencies. It outlines a machine learning workflow covering preprocessing, model training and evaluation, conditional model updates, and deployment.

### Source excerpt

Lecture 7 of MLOps with Databricks course

## Deploying a model serving endpoint

DevFeed: [Deploying a model serving endpoint](<https://devfeed.tech/articles/deploying-a-model-serving-endpoint-28605.md>)

Original publisher: [Read original article](<https://www.marvelousmlops.io/p/lecture-6-deploying-model-serving>)

Author: Başak Tuğçe Eskili

Published: 2025-08-02T11:00:01Z

Content type: tutorial

Language: en

Sources: [MarvelousMLOps](<https://devfeed.tech/sources/marvelousmlops.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [autoscaling](<https://devfeed.tech/topics/autoscaling.md>), [API](<https://devfeed.tech/topics/api.md>), [A/B Testing](<https://devfeed.tech/topics/a-b-testing.md>)

Tags: [a-b-testing](<https://devfeed.tech/tags/a-b-testing.md>), [api](<https://devfeed.tech/tags/api.md>), [article](<https://devfeed.tech/tags/article.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [latency](<https://devfeed.tech/tags/latency.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>)

### AI overview

Lecture 6 in an MLOps with Databricks course explains how to deploy registered MLflow models as Databricks Model Serving REST APIs. It covers serverless deployment, automatic scaling, monitoring, Unity Catalog integration, workload sizing, and limitations such as restricted runtime and cluster control.

### Source excerpt

Lecture 6 of MLOps with Databricks course

[Next page](<https://devfeed.tech/tags/mlops.md?cursor=WyIyMDI1LTA4LTAyVDExOjAwOjAxKzAwOjAwIiwgIjdiNThjZjY2LTQ3YjUtNDhjMS1hODk0LWZkYTllNGM5ZmE1ZCJd>)