# Monitor TAS and gang scheduling for AI training in Kubernetes

DevFeed: [Monitor TAS and gang scheduling for AI training in Kubernetes](<https://devfeed.tech/articles/monitor-tas-and-gang-scheduling-for-ai-training-in-kubernetes-26969.md>)

Original publisher: [Read original article](<https://www.datadoghq.com/blog/monitor-tas-and-gang-scheduling-for-ai-training-in-kubernetes/>)

Author: David Lentz; Kathy Lin

Published: 2026-09-15T00:00:00Z

Content type: article

Language: en

Sources: [Datadog | The Monitor blog](<https://devfeed.tech/sources/datadog-the-monitor-blog.md>)

Topics: [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [kueue](<https://devfeed.tech/topics/kueue.md>), [distributed-training](<https://devfeed.tech/topics/distributed-training.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [datadog](<https://devfeed.tech/topics/datadog.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [batch](<https://devfeed.tech/tags/batch.md>), [containers](<https://devfeed.tech/tags/containers.md>), [datadog](<https://devfeed.tech/tags/datadog.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-monitoring](<https://devfeed.tech/tags/gpu-monitoring.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [kueue](<https://devfeed.tech/tags/kueue.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [scheduler](<https://devfeed.tech/tags/scheduler.md>)

## AI overview

This article explains why Kubernetes scheduling is insufficient for distributed AI training workloads and how topology-aware scheduling and gang scheduling address hardware placement and simultaneous startup requirements. It discusses implementing these capabilities with Kueue and the Coscheduling plugin, and monitoring and troubleshooting them with Datadog GPU Monitoring.

## Source excerpt

Learn how Datadog helps you correlate Kueue, Coscheduling, GPU, and training framework signals to validate gang scheduling and topology-aware scheduling.