# How Kueue schedules Spark jobs fairly on Red Hat OpenShift AI

DevFeed: [How Kueue schedules Spark jobs fairly on Red Hat OpenShift AI](<https://devfeed.tech/articles/how-kueue-schedules-spark-jobs-fairly-on-red-hat-openshift-ai-116313.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/11/04/how-kueue-schedules-spark-jobs-fairly-on-red-hat-openshift-ai>)

Author: Vedant Deshpande

Published: 2026-11-04T13:16:25Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [kueue](<https://devfeed.tech/topics/kueue.md>), [scheduling](<https://devfeed.tech/topics/scheduling.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>)

Tags: [admission](<https://devfeed.tech/tags/admission.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [jobs](<https://devfeed.tech/tags/jobs.md>), [kueue](<https://devfeed.tech/tags/kueue.md>), [openshift-ai](<https://devfeed.tech/tags/openshift-ai.md>), [red-hat-openshift](<https://devfeed.tech/tags/red-hat-openshift.md>), [schedules](<https://devfeed.tech/tags/schedules.md>), [spark](<https://devfeed.tech/tags/spark.md>), [spark-operator](<https://devfeed.tech/tags/spark-operator.md>)

## AI overview

Kueue controls when SparkApplications may start by suspending each submission, evaluating its declared CPU and memory against a ClusterQueue, and admitting it to the Spark Operator when quota is available. In the example, a self-managed queue reserves 3 CPUs and 4 GiB: one app with a driver and two executors fits, while a second waits without creating pods and starts after the first finishes. Setup requires the external Red Hat build of Kueue, SparkApplication framework integration and RBAC, a ResourceFlavor/ClusterQueue/LocalQueue, and a queue-name label on every app. The excerpt warns that preemption deletes driver and executor pods without checkpointing, dynamic executor allocation is unsupported, and quota reflects requested rather than actual resource use. It recommends fixed executor counts, explicit resource requests, and checking Workload conditions to distinguish a quota wait from a configuration problem.

## Source excerpt

Table of contents: How Kueue and the Spark Operator divide the work What you will build Set up the integration The post How Kueue schedules Spark jobs fairly on Red Hat OpenShift AI appeared first on Red Hat Developer.