# Multi-objective Hyperparameter Optimization with Expert Priors

DevFeed: [Multi-objective Hyperparameter Optimization with Expert Priors](<https://devfeed.tech/articles/multi-objective-hyperparameter-optimization-with-expert-priors-120372.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2511.08371>)

Author: Soham Basu, Nastaran Alipour, Frank Hutter, Danny Stoll

Published: 2026-11-06T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Hyperparameter optimization](<https://devfeed.tech/topics/hyperparameter-optimization.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [experts](<https://devfeed.tech/tags/experts.md>), [hyperparameter-optimization](<https://devfeed.tech/tags/hyperparameter-optimization.md>), [objectives](<https://devfeed.tech/tags/objectives.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [user](<https://devfeed.tech/tags/user.md>), [vision-language-model](<https://devfeed.tech/tags/vision-language-model.md>)

## AI overview

PriMO is an HPO algorithm designed to incorporate expert beliefs across multiple objectives, addressing a gap in methods that use prior knowledge. The abstract reports state-of-the-art performance in both multi-objective and single-objective settings across eight deep-learning benchmarks, and at larger scale when optimizing a vision-language model over three objectives. The supplied text does not describe the method's implementation or benchmark details.

## Source excerpt

arXiv:2511.08371v2 Announce Type: replace Abstract: While Deep Learning (DL) experts often have prior knowledge about which hyperparameter settings yield strong performance, only few Hyperparameter Optimization (HPO) algorithms can leverage such prior knowledge and none incorporate priors over multiple objectives. As DL practitioners often need to optimize not just one but many objectives, this is a blind spot in the algorithmic landscape of HPO. To address this shortcoming, we propose the novel problem setting of multi-objective HPO with expert priors and introduce PriMO, the first HPO algorithm that can integrate user beliefs over multiple objectives. We show PriMO achieves state-of-the-art performance across 8 DL benchmarks in the multi-objective and single-objective setting. Further, we demonstrate that PriMO remains state-of-the-art at large scales by optimizing a vision-language model over three objectives.