# Normalized Entropy or Apply Rate? Evaluation Metrics for Online Modeling Experiments

DevFeed: [Normalized Entropy or Apply Rate? Evaluation Metrics for Online Modeling Experiments](<https://devfeed.tech/articles/normalized-entropy-or-apply-rate-evaluation-metrics-for-online-modeling-experiments-29992.md>)

Original publisher: [Read original article](<https://engineering.indeedblog.com/blog/2025/11/normalized-entropy-or-apply-rate-evaluation-metrics-for-online-modeling-experiments/>)

Author: Megan Chen

Published: 2025-11-11T06:16:53Z

Content type: opinion

Language: en

Sources: [Indeed](<https://devfeed.tech/sources/indeed.md>)

Topics: [recommendation systems](<https://devfeed.tech/topics/recommendation-systems.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [decision-making](<https://devfeed.tech/topics/decision-making.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>)

Tags: [a-b-testing](<https://devfeed.tech/tags/a-b-testing.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [decision-making](<https://devfeed.tech/tags/decision-making.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [metric](<https://devfeed.tech/tags/metric.md>), [models](<https://devfeed.tech/tags/models.md>), [ranking](<https://devfeed.tech/tags/ranking.md>), [unsorted](<https://devfeed.tech/tags/unsorted.md>)

## AI overview

Indeed examines whether model performance metrics or product metrics should guide online modeling experiments. It discusses how optimizing individual ranking models may not align with broader business goals and considers evaluation metrics for model rollouts.

## Source excerpt

Introduction At Indeed, our mission is to help people get jobs. We connect job seekers with their next career opportunities and assist employers in finding the ideal candidates. This makes matching a fundamental problem in the products we develop. The Ranking Models team is responsible for building Machine Learning models that drive matching between job [...]