# Replication of Thermal Comfort Cohort Models: No Support for Improved Thermal Preference Prediction

DevFeed: [Replication of Thermal Comfort Cohort Models: No Support for Improved Thermal Preference Prediction](<https://devfeed.tech/articles/replication-of-thermal-comfort-cohort-models-no-support-for-improved-thermal-preference-prediction-125526.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.12178>)

Author: Thomas Hirsch, Katja Ceplak, Veronika Windisch, Samina Kadkhoda Masoumali, Matias Quintana, Clayton Miller, Stefano Schiavon, Gerald Schweiger

Published: 2026-11-10T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [AI Models](<https://devfeed.tech/topics/ai-models.md>), [Amazon Machine Learning](<https://devfeed.tech/topics/amazon-machine-learning.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [assessment](<https://devfeed.tech/tags/assessment.md>), [class](<https://devfeed.tech/tags/class.md>), [classification](<https://devfeed.tech/tags/classification.md>), [cross-validation](<https://devfeed.tech/tags/cross-validation.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [distribution](<https://devfeed.tech/tags/distribution.md>), [experimental](<https://devfeed.tech/tags/experimental.md>), [information](<https://devfeed.tech/tags/information.md>), [metric](<https://devfeed.tech/tags/metric.md>), [models](<https://devfeed.tech/tags/models.md>), [multiple](<https://devfeed.tech/tags/multiple.md>), [original](<https://devfeed.tech/tags/original.md>), [performance](<https://devfeed.tech/tags/performance.md>), [personal](<https://devfeed.tech/tags/personal.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [random](<https://devfeed.tech/tags/random.md>), [replication](<https://devfeed.tech/tags/replication.md>), [thermal](<https://devfeed.tech/tags/thermal.md>)

## AI overview

The replication found no evidence that cohort comfort models (CCMs) improve thermal preference prediction over simple class-distribution baselines. On the DORN dataset (20 participants, six months) and an independent PersonAI dataset (72 participants, four weeks), a majority-class predictor matched CCMs on F1-micro; on F1-macro, CCMs had lower median scores than random predictions based on estimated preference distributions. The authors identify limited observations, class imbalance, missing trivial baselines, inadequate cross-validation, and information leakage as problems in the original study. They recommend better-designed studies, including controlled thermal conditions, to gather enough observations across preference classes.

## Source excerpt

arXiv:2611.12178v1 Announce Type: new Abstract: Cohort comfort models (CCMs) aim to overcome the extensive individual data requirements of personal comfort models (PCMs) by grouping occupants based on demographic and psychometric characteristics (cold start) or similar thermal preferences (warm start). We evaluated the validity of the reported CCM performance gains through (i) a methodological assessment of the original study, (ii) a replication using one of the two original datasets (DORN: 20 participants, 6 months) under a revised experimental protocol, and (iii) a replication using an independently collected dataset (PersonAI: 72 participants, 4 weeks). Classification performance was evaluated using F1-micro, as in the original study, and F1-macro to account for class imbalance. Under F1-micro, a trivial baseline that always outputs the majority class performed on par with cohort models. Under F1-macro, all cohort models achieved lower median scores than a simple baseline that makes random predictions based on the estimated distribution of thermal preferences. In our methodological assessment we identified the following key issues: Limited data per participant and per minority class, reliance on a metric insensitive to class imbalance, missing trivial baselines, inadequate cross validation strategy, and multiple occurrences of information leakage. Our findings challenge the original study's conclusion that CCMs improve thermal preference prediction. CCMs did not outperform simple class-distribution baselines. Future studies should improve experimental designs, including controlled thermal conditions, to obtain sufficient observations across thermal preference classes.