# Calibrated Uncertainty Quantification on TDC ADMET: What Can Be Resolved Across 22 Datasets?

DevFeed: [Calibrated Uncertainty Quantification on TDC ADMET: What Can Be Resolved Across 22 Datasets?](<https://devfeed.tech/articles/calibrated-uncertainty-quantification-on-tdc-admet-what-can-be-resolved-across-22-datasets-123401.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.09373>)

Author: Laurits Fredsgaard, Michael Riis Andersen, Mikkel N. Schmidt

Published: 2026-11-09T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Calibrated uncertainty](<https://devfeed.tech/topics/calibrated-uncertainty.md>), [Predictive AI](<https://devfeed.tech/topics/predictive-ai.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>)

Tags: [22](<https://devfeed.tech/tags/22.md>), [absorption](<https://devfeed.tech/tags/absorption.md>), [abstract](<https://devfeed.tech/tags/abstract.md>), [also](<https://devfeed.tech/tags/also.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [best](<https://devfeed.tech/tags/best.md>), [but](<https://devfeed.tech/tags/but.md>), [calibrated-uncertainty](<https://devfeed.tech/tags/calibrated-uncertainty.md>), [can](<https://devfeed.tech/tags/can.md>), [compare](<https://devfeed.tech/tags/compare.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [cross](<https://devfeed.tech/tags/cross.md>), [cross-validation](<https://devfeed.tech/tags/cross-validation.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [data-commons](<https://devfeed.tech/tags/data-commons.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [resolved](<https://devfeed.tech/tags/resolved.md>), [uncertainty](<https://devfeed.tech/tags/uncertainty.md>), [uncertainty-quantification](<https://devfeed.tech/tags/uncertainty-quantification.md>)

## AI overview

Across 22 TDC ADMET datasets, ensemble MC dropout has the best average rank for predictive performance, Brier score, and 90% interval score, but the benchmark does not establish it as a clear winner: other ensemble pipelines are not separated from it on performance, and LightGBM is also not ruled out for the two uncertainty scores. LightGBM wins the most individual datasets for performance and Brier score, while performing poorly on several endpoints. The study compares eleven calibrated pipelines using nested five-fold cross-validation, ten chemical partitions, and five model seeds; smaller evaluations can identify a different leader and miss the broader comparison. The findings support using LightGBM and an ensemble neural model as complementary baselines, and checking comparative claims across multiple chemical partitions with statistical analyses suited to the question.

## Source excerpt

arXiv:2611.09373v1 Announce Type: new Abstract: Absorption, distribution, metabolism, excretion, and toxicity (ADMET) models often rely on small, heterogeneous datasets, yet their predictions may determine which compounds proceed to experimental testing. Useful evaluations must therefore assess both predictive performance and the quality of reported probabilities or intervals. We ask which common uncertainty-quantification methods perform best on the 22 Therapeutics Data Commons (TDC) ADMET datasets and what this benchmark can resolve. We compare eleven calibrated pipelines using nested five-fold cross-validation across ten chemical partitions and five model seeds. Ensemble Monte Carlo (MC) dropout has the best average rank for TDC performance, Brier score, and 90% interval score. For TDC performance, however, it is not separated from the other ensemble pipelines; for Brier and interval score, LightGBM is also not ruled out as best. LightGBM wins more individual datasets than any other method for TDC performance and Brier score, but performs poorly on several endpoints. Smaller evaluations can identify a different leader and often fail to recover the broader comparison. These results make LightGBM and an ensemble neural model complementary baselines. Comparative claims should be checked across multiple chemical partitions using statistical analyses matched to the question being asked.