# Training Calibrated Conditional Generative Models with a Sample-Only Coverage Loss

DevFeed: [Training Calibrated Conditional Generative Models with a Sample-Only Coverage Loss](<https://devfeed.tech/articles/training-calibrated-conditional-generative-models-with-a-sample-only-coverage-loss-133043.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.15829>)

Author: Benjamin Remy, Raphael Rossellini, Chihway Chang, Rebecca Willett

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Calibrated uncertainty](<https://devfeed.tech/topics/calibrated-uncertainty.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [conditional](<https://devfeed.tech/tags/conditional.md>), [coverage](<https://devfeed.tech/tags/coverage.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [generative](<https://devfeed.tech/tags/generative.md>), [generative-models](<https://devfeed.tech/tags/generative-models.md>), [imaging](<https://devfeed.tech/tags/imaging.md>), [sample](<https://devfeed.tech/tags/sample.md>), [stat-me](<https://devfeed.tech/tags/stat-me.md>), [stat-ml](<https://devfeed.tech/tags/stat-ml.md>), [training](<https://devfeed.tech/tags/training.md>), [uncertainty-quantification](<https://devfeed.tech/tags/uncertainty-quantification.md>)

## AI overview

The paper introduces a differentiable coverage loss for calibrating conditional generative models using samples alone, without requiring tractable densities or architectural changes. The authors prove the loss is a strict divergence: it vanishes only when the model matches the true posterior. On simulation-based inference benchmarks, it matches a density-based coverage loss without evaluating densities; on high-dimensional imaging inverse problems, it improves posterior calibration over scoring-rule regularizers while changing point-estimate reconstruction quality little.

## Source excerpt

arXiv:2611.15829v1 Announce Type: new Abstract: Conditional generative models have become the tool of choice for sampling posteriors in scientific inverse problems, where we seek to sample images or signals conditioned on a set of indirect and noisy measurements. Yet they are often overconfident, which is a critical failure in scientific applications where accurate uncertainty quantification is essential. Existing regularizers fall short in complementary ways: differentiable coverage objectives require the model's density and do not identify the posterior, while strictly proper scoring rules such as the energy score need only samples but do not directly enforce coverage. We close this gap by introducing a differentiable loss function based on the expected coverage probability, estimated from samples alone. It applies to any conditional generative model, with no need for tractable densities or architectural changes. We prove that it is a strict divergence, vanishing if and only if the model equals the true posterior. On simulation-based inference benchmarks, it matches a density-based coverage loss without evaluating the density. On high-dimensional imaging inverse problems, it yields better-calibrated posteriors than scoring-rule regularizers, with little change in the reconstruction quality of point estimates.