# When Reconstruction Is Not Enough: Doubly Robust Counterfactual and Interventional Mediation Analysis with Learned Multimodal Representations

DevFeed: [When Reconstruction Is Not Enough: Doubly Robust Counterfactual and Interventional Mediation Analysis with Learned Multimodal Representations](<https://devfeed.tech/articles/when-reconstruction-is-not-enough-doubly-robust-counterfactual-and-interventional-mediation-analysis-with-learned-multimodal-representations-96911.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.30220>)

Author: Cong Cao

Published: 2026-10-23T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Representation learning](<https://devfeed.tech/topics/representation-learning.md>), [Predictive AI](<https://devfeed.tech/topics/predictive-ai.md>)

Tags: [autoencoders](<https://devfeed.tech/tags/autoencoders.md>), [bias](<https://devfeed.tech/tags/bias.md>), [coverage](<https://devfeed.tech/tags/coverage.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [diagnostics](<https://devfeed.tech/tags/diagnostics.md>), [digital-twins](<https://devfeed.tech/tags/digital-twins.md>), [health](<https://devfeed.tech/tags/health.md>), [linear](<https://devfeed.tech/tags/linear.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [portable](<https://devfeed.tech/tags/portable.md>), [robust](<https://devfeed.tech/tags/robust.md>), [stat-me](<https://devfeed.tech/tags/stat-me.md>), [stat-ml](<https://devfeed.tech/tags/stat-ml.md>), [sufficient](<https://devfeed.tech/tags/sufficient.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

## AI overview

Learned health-record representations can preserve reconstruction quality while losing confounders needed for causal identification, causing large bias. The abstract distinguishes counterfactual comparisons from interventional mediation, which requires more from a representation, and shows that double robustness and cross-fitting do not remove first-order representation bias; with an insufficient representation, interval coverage can worsen as sample size grows. The proposed workflow combines modality-specific variational autoencoders trained outside the estimation sample with cross-fitted doubly robust estimation, locked phenotypes, select-then-confirm pathway analysis, portable representations, and diagnostics for insufficiency, exposure leakage, and sensitivity. In simulations, omitting a rare, moderately strong confounder yielded only 2% coverage for indirect-effect intervals at n=3,000; reconstruction loss missed the problem, while a predictive diagnostic flagged it in every replicate.

## Source excerpt

arXiv:2610.30220v1 Announce Type: new Abstract: Learned representations of high-dimensional multimodal health records are increasingly used to adjust for confounding, yet they are usually trained to reconstruct the data rather than preserve the information that causal identification requires. We study counterfactual outcomes under alternative treatments, including phenotype-specific effects and patient-level counterfactual risk profiles of the kind digital twins provide, and interventional direct and indirect effects under exposure-induced intermediate confounding. We give conditions under which a representation preserves identification and show that interventional mediation is more demanding than counterfactual comparison. We prove that no covariate-only training objective, whether reconstruction, contrastive, or physics-informed, can certify that a representation is sufficient, and that, in a linear structural model, a representation can lose arbitrarily little reconstruction accuracy yet induce arbitrarily large bias. We decompose the error of cross-fitted doubly robust estimators into a first-order representation bias, which neither double robustness nor cross-fitting removes, and a second-order remainder of nuisance-estimation errors, so coverage worsens as the sample size grows when the representation is insufficient. We propose a workflow combining modality-specific variational autoencoders trained outside the estimation sample, cross-fitted doubly robust estimators, locked phenotypes, select-then-confirm pathway analysis, portable representations, and diagnostics for representation insufficiency, exposure leakage, and sensitivity. In simulations, discarding a rare, moderately strong confounder gave indirect-effect intervals with 2% coverage at n = 3,000; reconstruction loss missed the problem, and a simple predictive diagnostic flagged it in every replicate.