# PAL-Bench: Evidence-Grounded Profile Reconstruction from Longitudinal Personal Albums

DevFeed: [PAL-Bench: Evidence-Grounded Profile Reconstruction from Longitudinal Personal Albums](<https://devfeed.tech/articles/pal-bench-evidence-grounded-profile-reconstruction-from-longitudinal-personal-albums-131934.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2606.16175>)

Author: Qiwei Yan, Zhiqiang Yuan, Zexi Jia, Nanxing Hu, Kailin Lyu, Jie Zhou, Jinchao Zhang

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Entity resolution](<https://devfeed.tech/topics/entity-resolution.md>), [Ground truth / benchmark quality](<https://devfeed.tech/topics/ground-truth-benchmark-quality.md>), [Audit-then-score](<https://devfeed.tech/topics/audit-then-score.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Image processing](<https://devfeed.tech/topics/image-processing.md>), [sensitive data](<https://devfeed.tech/topics/sensitive-data.md>)

Tags: [album](<https://devfeed.tech/tags/album.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [best](<https://devfeed.tech/tags/best.md>), [builds](<https://devfeed.tech/tags/builds.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [entity-resolution](<https://devfeed.tech/tags/entity-resolution.md>), [framework](<https://devfeed.tech/tags/framework.md>), [identity](<https://devfeed.tech/tags/identity.md>), [metric](<https://devfeed.tech/tags/metric.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [profile](<https://devfeed.tech/tags/profile.md>), [provenance](<https://devfeed.tech/tags/provenance.md>), [public-records](<https://devfeed.tech/tags/public-records.md>), [records](<https://devfeed.tech/tags/records.md>), [social](<https://devfeed.tech/tags/social.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [temporal](<https://devfeed.tech/tags/temporal.md>), [timestamps](<https://devfeed.tech/tags/timestamps.md>)

## AI overview

PAL-Bench evaluates whether systems can reconstruct personal profiles and social relationships from noisy, longitudinal photo-album records while grounding claims in evidence. Its Evidence Compiler creates synthetic private worlds, renders album images, re-measures them through perception pipelines, and gives agents only perception-derived public records; targets, identity maps, and evidence paths stay hidden. The benchmark includes 50 synthetic users, 36,659 photo records, and 2,799 targets. An audit with 10 participants found its evidence structures match real albums, while equivalent public releases remain privacy-prohibitive. Across seven systems, results show that plausible owner summaries do not ensure accurate recurring-identity resolution or evidence citation. PAL-TRACE performs best by freezing identity bindings before mining owner facts, but difficult identity resolution remains unsolved.

## Source excerpt

arXiv:2606.16175v2 Announce Type: replace Abstract: Longitudinal personal albums are weak-schema multimodal databases: noisy perceptual records whose key facts require joins across faces, text, timestamps, locations, and repeated events. Existing visual, video, document, and lifelog benchmarks test sub-problems, but not album-scale profile reconstruction with social identity binding and evidence citation. Benchmarking this task is difficult because the ground truth needed for evaluation--owner profiles, social graphs, face-name maps, and evidence provenance--is private state that real albums cannot safely release. We introduce PAL-Bench, a controlled benchmark for evidence-grounded reconstruction under a public-record contract. Its Evidence Compiler builds latent private worlds, programs target-level evidence paths, renders album pixels, re-measures them through perception pipelines, and exports audited public/private views. Agents receive only perception-derived public records; targets, identifier maps, and evidence paths remain hidden. PAL-Bench contains 50 synthetic users, 36,659 public photo records, and 2,799 targets over owner facts, identities, and relations. A privacy-preserving audit with 10 participants confirms that PAL-Bench evidence structures match real private albums, though equivalent releases remain privacy-prohibitive. Across seven systems and two compute-matched diagnostics, a seven-metric protocol reveals a gap between plausible profile summarization and faithful social reconstruction: systems recover some owner facts but struggle with recurring identities and evidence citation. PAL-TRACE, a reference framework that freezes identity bindings before owner-fact mining, performs best but leaves hard identity resolution far from solved. PAL-Bench provides a testbed for perceptual entity resolution, multimodal data integration, temporal evidence aggregation, and provenance-aware structured prediction.