# Understanding Backdoor Attacks in Scene Graph Generation via Global Context Pathway

DevFeed: [Understanding Backdoor Attacks in Scene Graph Generation via Global Context Pathway](<https://devfeed.tech/articles/understanding-backdoor-attacks-in-scene-graph-generation-via-global-context-pathway-117477.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.04379>)

Author: Xiaoguang Chang, Tuo Chen, Chengze Jiang, Teng Wang, Changyin Sun

Published: 2026-11-04T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Adversarial attacks](<https://devfeed.tech/topics/adversarial-attacks.md>), [Machine Perception](<https://devfeed.tech/topics/machine-perception.md>)

Tags: [attacks](<https://devfeed.tech/tags/attacks.md>), [backdoor](<https://devfeed.tech/tags/backdoor.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [global-context](<https://devfeed.tech/tags/global-context.md>), [graph](<https://devfeed.tech/tags/graph.md>)

## AI overview

The study finds that explicit global context pathways can carry training-time backdoors in scene graph generation (SGG), enabling selective corruption of relations involving a designated object category. On Visual Genome, the attack was effective across evaluated open-vocabulary and closed-set models. Replacing poisoned global context with clean context at inference reduced attack success by 100% for the OvSGTR family and 97% for RelationFormer. In OvSGTR, training-time efforts to suppress trigger signals in that pathway either reduced attack success or substantially degraded utility. The findings indicate a potential backdoor risk in SGG architectures with explicit global context; the supplied abstract does not describe the attack method or the three-axis evaluation protocol in detail.

## Source excerpt

arXiv:2611.04379v1 Announce Type: cross Abstract: Scene Graph Generation (SGG) produces structured scene representations, yet its training-time backdoor risk remains unexplored. Unlike classification, SGG exposes a pair-level attack surface that enables selective corruption of relations involving a designated object category. However, because SGG largely relies on localized evidence, globally placed triggers may face difficulty in manipulating such predictions. Recent SGG architectures increasingly incorporate global context to improve scene modeling, which may in turn facilitate such attacks. In this paper, we systematically study this backdoor risk and investigate the role of the global context pathway in backdoor behavior. Concretely, we first instantiate this attack with an effective method, and propose a three-axis evaluation protocol to characterize backdoor behavior. Experiments on Visual Genome with representative open-vocabulary and closed-set SGG models demonstrate the effectiveness of the attack. Mechanistic analyses reveal that the explicit global context pathway serves as a major carrier of the backdoor effect across the evaluated SGG models. In particular, replacing the poisoned global context representation with its clean counterpart during inference sharply suppresses the attack, yielding 100% and 97% reductions in attack success for the OvSGTR family and RelationFormer, respectively. Moreover, training-time interventions in the OvSGTR family show that suppressing trigger signals in this pathway either reduces attack success or substantially degrades utility. Together, these findings suggest that explicit global context designs may pose a backdoor risk in SGG architectures.