Data-Chain Backdoor: Do You Trust Diffusion Models as Generative Data Supplier?
Junchi Lu, Xinke Li, Yuheng Liu, Qi Alfred Chen
TL;DR
This work reveals a new security threat, Data-Chain Backdoor (DCB), in diffusion-model–driven data augmentation where poisoned upstream generators embed triggers that propagate to downstream classifiers via synthetic data. It formalizes a two-stage attack pipeline—trigger registry through poisoned diffusion training and trigger manifestation in downstream models—while preserving data quality and semantics. The authors identify Early-Stage Trigger Manifestation (ESTM), showing triggers are more explicit in early, high-noise diffusion steps and become camouflaged as sampling proceeds. Empirically, DCB delivers high attack success rates with minimal impact on benign performance and provides robust insights for defenses against backdoors in generative data pipelines and in zero-shot learning contexts.
Abstract
The increasing use of generative models such as diffusion models for synthetic data augmentation has greatly reduced the cost of data collection and labeling in downstream perception tasks. However, this new data source paradigm may introduce important security concerns. This work investigates backdoor propagation in such emerging generative data supply chains, namely Data-Chain Backdoor (DCB). Specifically, we find that open-source diffusion models can become hidden carriers of backdoors. Their strong distribution-fitting ability causes them to memorize and reproduce backdoor triggers during generation, which are subsequently inherited by downstream models, resulting in severe security risks. This threat is particularly concerning under clean-label attack scenarios, as it remains effective while having negligible impact on the utility of the synthetic data. Furthermore, we discover an Early-Stage Trigger Manifestation (ESTM) phenomenon: backdoor trigger patterns tend to surface more explicitly in the early, high-noise stages of the diffusion model's reverse generation process before being subtly integrated into the final samples. Overall, this work reveals a previously underexplored threat in generative data pipelines and provides initial insights toward mitigating backdoor risks in synthetic data generation.
