TAG-WM: Tamper-Aware Generative Image Watermarking via Diffusion Inversion Sensitivity
Yuzhuo Chen, Zehua Ma, Han Fang, Weiming Zhang, Nenghai Yu
TL;DR
This work introduces TAG-WM, a tamper-aware watermarking framework embedded directly into diffusion-model generation to simultaneously protect copyright and localize tampering. It combines dual watermark embedding via a DMJS scheme, latent reconstruction for extraction, a dense variation region detector for tamper localization, and tamper-aware decoding to robustly recover watermarks under manipulation. The approach achieves state-of-the-art tampering robustness and localization, maintains high generation quality, and supports a 256-bit watermark capacity with substantial speed advantages over post-processing methods. The results offer a practical pathway for provenance and authenticity in AI-generated imagery, while also outlining limitations and directions for future enhancements.
Abstract
AI-generated content (AIGC) enables efficient visual creation but raises copyright and authenticity risks. As a common technique for integrity verification and source tracing, digital image watermarking is regarded as a potential solution to above issues. However, the widespread adoption and advancing capabilities of generative image editing tools have amplified malicious tampering risks, while simultaneously posing new challenges to passive tampering detection and watermark robustness. To address these challenges, this paper proposes a Tamper-Aware Generative image WaterMarking method named TAG-WM. The proposed method comprises four key modules: a dual-mark joint sampling (DMJS) algorithm for embedding copyright and localization watermarks into the latent space while preserving generative quality, the watermark latent reconstruction (WLR) utilizing reversed DMJS, a dense variation region detector (DVRD) leveraging diffusion inversion sensitivity to identify tampered areas via statistical deviation analysis, and the tamper-aware decoding (TAD) guided by localization results. The experimental results demonstrate that TAG-WM achieves state-of-the-art performance in both tampering robustness and localization capability even under distortion, while preserving lossless generation quality and maintaining a watermark capacity of 256 bits. The code is available at: https://github.com/Suchenl/TAG-WM.
