Only Whats Necessary: Pareto Optimal Data Minimization for Privacy Preserving Video Anomaly Detection

Abstract

Video anomaly detection (VAD) systems are increasingly deployed in safety critical environments and require a large amount of data for accurate detection. However, such data may contain personally identifiable information (PII), including facial cues and sensitive demographic attributes, creating compliance challenges under the EU General Data Protection Regulation (GDPR). In particular, GDPR requires that personal data be limited to what is strictly necessary for a specified processing purpose. To address this, we introduce Only What's Necessary, a privacy-by-design framework for VAD that explicitly controls the amount and type of visual information exposed to the detection pipeline. The framework combines breadth based and depth based data minimization mechanisms to suppress PII while preserving cues relevant to anomaly detection. We evaluate a range of minimization configurations by feeding the minimized videos to both a VAD model and a privacy inference model. We employ two ranking based methods, along with Pareto analysis, to characterize the resulting trade off between privacy and utility. From the non-dominated frontier, we identify sweet spot operating points that minimize personal data exposure with limited degradation in detection performance. Extensive experiments on publicly available datasets demonstrate the effectiveness of the proposed framework.

Figures (3)

• Figure 1: Overview of the proposed data minimization framework. Given an input video clip $x \in \mathbb{R}^{T \times H \times W \times C}$, a configurable minimization module $T_{\theta}$ produces a reduced representation $z=T_{\theta}(x)$. The minimized video is then evaluated along two downstream objectives: anomaly detection using a VAD model $f_{\phi}$ and privacy leakage using a privacy inference model $g_{\psi}$.
• Figure 2: Heatmap visualization of raw performance metrics and derived selection criteria for all single and pairwise minimization settings. The top row shows AUC, cMAP, and F1, while the bottom row reports distance to the ideal point, weighted score, and combined rank. Diagonal entries denote single minimization settings, and off-diagonal entries denote pairwise settings, where the minimization on the vertical axis is applied first, and the minimization on the horizontal axis is applied second. TS: Temporal sampling; DS: Downsample; MK: Masking; BL: Blurring; BR: Background removal.
• Figure 3: Projection of all candidate settings onto the AUC-cMAP and AUC-F1 planes. Higher AUC and lower cMAP/F1 are preferred. Highlighted markers denote settings that are Pareto-optimal in the full three-objective space of AUC, cMAP, and F1. The figure provides a compact visualization of the feasible utility-privacy trade-off surface and complements the quantitative ranking reported in Section \ref{['sec:Pareto_Optimal']}.