Table of Contents
Fetching ...

Fixed-point graph convolutional networks against adversarial attacks

Shakib Khan, A. Ben Hamza, Amr Youssef

TL;DR

Graph neural networks are vulnerable to adversarial perturbations on graph structure and node features. The authors propose Fix-GCN, a fixed-point iterative GCN that uses a spectral modulation filter with $h_s(λ)=\frac{1}{(1+s)λ - sλ^2}$ and a propagation operator $P=((1-s)I+s\hat{A})\hat{A}$ to perform higher-order diffusion while attenuating high-frequency perturbations. The model updates via $\mathbf{H}^{(\ell+1)}=\sigma( P\mathbf{H}^{(\ell)}\mathbf{W}^{(\ell)}+\mathbf{X}\widetilde{\mathbf{W}}^{(\ell)})$ with an initial residual path, and recovers standard GCN behavior when $s=0$ and a second-order GCN when $s=1$. Empirical results across multiple datasets show Fix-GCN achieves superior robustness against poisoning, random, feature, and evasion attacks, with best performance near $s=0.2$ and comparable computational complexity to conventional GCNs. Overall, Fix-GCN provides a practical, scalable defense that leverages fixed-point spectral filtering to bolster graph representations under adversarial conditions.

Abstract

Adversarial attacks present a significant risk to the integrity and performance of graph neural networks, particularly in tasks where graph structure and node features are vulnerable to manipulation. In this paper, we present a novel model, called fixed-point iterative graph convolutional network (Fix-GCN), which achieves robustness against adversarial perturbations by effectively capturing higher-order node neighborhood information in the graph without additional memory or computational complexity. Specifically, we introduce a versatile spectral modulation filter and derive the feature propagation rule of our model using fixed-point iteration. Unlike traditional defense mechanisms that rely on additional design elements to counteract attacks, the proposed graph filter provides a flexible-pass filtering approach, allowing it to selectively attenuate high-frequency components while preserving low-frequency structural information in the graph signal. By iteratively updating node representations, our model offers a flexible and efficient framework for preserving essential graph information while mitigating the impact of adversarial manipulation. We demonstrate the effectiveness of the proposed model through extensive experiments on various benchmark graph datasets, showcasing its resilience against adversarial attacks.

Fixed-point graph convolutional networks against adversarial attacks

TL;DR

Graph neural networks are vulnerable to adversarial perturbations on graph structure and node features. The authors propose Fix-GCN, a fixed-point iterative GCN that uses a spectral modulation filter with and a propagation operator to perform higher-order diffusion while attenuating high-frequency perturbations. The model updates via with an initial residual path, and recovers standard GCN behavior when and a second-order GCN when . Empirical results across multiple datasets show Fix-GCN achieves superior robustness against poisoning, random, feature, and evasion attacks, with best performance near and comparable computational complexity to conventional GCNs. Overall, Fix-GCN provides a practical, scalable defense that leverages fixed-point spectral filtering to bolster graph representations under adversarial conditions.

Abstract

Adversarial attacks present a significant risk to the integrity and performance of graph neural networks, particularly in tasks where graph structure and node features are vulnerable to manipulation. In this paper, we present a novel model, called fixed-point iterative graph convolutional network (Fix-GCN), which achieves robustness against adversarial perturbations by effectively capturing higher-order node neighborhood information in the graph without additional memory or computational complexity. Specifically, we introduce a versatile spectral modulation filter and derive the feature propagation rule of our model using fixed-point iteration. Unlike traditional defense mechanisms that rely on additional design elements to counteract attacks, the proposed graph filter provides a flexible-pass filtering approach, allowing it to selectively attenuate high-frequency components while preserving low-frequency structural information in the graph signal. By iteratively updating node representations, our model offers a flexible and efficient framework for preserving essential graph information while mitigating the impact of adversarial manipulation. We demonstrate the effectiveness of the proposed model through extensive experiments on various benchmark graph datasets, showcasing its resilience against adversarial attacks.

Paper Structure

This paper contains 11 sections, 2 theorems, 11 equations, 6 figures, 2 tables.

Key Result

Lemma 1

If two matrices $\bm{C}_{1}$ and $\bm{C}_{2}$ commute, i.e., $\bm{C}_{1}\bm{C}_{2}=\bm{C}_{2}\bm{C}_{1}$, then where $\rho(\cdot)$ denotes matrix spectral radius (i.e., largest absolute value of all eigenvalues).

Figures (6)

  • Figure 1: Transfer function of the spectral modulation filter. Lower values of the scaling parameter make the filter attenuate high-frequency components more strongly.
  • Figure 2: Node classification accuracy under targeted attacks (Nettack) with varying numbers of perturbations on the target nodes $\{1, 2, 3, 4, 5\}$.
  • Figure 3: Node classification accuracy under random attacks with varying perturbation rates.
  • Figure 4: Node classification accuracy under feature attacks with different perturbation rates.
  • Figure 5: Node classification accuracy of different models under evasion attacks (DICE) with varying perturbation rates.
  • ...and 1 more figures

Theorems & Definitions (2)

  • Lemma 1
  • Proposition 1