Table of Contents
Fetching ...

Adaptive Graph Unlearning

Pengfei Ding, Yan Wang, Guanfeng Liu, Jiajie Zhu

TL;DR

AGU tackles the problem of forgetting deleted graph elements in GNNs while preserving the rest. It introduces two components—task-adaptive element forgetting and GNN-adaptive neighbor selection—to tailor unlearning to node/edge/feature levels and backbone architectures. The approach combines edge and feature forgetting with a node-unlearning reformulation, and employs a unified objective $\mathcal{L}=\mathcal{L}_{EF}+\mathcal{L}_{AN}$ that preserves signals on highly affected neighbors. Experiments on seven real-world graphs demonstrate state-of-the-art effectiveness and efficiency, with strong unlearning capabilities and good transferability to existing GU frameworks.

Abstract

Graph unlearning, which deletes graph elements such as nodes and edges from trained graph neural networks (GNNs), is crucial for real-world applications where graph data may contain outdated, inaccurate, or privacy-sensitive information. However, existing methods often suffer from (1) incomplete or over unlearning due to neglecting the distinct objectives of different unlearning tasks, and (2) inaccurate identification of neighbors affected by deleted elements across various GNN architectures. To address these limitations, we propose AGU, a novel Adaptive Graph Unlearning framework that flexibly adapts to diverse unlearning tasks and GNN architectures. AGU ensures the complete forgetting of deleted elements while preserving the integrity of the remaining graph. It also accurately identifies affected neighbors for each GNN architecture and prioritizes important ones to enhance unlearning performance. Extensive experiments on seven real-world graphs demonstrate that AGU outperforms existing methods in terms of effectiveness, efficiency, and unlearning capability.

Adaptive Graph Unlearning

TL;DR

AGU tackles the problem of forgetting deleted graph elements in GNNs while preserving the rest. It introduces two components—task-adaptive element forgetting and GNN-adaptive neighbor selection—to tailor unlearning to node/edge/feature levels and backbone architectures. The approach combines edge and feature forgetting with a node-unlearning reformulation, and employs a unified objective that preserves signals on highly affected neighbors. Experiments on seven real-world graphs demonstrate state-of-the-art effectiveness and efficiency, with strong unlearning capabilities and good transferability to existing GU frameworks.

Abstract

Graph unlearning, which deletes graph elements such as nodes and edges from trained graph neural networks (GNNs), is crucial for real-world applications where graph data may contain outdated, inaccurate, or privacy-sensitive information. However, existing methods often suffer from (1) incomplete or over unlearning due to neglecting the distinct objectives of different unlearning tasks, and (2) inaccurate identification of neighbors affected by deleted elements across various GNN architectures. To address these limitations, we propose AGU, a novel Adaptive Graph Unlearning framework that flexibly adapts to diverse unlearning tasks and GNN architectures. AGU ensures the complete forgetting of deleted elements while preserving the integrity of the remaining graph. It also accurately identifies affected neighbors for each GNN architecture and prioritizes important ones to enhance unlearning performance. Extensive experiments on seven real-world graphs demonstrate that AGU outperforms existing methods in terms of effectiveness, efficiency, and unlearning capability.
Paper Structure (18 sections, 9 equations, 4 figures, 6 tables)

This paper contains 18 sections, 9 equations, 4 figures, 6 tables.

Figures (4)

  • Figure 1: Examples of graph unlearning tasks. The deletion of node $\emph{v}_0$ or edge $(\emph{v}_0, \emph{v}_1)$ affects $\emph{v}_3$ in GCN but not in GAT.
  • Figure 2: The overall architecture of our proposed AGU framework.
  • Figure 3: Edge attack performance on the Cora dataset.
  • Figure 4: Node unlearning performance with varying parameters.