Table of Contents
Fetching ...

Partition-wise Graph Filtering: A Unified Perspective Through the Lens of Graph Coarsening

Guoming Li, Jian Yang, Yifan Chen

TL;DR

This work addresses the limitations of purely graph-wise or node-wise filtering in graph neural networks by introducing Coarsening-guided Partition-wise Filtering (CPF). CPF performs filtering on node partitions derived from graph coarsening (structure-aware) and on clusters derived from feature embeddings (class-aware), unifying graph- and node-centric paradigms. The authors provide theoretical insights, including RSA-based guarantees and a unified embedding formulation Z = \sum_{k=0}^{K} diag(C^{+}\Theta_{:k+1}) T_{k}(\\boldsymbol{L}) X, and demonstrate strong empirical gains on both homophilic and heterophilic graphs, as well as real-world graph anomaly detection tasks. The approach highlights improved generalization and scalability, achieving state-of-the-art performance across diverse datasets while mitigating overfitting risks associated with fully node-wise filtering.

Abstract

Filtering-based graph neural networks (GNNs) constitute a distinct class of GNNs that employ graph filters to handle graph-structured data, achieving notable success in various graph-related tasks. Conventional methods adopt a graph-wise filtering paradigm, imposing a uniform filter across all nodes, yet recent findings suggest that this rigid paradigm struggles with heterophilic graphs. To overcome this, recent works have introduced node-wise filtering, which assigns distinct filters to individual nodes, offering enhanced adaptability. However, a fundamental gap remains: a comprehensive framework unifying these two strategies is still absent, limiting theoretical insights into the filtering paradigms. Moreover, through the lens of Contextual Stochastic Block Model, we reveal that a synthesis of graph-wise and node-wise filtering provides a sufficient solution for classification on graphs exhibiting both homophily and heterophily, suggesting the risk of excessive parameterization and potential overfitting with node-wise filtering. To address the limitations, this paper introduces Coarsening-guided Partition-wise Filtering (CPF). CPF innovates by performing filtering on node partitions. The method begins with structure-aware partition-wise filtering, which filters node partitions obtained via graph coarsening algorithms, and then performs feature-aware partition-wise filtering, refining node embeddings via filtering on clusters produced by $k$-means clustering over features. In-depth analysis is conducted for each phase of CPF, showing its superiority over other paradigms. Finally, benchmark node classification experiments, along with a real-world graph anomaly detection application, validate CPF's efficacy and practical utility.

Partition-wise Graph Filtering: A Unified Perspective Through the Lens of Graph Coarsening

TL;DR

This work addresses the limitations of purely graph-wise or node-wise filtering in graph neural networks by introducing Coarsening-guided Partition-wise Filtering (CPF). CPF performs filtering on node partitions derived from graph coarsening (structure-aware) and on clusters derived from feature embeddings (class-aware), unifying graph- and node-centric paradigms. The authors provide theoretical insights, including RSA-based guarantees and a unified embedding formulation Z = \sum_{k=0}^{K} diag(C^{+}\Theta_{:k+1}) T_{k}(\\boldsymbol{L}) X, and demonstrate strong empirical gains on both homophilic and heterophilic graphs, as well as real-world graph anomaly detection tasks. The approach highlights improved generalization and scalability, achieving state-of-the-art performance across diverse datasets while mitigating overfitting risks associated with fully node-wise filtering.

Abstract

Filtering-based graph neural networks (GNNs) constitute a distinct class of GNNs that employ graph filters to handle graph-structured data, achieving notable success in various graph-related tasks. Conventional methods adopt a graph-wise filtering paradigm, imposing a uniform filter across all nodes, yet recent findings suggest that this rigid paradigm struggles with heterophilic graphs. To overcome this, recent works have introduced node-wise filtering, which assigns distinct filters to individual nodes, offering enhanced adaptability. However, a fundamental gap remains: a comprehensive framework unifying these two strategies is still absent, limiting theoretical insights into the filtering paradigms. Moreover, through the lens of Contextual Stochastic Block Model, we reveal that a synthesis of graph-wise and node-wise filtering provides a sufficient solution for classification on graphs exhibiting both homophily and heterophily, suggesting the risk of excessive parameterization and potential overfitting with node-wise filtering. To address the limitations, this paper introduces Coarsening-guided Partition-wise Filtering (CPF). CPF innovates by performing filtering on node partitions. The method begins with structure-aware partition-wise filtering, which filters node partitions obtained via graph coarsening algorithms, and then performs feature-aware partition-wise filtering, refining node embeddings via filtering on clusters produced by -means clustering over features. In-depth analysis is conducted for each phase of CPF, showing its superiority over other paradigms. Finally, benchmark node classification experiments, along with a real-world graph anomaly detection application, validate CPF's efficacy and practical utility.

Paper Structure

This paper contains 38 sections, 4 theorems, 16 equations, 3 figures, 14 tables.

Key Result

proposition 1

Consider a binary-class graph $\mathcal{G}$ generated from the distribution $CSBM(n, \boldsymbol{\mu}, \boldsymbol{\nu}, (p_0, q_0), (p_1, q_1), P)$, as defined in nodewise-3. Here, $\boldsymbol{\mu}$ and $\boldsymbol{\nu}$ define Gaussian distributions for the generation of random node features, wh

Figures (3)

  • Figure 1: Overview of CPF’s filtering procedure. It employs the partition-wise graph filtering in two aspects: structure, where partitions are obtained via graph coarsening, and features, where partitions are derived through $k$-means clustering on features.
  • Figure 2: The impact of coarsening ratio. Here, "Graph-" and "Node-" represent graph-wise and node-wise filtering.
  • Figure 3: Additional ablation studies of coarsening ratio $r$ evaluated on graphs with diverse sizes and heterophily.

Theorems & Definitions (5)

  • definition 1
  • proposition 1
  • theorem 1
  • proposition 2
  • proposition 3