Table of Contents
Fetching ...

CuMPerLay: Learning Cubical Multiparameter Persistence Vectorizations

Caner Korkmaz, Brighton Nuwagira, Barış Coşkunuzer, Tolga Birdal

TL;DR

CuMPerLay tackles the challenge of integrating Cubical Multiparameter Persistence into deep learning by slicing the multiparameter grid into single-parameter filtrations and applying learnable PersLay-style vectorizations per row, enabling end-to-end differentiable training with CNNs and Swin transformers. The authors establish stability under generalized $W_p$ metrics and provide a CUDA GPU implementation, combining a learnable multifiltration decoder with a four-part topology-aware learning block. Empirically, the approach yields improvements over single-parameter and non-learnable MP baselines on medical imaging and semantic segmentation, with pronounced benefits in limited-data scenarios. Overall, the work offers a practical pathway to infuse global topological structure into modern deep learning architectures for structured image analysis.

Abstract

We present CuMPerLay, a novel differentiable vectorization layer that enables the integration of Cubical Multiparameter Persistence (CMP) into deep learning pipelines. While CMP presents a natural and powerful way to topologically work with images, its use is hindered by the complexity of multifiltration structures as well as the vectorization of CMP. In face of these challenges, we introduce a new algorithm for vectorizing MP homologies of cubical complexes. Our CuMPerLay decomposes the CMP into a combination of individual, learnable single-parameter persistence, where the bifiltration functions are jointly learned. Thanks to the differentiability, its robust topological feature vectors can be seamlessly used within state-of-the-art architectures such as Swin Transformers. We establish theoretical guarantees for the stability of our vectorization under generalized Wasserstein metrics. Our experiments on benchmark medical imaging and computer vision datasets show the benefit CuMPerLay on classification and segmentation performance, particularly in limited-data scenarios. Overall, CuMPerLay offers a promising direction for integrating global structural information into deep networks for structured image analysis.

CuMPerLay: Learning Cubical Multiparameter Persistence Vectorizations

TL;DR

CuMPerLay tackles the challenge of integrating Cubical Multiparameter Persistence into deep learning by slicing the multiparameter grid into single-parameter filtrations and applying learnable PersLay-style vectorizations per row, enabling end-to-end differentiable training with CNNs and Swin transformers. The authors establish stability under generalized metrics and provide a CUDA GPU implementation, combining a learnable multifiltration decoder with a four-part topology-aware learning block. Empirically, the approach yields improvements over single-parameter and non-learnable MP baselines on medical imaging and semantic segmentation, with pronounced benefits in limited-data scenarios. Overall, the work offers a practical pathway to infuse global topological structure into modern deep learning architectures for structured image analysis.

Abstract

We present CuMPerLay, a novel differentiable vectorization layer that enables the integration of Cubical Multiparameter Persistence (CMP) into deep learning pipelines. While CMP presents a natural and powerful way to topologically work with images, its use is hindered by the complexity of multifiltration structures as well as the vectorization of CMP. In face of these challenges, we introduce a new algorithm for vectorizing MP homologies of cubical complexes. Our CuMPerLay decomposes the CMP into a combination of individual, learnable single-parameter persistence, where the bifiltration functions are jointly learned. Thanks to the differentiability, its robust topological feature vectors can be seamlessly used within state-of-the-art architectures such as Swin Transformers. We establish theoretical guarantees for the stability of our vectorization under generalized Wasserstein metrics. Our experiments on benchmark medical imaging and computer vision datasets show the benefit CuMPerLay on classification and segmentation performance, particularly in limited-data scenarios. Overall, CuMPerLay offers a promising direction for integrating global structural information into deep networks for structured image analysis.
Paper Structure (28 sections, 5 theorems, 29 equations, 15 figures, 7 tables, 3 algorithms)

This paper contains 28 sections, 5 theorems, 29 equations, 15 figures, 7 tables, 3 algorithms.

Key Result

Proposition 1

We introduce our cubical two-parameter vectorization $\Psi_{\mathrm{MP}}$ to be: where we choose the SP vectorization $\Psi$ for the $s^\mathrm{th}$ row of the filtration to be a level-dependent PersLay carriere2020perslay:

Figures (15)

  • Figure 1: Elementary complexes of different dimensions and an exemplary cubical complex.
  • Figure 2: Toy example. For the $5\times 5$ image $\mathcal{X}$ with the given pixel values, the sublevel filtration is the sequence of binary images $\mathcal{X}_1\subset \mathcal{X}_2\subset \mathcal{X}_3\subset \mathcal{X}_4\subset \mathcal{X}_5$.
  • Figure 3: CuMPerLay. Our differentiable layer can be deployed on top of existing deep networks such as Swin transformers to discern topological features of cubical complexes (e.g., images) by vectorizing multiparameter persistent homology.
  • Figure 4: TopoSwin: Our CuMPerLay based topological Swin architecture.
  • Figure 5: Filtration learning. Some of the compact multifiltration representations and the corresponding bifiltrations from the third layer of our network on ISIC dataset.
  • ...and 10 more figures

Theorems & Definitions (26)

  • Definition 1: Elementary interval
  • Definition 2: Elementary cube
  • Definition 3: Boundary
  • Definition 4: Face
  • Definition 5: Cubical complex (CC)
  • Definition 6: Cubical map
  • Definition 7: Chain complex of a CC
  • Definition 8: Homology
  • Definition 9: Filtration
  • Example 1: Threshold filtrations
  • ...and 16 more