Table of Contents
Fetching ...

A Deep Autoregressive Model for Dynamic Combinatorial Complexes

Ata Tuna

TL;DR

This work introduces DAMCC, the first deep autoregressive model designed to generate dynamic combinatorial complexes (CCs), addressing the gap in modeling temporal evolution and higher-order interactions beyond static graphs. It proposes a CC-specific encoder–decoder framework built on a higher-order attention backbone (HOAN) and a row-wise permutation-invariant loss (RWPL) to enable CC-time-series generation via incidence/co-incidence representations. Key contributions include novel CC loss functions, an autoregressive generation scheme over CCs, and comprehensive experiments on real and synthetic datasets that demonstrate the model’s ability to capture temporal and higher-order dependencies, along with a frank discussion of training challenges. The work lays a foundational framework for dynamic topological learning with CCs and points to future directions for scalability, richer temporal modeling, and datasets that inherently require CC representations.

Abstract

We introduce DAMCC (Deep Autoregressive Model for Dynamic Combinatorial Complexes), the first deep learning model designed to generate dynamic combinatorial complexes (CCs). Unlike traditional graph-based models, CCs capture higher-order interactions, making them ideal for representing social networks, biological systems, and evolving infrastructures. While existing models primarily focus on static graphs, DAMCC addresses the challenge of modeling temporal dynamics and higher-order structures in dynamic networks. DAMCC employs an autoregressive framework to predict the evolution of CCs over time. Through comprehensive experiments on real-world and synthetic datasets, we demonstrate its ability to capture both temporal and higher-order dependencies. As the first model of its kind, DAMCC lays the foundation for future advancements in dynamic combinatorial complex modeling, with opportunities for improved scalability and efficiency on larger networks.

A Deep Autoregressive Model for Dynamic Combinatorial Complexes

TL;DR

This work introduces DAMCC, the first deep autoregressive model designed to generate dynamic combinatorial complexes (CCs), addressing the gap in modeling temporal evolution and higher-order interactions beyond static graphs. It proposes a CC-specific encoder–decoder framework built on a higher-order attention backbone (HOAN) and a row-wise permutation-invariant loss (RWPL) to enable CC-time-series generation via incidence/co-incidence representations. Key contributions include novel CC loss functions, an autoregressive generation scheme over CCs, and comprehensive experiments on real and synthetic datasets that demonstrate the model’s ability to capture temporal and higher-order dependencies, along with a frank discussion of training challenges. The work lays a foundational framework for dynamic topological learning with CCs and points to future directions for scalability, richer temporal modeling, and datasets that inherently require CC representations.

Abstract

We introduce DAMCC (Deep Autoregressive Model for Dynamic Combinatorial Complexes), the first deep learning model designed to generate dynamic combinatorial complexes (CCs). Unlike traditional graph-based models, CCs capture higher-order interactions, making them ideal for representing social networks, biological systems, and evolving infrastructures. While existing models primarily focus on static graphs, DAMCC addresses the challenge of modeling temporal dynamics and higher-order structures in dynamic networks. DAMCC employs an autoregressive framework to predict the evolution of CCs over time. Through comprehensive experiments on real-world and synthetic datasets, we demonstrate its ability to capture both temporal and higher-order dependencies. As the first model of its kind, DAMCC lays the foundation for future advancements in dynamic combinatorial complex modeling, with opportunities for improved scalability and efficiency on larger networks.

Paper Structure

This paper contains 70 sections, 1 theorem, 65 equations, 11 figures, 9 tables, 2 algorithms.

Key Result

Proposition 1

Let us call a set of CCs isomorphic to a CC $\mathcal{X}$ the "structure class" of $\mathcal{X}$. The structure class of $\mathcal{X}$ is determined by the sequence of (co)-incidence matrices $((co)B_{0,k})_{k=1}^{ \dim(\mathcal{X})}$.

Figures (11)

  • Figure 1: A visual representation of an example graph in Example \ref{['graph:example']}.
  • Figure 2: A visual representation of an example graph in Example \ref{['hypergraph:example']}.
  • Figure 3: A visual representation of the simplicial complex in Example \ref{['simplex:example']}.
  • Figure 4: A visual representation of the cellular complex in Example \ref{['cell:example']}.
  • Figure 5: A visual representation of the cellular complex in Example \ref{['cc:example']}.
  • ...and 6 more figures

Theorems & Definitions (46)

  • Definition 1: Neighbourhood function
  • Definition 2: Neighbourhood topology
  • Definition 3: Topological space
  • Definition 4: Graph
  • Example 1
  • Definition 5: Hypergraph
  • Remark 1
  • Example 2
  • Definition 6: Simplex
  • Definition 7: https://app.vectary.com/p/4HZRioKH7lZ2jWESIBrjhf
  • ...and 36 more