Table of Contents
Fetching ...

AutoG: Towards automatic graph construction from tabular data

Zhikai Chen, Han Xie, Jian Zhang, Xiang song, Jiliang Tang, Huzefa Rangwala, George Karypis

TL;DR

AutoG tackles the underexplored problem of constructing graphs from tabular data for graph ML. It formalizes graph-construction as a benchmark with eight real-world datasets and proposes an LLM-based framework that uses a three-module pipeline and chain-of-augmentation to generate augmented graph schemas, guided by an oracle that evaluates downstream task performance. Empirical results show that graph quality substantially affects downstream models, with AutoG achieving performance close to human expert-designed graphs and outperforming heuristic baselines. The work provides a practical, self-contained approach to reduce manual feature-engineering in industrial data pipelines, with released code to promote adoption and further research. $\mathcal{G}$ is modeled as a heterogeneous graph, and the approach emphasizes task-aware, automatic schema design that aligns with downstream objectives.

Abstract

Recent years have witnessed significant advancements in graph machine learning (GML), with its applications spanning numerous domains. However, the focus of GML has predominantly been on developing powerful models, often overlooking a crucial initial step: constructing suitable graphs from common data formats, such as tabular data. This construction process is fundamental to applying graph-based models, yet it remains largely understudied and lacks formalization. Our research aims to address this gap by formalizing the graph construction problem and proposing an effective solution. We identify two critical challenges to achieve this goal: 1. The absence of dedicated datasets to formalize and evaluate the effectiveness of graph construction methods, and 2. Existing automatic construction methods can only be applied to some specific cases, while tedious human engineering is required to generate high-quality graphs. To tackle these challenges, we present a two-fold contribution. First, we introduce a set of datasets to formalize and evaluate graph construction methods. Second, we propose an LLM-based solution, AutoG, automatically generating high-quality graph schemas without human intervention. The experimental results demonstrate that the quality of constructed graphs is critical to downstream task performance, and AutoG can generate high-quality graphs that rival those produced by human experts. Our code can be accessible from https://github.com/amazon-science/Automatic-Table-to-Graph-Generation.

AutoG: Towards automatic graph construction from tabular data

TL;DR

AutoG tackles the underexplored problem of constructing graphs from tabular data for graph ML. It formalizes graph-construction as a benchmark with eight real-world datasets and proposes an LLM-based framework that uses a three-module pipeline and chain-of-augmentation to generate augmented graph schemas, guided by an oracle that evaluates downstream task performance. Empirical results show that graph quality substantially affects downstream models, with AutoG achieving performance close to human expert-designed graphs and outperforming heuristic baselines. The work provides a practical, self-contained approach to reduce manual feature-engineering in industrial data pipelines, with released code to promote adoption and further research. is modeled as a heterogeneous graph, and the approach emphasizes task-aware, automatic schema design that aligns with downstream objectives.

Abstract

Recent years have witnessed significant advancements in graph machine learning (GML), with its applications spanning numerous domains. However, the focus of GML has predominantly been on developing powerful models, often overlooking a crucial initial step: constructing suitable graphs from common data formats, such as tabular data. This construction process is fundamental to applying graph-based models, yet it remains largely understudied and lacks formalization. Our research aims to address this gap by formalizing the graph construction problem and proposing an effective solution. We identify two critical challenges to achieve this goal: 1. The absence of dedicated datasets to formalize and evaluate the effectiveness of graph construction methods, and 2. Existing automatic construction methods can only be applied to some specific cases, while tedious human engineering is required to generate high-quality graphs. To tackle these challenges, we present a two-fold contribution. First, we introduce a set of datasets to formalize and evaluate graph construction methods. Second, we propose an LLM-based solution, AutoG, automatically generating high-quality graph schemas without human intervention. The experimental results demonstrate that the quality of constructed graphs is critical to downstream task performance, and AutoG can generate high-quality graphs that rival those produced by human experts. Our code can be accessible from https://github.com/amazon-science/Automatic-Table-to-Graph-Generation.
Paper Structure (43 sections, 24 figures, 6 tables)

This paper contains 43 sections, 24 figures, 6 tables.

Figures (24)

  • Figure 1: Demonstrations of challenges in two selected datasets. Existing heuristic-based methods cannot well tackle C2-C4 in that they require task-specific decisions.
  • Figure 2: An illustration of our proposed AutoG framework.
  • Figure 3: The original schema for the dataset AVS
  • Figure 4: The new schema for dataset AVS with augmented relations
  • Figure 5: Schema for the AutoG IEEE-CIS dataset
  • ...and 19 more figures