Table of Contents
Fetching ...

Who is the root in a syntactic dependency structure?

Ramon Ferrer-i-Cancho, Marta Arias

TL;DR

The paper investigates the root vertex in syntactic dependency trees through the lens of vertex centrality, testing whether roots are central in the free tree and how positional information aids root discovery. It introduces novel spatial centrality scores (D, D', and coverage) and a soft score based on subtree-size moments, showing that local spatial cues can outperform traditional non-spatial measures in reliably ranking and classifying roots across UD and SUD languages. Empirically, the best results come from the new spatial scores, though language-specific anomalies (notably Japanese in SUD) indicate limits and the need for annotation-aware interpretation. The work provides theoretical and empirical foundations toward a universal notion of rootness in networks and motivates integrating centrality-based root priors into unsupervised parsing pipelines.

Abstract

The syntactic structure of a sentence can be described as a tree that indicates the syntactic relationships between words. In spite of significant progress in unsupervised methods that retrieve the syntactic structure of sentences, guessing the right direction of edges is still a challenge. As in a syntactic dependency structure edges are oriented away from the root, the challenge of guessing the right direction can be reduced to finding an undirected tree and the root. The limited performance of current unsupervised methods demonstrates the lack of a proper understanding of what a root vertex is from first principles. We consider an ensemble of centrality scores, some that only take into account the free tree (non-spatial scores) and others that take into account the position of vertices (spatial scores). We test the hypothesis that the root vertex is an important or central vertex of the syntactic dependency structure. We confirm the hypothesis in the sense that root vertices tend to have high centrality and that vertices of high centrality tend to be roots. The best performance in guessing the root is achieved by novel scores that only take into account the position of a vertex and that of its neighbours. We provide theoretical and empirical foundations towards a universal notion of rootness from a network science perspective.

Who is the root in a syntactic dependency structure?

TL;DR

The paper investigates the root vertex in syntactic dependency trees through the lens of vertex centrality, testing whether roots are central in the free tree and how positional information aids root discovery. It introduces novel spatial centrality scores (D, D', and coverage) and a soft score based on subtree-size moments, showing that local spatial cues can outperform traditional non-spatial measures in reliably ranking and classifying roots across UD and SUD languages. Empirically, the best results come from the new spatial scores, though language-specific anomalies (notably Japanese in SUD) indicate limits and the need for annotation-aware interpretation. The work provides theoretical and empirical foundations toward a universal notion of rootness in networks and motivates integrating centrality-based root priors into unsupervised parsing pipelines.

Abstract

The syntactic structure of a sentence can be described as a tree that indicates the syntactic relationships between words. In spite of significant progress in unsupervised methods that retrieve the syntactic structure of sentences, guessing the right direction of edges is still a challenge. As in a syntactic dependency structure edges are oriented away from the root, the challenge of guessing the right direction can be reduced to finding an undirected tree and the root. The limited performance of current unsupervised methods demonstrates the lack of a proper understanding of what a root vertex is from first principles. We consider an ensemble of centrality scores, some that only take into account the free tree (non-spatial scores) and others that take into account the position of vertices (spatial scores). We test the hypothesis that the root vertex is an important or central vertex of the syntactic dependency structure. We confirm the hypothesis in the sense that root vertices tend to have high centrality and that vertices of high centrality tend to be roots. The best performance in guessing the root is achieved by novel scores that only take into account the position of a vertex and that of its neighbours. We provide theoretical and empirical foundations towards a universal notion of rootness from a network science perspective.
Paper Structure (37 sections, 2 theorems, 58 equations, 9 figures, 12 tables)

This paper contains 37 sections, 2 theorems, 58 equations, 9 figures, 12 tables.

Key Result

Corollary 1

Figures (9)

  • Figure 1: (a) The syntactic dependency structure of a sentence. (b) The corresponding rooted tree. (c) The corresponding free tree.
  • Figure 2: All unlabelled trees between 3 and 6 vertices and their canonical names. The trees of the same size are sorted by increasing degree variance. The number in parenthesis next to the tree name is $\left< k^2 \right>$, the 2nd moment of degree about zero (equation \ref{['eq:degree_2nd_moment_zero']}).
  • Figure 3: All unlabelled trees between 3 and 6 vertices, their canonical names and the centers retrieved by the centrality scores on the free tree (the non-spatial scores). The trees of same size are sorted by increasing degree variance. Centers are colored according to the representative of the class that retrieves them: degree centrality (red), eccentricity (green and yellow; green when eccentricity is the only member of the class) and maximum subtree size (orange). For each tree, we show only a representative of the class of equivalence that results from conditioning on both the tree kind and its size.
  • Figure 4: The distribution of sentence length ($n$) given an annotation style over all languages. The frequency of lengths up to $n = 6$ is shown on top of each bar. Notice that the $y$-axis is in logarithmic scale. Only $3.3\%$ of sentences are of length 6 or smaller.
  • Figure 5: The distribution of the mean $\bar{r}$, the mean normalized rank, by means of a combined boxplot and violin plot across languages for each centrality score when using UD (top) and SUD (bottom) annotation style. The mean normalized rank of a score is computed for each language by averaging the normalized rank for that score over all sentences. For each centrality score, black thick lines indicate medians while blue diamonds indicate means. "baseline" refers to the random baseline. The red dashed line indicates the expected normalized rank according to the random baseline (Property \ref{['prop:ranking']}).
  • ...and 4 more figures

Theorems & Definitions (16)

  • proof
  • proof
  • proof
  • proof
  • proof
  • Corollary 1
  • proof
  • Corollary 2
  • proof
  • proof
  • ...and 6 more