Table of Contents
Fetching ...

Degree-corrected distribution-free model for community detection in weighted networks

Huan Qing

TL;DR

A degree-corrected distribution-free model is proposed for weighted social networks with latent structural information by considering variation in node degree to fit real-world weighted networks, and an algorithm based on the idea of spectral clustering to fit the model is designed.

Abstract

A degree-corrected distribution-free model is proposed for weighted social networks with latent structural information. The model extends the previous distribution-free models by considering variation in node degree to fit real-world weighted networks, and it also extends the classical degree-corrected stochastic block model from un-weighted network to weighted network. We design an algorithm based on the idea of spectral clustering to fit the model. Theoretical framework on consistent estimation for the algorithm is developed under the model. Theoretical results when edge weights are generated from different distributions are analyzed. We also propose a general modularity as an extension of Newman's modularity from un-weighted network to weighted network. Using experiments with simulated and real-world networks, we show that our method significantly outperforms the uncorrected one, and the general modularity is effective.

Degree-corrected distribution-free model for community detection in weighted networks

TL;DR

A degree-corrected distribution-free model is proposed for weighted social networks with latent structural information by considering variation in node degree to fit real-world weighted networks, and an algorithm based on the idea of spectral clustering to fit the model is designed.

Abstract

A degree-corrected distribution-free model is proposed for weighted social networks with latent structural information. The model extends the previous distribution-free models by considering variation in node degree to fit real-world weighted networks, and it also extends the classical degree-corrected stochastic block model from un-weighted network to weighted network. We design an algorithm based on the idea of spectral clustering to fit the model. Theoretical framework on consistent estimation for the algorithm is developed under the model. Theoretical results when edge weights are generated from different distributions are analyzed. We also propose a general modularity as an extension of Newman's modularity from un-weighted network to weighted network. Using experiments with simulated and real-world networks, we show that our method significantly outperforms the uncorrected one, and the general modularity is effective.
Paper Structure (22 sections, 6 theorems, 31 equations, 11 figures, 5 tables, 1 algorithm)

This paper contains 22 sections, 6 theorems, 31 equations, 11 figures, 5 tables, 1 algorithm.

Key Result

Proposition 1

(Identifiability of DCDFM). DCDFM is identifiable for membership matrix: For eligible $(P,Z, \Theta)$ and $(\tilde{P}, \tilde{Z},\tilde{\Theta})$, if $\Theta ZPZ'\Theta=\tilde{\Theta}\tilde{Z}\tilde{P}\tilde{Z}'\tilde{\Theta}$, then $Z=\tilde{Z}$.

Figures (11)

  • Figure 1: Numerical results of Experiments 1-6. y-axis: error rate.
  • Figure 2: For adjacency matrix in panel (a), $\hat{f}(DFA)=0.0833, \hat{f}(nDFA)=0$. For adjacency matrix in panel (b), $\hat{f}(DFA)=0.0417, \hat{f}(nDFA)=0.1250$. For both panels, $R_{E_{Q}(DFA,nDFA)}=1$. x-axis: row nodes; y-axis: column nodes.
  • Figure 3: For both adjacency matrices in panels (a) and (b), error rates for DFA and nDFA are 0. x-axis: row nodes; y-axis: column nodes.
  • Figure 4: For adjacency matrix in panel (a), $\hat{f}(DFA)=0.2500, \hat{f}(nDFA)=0.1250$. For adjacency matrix in panel (b), $\hat{f}(DFA)=0.1250, \hat{f}(nDFA)=0.0833$. For both panels, $R_{E_{Q}(DFA,nDFA)}=1$. x-axis: row nodes; y-axis: column nodes.
  • Figure 5: For adjacency matrix in panel (a), $\hat{f}(DFA)=0.0833, \hat{f}(nDFA)=0.0417$. For adjacency matrix in panel (b), $\hat{f}(DFA)=0, \hat{f}(nDFA)=0$. For panel (a), $R_{E_{Q}(DFA,nDFA)}=1$. x-axis: row nodes; y-axis: column nodes.
  • ...and 6 more figures

Theorems & Definitions (28)

  • Definition 1
  • Remark 1
  • Remark 2
  • Remark 3
  • Remark 4
  • Remark 5
  • Proposition 1
  • proof
  • Lemma 1
  • proof
  • ...and 18 more