Table of Contents
Fetching ...

A two-stage model for factors influencing citation counts

Pablo Dorta-González, Emilio Gómez-Déniz

TL;DR

The study addresses how various document- and context-level factors influence citation counts by employing a two-stage model that separates the probability of zero citations from the intensity of citations once a paper is cited. It combines a negative-binomial regression with a hurdle component, using the mean $\mu_{\mathbf{x}}=\exp(\mathbf{x}^T\boldsymbol{\beta})$ and a zero-probability $\phi(\mathbf{x})=\mathrm{logit}^{-1}(\mathbf{x}^T\boldsymbol{\delta})$, on a large real-world dataset from The Lens with Altmetric indicators. Key findings show that collaboration, funding, and several open-access forms generally increase citation counts, while bronze OA can raise the likelihood of zero citations; social attention metrics have nuanced effects, with Mendeley readership strongly predicting higher counts. The results highlight the value of explicitly modeling zero-citation probability alongside citation intensity for research evaluation and dissemination policy in economics and business.

Abstract

This work aims to study a count response random variable, the number of citations of a research paper, affected by some explanatory variables through a suitable regression model. Due to the fact that the count variable exhibits substantial variation since the sample variance is larger than the sample mean, the classical Poisson regression model seems not to be appropriate. We concentrate attention on the negative binomial regression model, which allows the variance of each measurement to be a function of its predicted value. Nevertheless, the process of citations of papers may be divided into two parts. In the first stage, the paper has no citations, and the second part provides the intensity of the citations. A hurdle model for separating the documents with citations and those without citations is considered. The dataset for the empirical application consisted of 43,190 research papers in the field of Economics and Business from 2014-2021, obtained from The Lens database. Citation counts and social attention scores for each article were gathered from Altmetric database. The main findings indicate that both collaboration and funding have a positive impact on citation counts and reduce the likelihood of receiving zero citations. Higher journal impact factors lead to higher citation counts, while lower peer review ratings lead to fewer citations and a higher probability of zero citations. Mentions in news, blogs, and social media have varying but generally limited effects on citation counts. Open access via repositories (green OA) correlates with higher citation counts and a lower probability of zero citations. In contrast, OA via the publisher's website without an explicit open license (bronze OA) is associated with higher citation counts but also with a higher probability of zero citations.

A two-stage model for factors influencing citation counts

TL;DR

The study addresses how various document- and context-level factors influence citation counts by employing a two-stage model that separates the probability of zero citations from the intensity of citations once a paper is cited. It combines a negative-binomial regression with a hurdle component, using the mean and a zero-probability , on a large real-world dataset from The Lens with Altmetric indicators. Key findings show that collaboration, funding, and several open-access forms generally increase citation counts, while bronze OA can raise the likelihood of zero citations; social attention metrics have nuanced effects, with Mendeley readership strongly predicting higher counts. The results highlight the value of explicitly modeling zero-citation probability alongside citation intensity for research evaluation and dissemination policy in economics and business.

Abstract

This work aims to study a count response random variable, the number of citations of a research paper, affected by some explanatory variables through a suitable regression model. Due to the fact that the count variable exhibits substantial variation since the sample variance is larger than the sample mean, the classical Poisson regression model seems not to be appropriate. We concentrate attention on the negative binomial regression model, which allows the variance of each measurement to be a function of its predicted value. Nevertheless, the process of citations of papers may be divided into two parts. In the first stage, the paper has no citations, and the second part provides the intensity of the citations. A hurdle model for separating the documents with citations and those without citations is considered. The dataset for the empirical application consisted of 43,190 research papers in the field of Economics and Business from 2014-2021, obtained from The Lens database. Citation counts and social attention scores for each article were gathered from Altmetric database. The main findings indicate that both collaboration and funding have a positive impact on citation counts and reduce the likelihood of receiving zero citations. Higher journal impact factors lead to higher citation counts, while lower peer review ratings lead to fewer citations and a higher probability of zero citations. Mentions in news, blogs, and social media have varying but generally limited effects on citation counts. Open access via repositories (green OA) correlates with higher citation counts and a lower probability of zero citations. In contrast, OA via the publisher's website without an explicit open license (bronze OA) is associated with higher citation counts but also with a higher probability of zero citations.

Paper Structure

This paper contains 16 sections, 10 equations, 3 figures, 6 tables.

Figures (3)

  • Figure 1: Empirical and fitted histogram of the number of citations obtained by the model based on the Poisson (P), negative binomial (NB) and hurdle negative binomial (HNB) distributions
  • Figure 2: Box-and-whisker chart of deviance residuals (left panel), probability plot of deviance residuals (center panel) and histogram of the deviance residuals (right panel) based on the NB regression model.
  • Figure 3: Scatter plot of the Pearson's residual against the predicted values: NB (left pannel), HNB (center pannel) and HNB of the restricted model (right pannel) regression models.