Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Detection of the papermilling behavior

Igor Podlubny

TL;DR

The paper tackles the problem of papermilling by analyzing Web of Science data to identify distinctive publication-citation dynamics and introduces the $I$-index as a robustness check against mere production of papers. It provides a MATLAB tool to quantify correlations, delays, and growth patterns, and demonstrates the method through a case study on mathematics, plus cross-field examples. The findings highlight that strong publication-citation synchronization, surges in yearly outputs, and low $I$-index values are typical of papermilling, driven in part by incentive structures surrounding promotions and open access economics. The work advocates multi-criteria screening and editor vigilance to mitigate the erosion of scientific integrity across disciplines.

Abstract

Based on the analysis of the data obtainable from the Web of Science publication and citation database, typical signs of possible papermilling behavior are described, quantified, and illustrated by examples. A MATLAB function is provided for the analysis of the outputs from the Web of Science. A new quantitative indicator -- integrity index, or I-index -- is proposed for using it along with standard bibliographic and scientometric indicators. A case study is presented.

Detection of the papermilling behavior

TL;DR

The paper tackles the problem of papermilling by analyzing Web of Science data to identify distinctive publication-citation dynamics and introduces the -index as a robustness check against mere production of papers. It provides a MATLAB tool to quantify correlations, delays, and growth patterns, and demonstrates the method through a case study on mathematics, plus cross-field examples. The findings highlight that strong publication-citation synchronization, surges in yearly outputs, and low -index values are typical of papermilling, driven in part by incentive structures surrounding promotions and open access economics. The work advocates multi-criteria screening and editor vigilance to mitigate the erosion of scientific integrity across disciplines.

Abstract

Based on the analysis of the data obtainable from the Web of Science publication and citation database, typical signs of possible papermilling behavior are described, quantified, and illustrated by examples. A MATLAB function is provided for the analysis of the outputs from the Web of Science. A new quantitative indicator -- integrity index, or I-index -- is proposed for using it along with standard bibliographic and scientometric indicators. A case study is presented.
Paper Structure (13 sections, 10 figures)

This paper contains 13 sections, 10 figures.

Table of Contents

  1. Introduction
  2. The good intentions...
  3. … and what happened
  4. The data source
  5. Papermilling behavior: visual signs
  6. Basic quantitative indicators of the papermilling behavior
  7. Integrity index
  8. The MATLAB function
  9. A case study
  10. Reasons for the papermilling behavior
  11. Papermilling behavior in other fields
  12. What made the papermilling behavior possible?
  13. Conclusion

Figures (10)

  • Figure 1: Typical performance of a conscientious mathematician.
  • Figure 2: Typical visual signs of possible papermilling in mathematics.
  • Figure 3: Integrity index versus correlation between the time series of papers and citations
  • Figure 4: Integrity, correlation between papers and citations, and maximum number of papers in one year.
  • Figure 5: Integrity index versus total number of papers, along with the power-law fit.
  • ...and 5 more figures