A Quantitative Approach to Estimating Bias, Favouritism and Distortion in Scientific Journalism

TL;DR

Using a corpus from Wired, Quanta Magazine, and New Scientist (2014–2024), the study quantifies bias in scientific journalism via distributional metrics including the Gini coefficient $G$ (a standard measure of inequality) and Zipf-type analyses, as well as topic-frequency and sentiment analysis of titles. It finds pronounced repetition bias and stronger concentration of coverage on living scientists, especially in Quanta, compared with Wired and New Scientist, indicating personality-driven distortion. The work argues for accountability in science communication and provides data and code to enable reproducibility, highlighting implications for transparency, public trust, and epistemic integrity in science. Together, the findings suggest that editorial and narrative choices shape science coverage in ways that can influence which research and researchers gain visibility, with practical implications for funding, policy, and public understanding.

Abstract

While traditionally not considered part of the scientific method, science communication is increasingly playing a pivotal role in shaping scientific practice. Researchers are now frequently compelled to publicise their findings in response to institutional impact metrics and competitive grant environments. This shift underscores the growing influence of media narratives on both scientific priorities and public perception. In a current trend of personality-driven reporting, we examine patterns in science communication that may indicate biases of different types, towards topics and researchers. We focused and applied our methodology to a corpus of media coverage from three of the most prominent scientific media outlets: Wired, Quanta, and The New Scientist -- spanning the past 5 to 10 years. By mapping linguistic patterns, citation flows, and topical convergence, our objective was to quantify the dimensions and degree of bias that influence the credibility of scientific journalism. In doing so, we seek to illuminate the systemic features that shape science communication today and to interrogate their broader implications for epistemic integrity and public accountability in science. We present our results with anonymised journalist names but conclude that personality-driven media coverage distorts science and the practice of science flattening rather than expanding scientific coverage perception. Keywords : selective sourcing, bias, scientific journalism, Quanta, Wired, New Scientist, fairness, balance, neutrality, standard practices, distortion, personal promotion, communication, media outlets.

Figures (7)

• Figure 1: Top 20 Title Words in Wired. Frequent use of terms such as "AI," "quantum," and "data" indicates emphasis on technology-driven narratives.
• Figure 2: Top 20 Title Words in New Scientist. Coverage is more broadly distributed across cosmology, health, and climate-related terms.
• Figure 3: Top 20 Title Words in Quanta. Quanta emphasizes mathematical and foundational science topics, with terms like "theory," "proof," and "quantum" dominating.
• Figure 4: Sentiment of Article Titles by Outlet. VADER compound scores show Quanta and New Scientist framing titles in a more positive tone, while Wired displays more variability and a wider sentiment spread suggesting a more balanced to critical approach. The higher score, the more positive, while the more lower score the more negative.
• Figure 5: Example of individual mention bias from a top 20 scientific anonymised scientific journalist from Quanta. Recent Wired practice of publishing verbatim versions of Quanta articles may be driven Wired's bias towards Quanta.