Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

How is Testing Related to Single Statement Bugs?

Habibur Rahman, Saqib Ameen

TL;DR

The preliminary findings suggest a weak to moderate correlation, indicating that increased test coverage is somewhat reduce the occurrence of SSBs, however, this relationship is not very strong, emphasizing the need for better tests.

Abstract

In this study, we analyzed the correlation between unit test coverage and the occurrence of Single Statement Bugs (SSBs) in open-source Java projects. We analyzed data from the top 100 Maven-based projects on GitHub, which includes 7824 SSBs. Our preliminary findings suggest a weak to moderate correlation, indicating that increased test coverage is somewhat reduce the occurrence of SSBs. However, this relationship is not very strong, emphasizing the need for better tests. Our study contributes to the ongoing discussion on enhancing software quality and provides a basis for future research into effective testing practices aimed at mitigating SSBs.

How is Testing Related to Single Statement Bugs?

TL;DR

The preliminary findings suggest a weak to moderate correlation, indicating that increased test coverage is somewhat reduce the occurrence of SSBs, however, this relationship is not very strong, emphasizing the need for better tests.

Abstract

In this study, we analyzed the correlation between unit test coverage and the occurrence of Single Statement Bugs (SSBs) in open-source Java projects. We analyzed data from the top 100 Maven-based projects on GitHub, which includes 7824 SSBs. Our preliminary findings suggest a weak to moderate correlation, indicating that increased test coverage is somewhat reduce the occurrence of SSBs. However, this relationship is not very strong, emphasizing the need for better tests. Our study contributes to the ongoing discussion on enhancing software quality and provides a basis for future research into effective testing practices aimed at mitigating SSBs.
Paper Structure (17 sections, 1 equation, 7 figures, 2 tables)

This paper contains 17 sections, 1 equation, 7 figures, 2 tables.

Table of Contents

  1. Introduction
  2. Background and Terminology
  3. Related Work
  4. Methodology
  5. Dataset
  6. Splitting the Dataset By Projects
  7. Cloning Projects
  8. Finding the Distribution of Bugs
  9. Generating Coverage Reports
  10. Getting Release Number
  11. Fetching Report for Particular Release
  12. Identifying SSBs in Covered and Not Covered Parts
  13. Calculating the Correlation Coefficient
  14. Results
  15. How is Testing Related to SSBs?
  16. ...and 2 more sections

Figures (7)

  • Figure 1: Example of a single statement bug before and after the fix.
  • Figure 2: Distribution of SSBs in the top 100 open source Java projects on GitHub using Maven build system
  • Figure 3: An overview of the bug distribution scenarios based on coverage. similar
  • Figure 4: An overview of the complete methodology.
  • Figure 5: A snapshot of the ManySStuBs4J dataset instance.
  • ...and 2 more figures