Testing and Debugging Quantum Programs: The Road to 2030
Neilson Carlos Leite Ramalho, Higor Amario de Souza, Marcos Lordello Chaim
TL;DR
The paper addresses the challenge of delivering reliable quantum software in the NISQ era and toward 2030 by surveying current testing and debugging techniques, introducing a conceptual model, and identifying 12 actionable research opportunities. It systematically covers testing strategies (combinatorial, search-based, fuzzing, metamorphic, mutation, coverage), assertions (measurement-based and quantum-based), bug patterns and benchmarks, debugging and program-analysis methods, and the critical role of interfaces between classical and quantum components and the transpilation process. A key contribution is a forward-looking 2030 horizon that maps challenges such as noise, lack of standard architectures, realistic input data, and the oracle problem to concrete research directions, including dynamic circuits and noise-aware testing. The work emphasizes the need for higher-level abstractions, standard quantum architectures (e.g., IEEE P3120), and interdisciplinary education to enable scalable, reliable quantum software as quantum hardware matures.
Abstract
Quantum computing has existed in the theoretical realm for several decades. Recently, quantum computing has re-emerged as a promising technology to solve problems that a classical computer could take hundreds of years to solve. However, there are challenges and opportunities for academics and practitioners regarding software engineering practices for testing and debugging quantum programs. This paper presents a roadmap for addressing these challenges, pointing out the existing gaps in the literature and suggesting research directions. We discuss the limitations caused by noise, the no-cloning theorem, the lack of a standard architecture for quantum computers, among others. Regarding testing, we highlight gaps and opportunities related to transpilation, mutation analysis, input states with hybrid interfaces, program analysis, and coverage. For debugging, we present the current strategies, including classical techniques applied to quantum programs, quantum-specific assertions, and quantum-related bug patterns. We introduce a conceptual model to illustrate concepts regarding the testing and debugging of quantum programs and the relationship between them. Those concepts are used to identify and discuss research challenges to cope with quantum programs through 2030, focusing on the interfaces between classical and quantum computing and on creating testing and debugging techniques that take advantage of the unique quantum computing characteristics.