[Paper Review] The Quantum Frontier of Software Engineering: A Systematic Mapping Study

Manuel De Stefano, Fabiano Pecorelli+3 more|arXiv (Cornell University)|May 31, 2023

Quantum Computing Algorithms and Architecture4 citations

TL;DR

This systematic mapping study investigates the current state of quantum software engineering (QSE), analyzing 158 studies from 2016 to 2023 to map research trends, tools, and collaboration patterns. It reveals that QSE research is dominated by software testing, primarily using Qiskit, with limited focus on management aspects and strong collaboration clusters among researchers, primarily published in non-thematic conferences.

ABSTRACT

Context. Quantum computing is becoming a reality, and quantum software engineering (QSE) is emerging as a new discipline to enable developers to design and develop quantum programs. Objective. This paper presents a systematic mapping study of the current state of QSE research, aiming to identify the most investigated topics, the types and number of studies, the main reported results, and the most studied quantum computing tools/frameworks. Additionally, the study aims to explore the research community's interest in QSE, how it has evolved, and any prior contributions to the discipline before its formal introduction through the Talavera Manifesto. Method. We searched for relevant articles in several databases and applied inclusion and exclusion criteria to select the most relevant studies. After evaluating the quality of the selected resources, we extracted relevant data from the primary studies and analyzed them. Results. We found that QSE research has primarily focused on software testing, with little attention given to other topics, such as software engineering management. The most commonly studied technology for techniques and tools is Qiskit, although, in most studies, either multiple or none specific technologies were employed. The researchers most interested in QSE are interconnected through direct collaborations, and several strong collaboration clusters have been identified. Most articles in QSE have been published in non-thematic venues, with a preference for conferences. Conclusions. The study's implications are providing a centralized source of information for researchers and practitioners in the field, facilitating knowledge transfer, and contributing to the advancement and growth of QSE.

Motivation & Objective

• To map the current state of quantum software engineering (QSE) research and identify dominant research topics, tools, and trends.
• To analyze the evolution of QSE research and its research community’s collaboration patterns.
• To assess the role of prior contributions before the formal emergence of QSE following the Talavera Manifesto.
• To evaluate the publication venues and quality of QSE studies, particularly focusing on empirical and tool-oriented research.

Proposed method

• Conducted a systematic literature search across multiple databases using predefined keywords related to quantum computing and software engineering.
• Applied inclusion and exclusion criteria to filter relevant studies, resulting in 158 primary studies for analysis.
• Evaluated study quality using predefined criteria to ensure reliability of extracted data.
• Extracted data on research topics, tools/frameworks used (e.g., Qiskit, Cirq), publication venues, collaboration networks, and research focus.
• Performed thematic analysis to categorize studies by research area and identify dominant trends.
• Mapped collaboration networks to identify key research clusters and influential researchers in QSE.

Experimental results

Research questions

• RQ1 What are the most investigated topics in quantum software engineering research between 2016 and 2023?
• RQ2 Which quantum computing tools and frameworks are most frequently used in QSE studies?
• RQ3 How has the QSE research community evolved in terms of collaboration and publication patterns?
• RQ4 What is the role of prior contributions to QSE before the formal introduction of the discipline via the Talavera Manifesto?
• RQ5 In which types of venues are QSE studies primarily published, and how does this reflect the field’s academic positioning?

Key findings

• Software testing is the most investigated topic in QSE research, with the majority of studies focusing on verification, validation, and debugging of quantum programs.
• Qiskit is the most commonly used framework in QSE studies, although many studies employ multiple or no specific technologies.
• The QSE research community is characterized by strong collaboration clusters, with researchers frequently co-authoring papers and forming interconnected research groups.
• Most QSE studies are published in non-thematic conferences rather than specialized journals, indicating a nascent but growing field.
• Research on quantum software engineering management and process-related topics remains underexplored, with limited attention compared to implementation and testing.
• Prior contributions to QSE existed before the Talavera Manifesto, suggesting a gradual emergence of the field rather than a sudden formalization.