Print Email Facebook Twitter A Systematic Literature Review of How Mutation Testing Supports Quality Assurance Processes Title A Systematic Literature Review of How Mutation Testing Supports Quality Assurance Processes Author Zhu, Q. (TU Delft Software Engineering) Panichella, A. (TU Delft Software Engineering) Zaidman, A.E. (TU Delft Software Engineering) Date 2018 Abstract Mutation testing has been very actively investigated by researchers since the 1970s, and remarkable advances have been achieved in its concepts, theory, technology, and empirical evidence. While the most influential realisations have been summarised by existing literature reviews, we lack insight into how mutation testing is actually applied. Our goal is to identify and classify the main applications of mutation testing and analyse the level of replicability of empirical studies related to mutation testing. To this aim, this paper provides a systematic literature review on the application perspective of mutation testing based on a collection of 191 papers published between 1981 and 2015. In particular, we analysed in which quality assurance processes mutation testing is used, which mutation tools and which mutation operators are employed. Additionally, we also investigated how the inherent core problems of mutation testing, ie, the equivalent mutant problem and the high computational cost, are addressed during the actual usage. The results show that most studies use mutation testing as an assessment tool targeting unit tests, and many of the supporting techniques for making mutation testing applicable in practice are still underdeveloped. Based on our observations, we made 9 recommendations for future work, including an important suggestion on how to report mutation testing in testing experiments in an appropriate manner. Subject applicationmutation testingsystematic literature review To reference this document use: http://resolver.tudelft.nl/uuid:8767f68d-cea1-40b1-8933-a34825212860 DOI https://doi.org/10.1002/stvr.1675 Embargo date 2022-07-04 ISSN 1099-1689 Source Software Testing, Verification and Reliability, 28 (6), 1-39 Bibliographical note Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type journal article Rights © 2018 Q. Zhu, A. Panichella, A.E. Zaidman Files PDF Software_Testing_Verif_Re ... uality.pdf 1.09 MB Close viewer /islandora/object/uuid:8767f68d-cea1-40b1-8933-a34825212860/datastream/OBJ/view