Print Email Facebook Twitter Fixing Continuous Integration Tests From Within the IDE With Contextual Information Title Fixing Continuous Integration Tests From Within the IDE With Contextual Information Author Boone, Casper (Student TU Delft) Brandt, C.E. (TU Delft Software Engineering) Zaidman, A.E. (TU Delft Software Engineering) Date 2022 Abstract The most common reason for Continuous Integration (CI) builds to break is failing tests. When a build breaks, a developer often has to scroll through hundreds to thousands of log lines to find which test is failing and why. Finding the issue is a tedious process that relies on a developer's experience and increases the cost of software testing. We investigate how presenting different kinds of contextual information about CI builds in the Integrated Development Environment (IDE) impacts the time developers take to fix a broken build. Our IntelliJ plugin TESTAXIS surfaces additional information such as a unique view of the code under test that was changed leading up to the build failure. We conduct a user experiment and show that TESTAXIS helps developers fix failing tests 13.4% to 48.6% faster. The participants found the features of TESTAXIS useful and would incorporate it in their development workflow to save time. With TESTAXIS we set an important step towards removing the need to manually inspect build logs and bringing CI build results to the IDE, ultimately saving developers time. Subject Software TestingContinuous IntegrationDeveloper AssistanceIDE PluginUser Experiment To reference this document use: http://resolver.tudelft.nl/uuid:7dba51ff-c16b-4ae4-a252-6a975ceec23c DOI https://doi.org/10.1145/3524610.3527908 Publisher IEEE Embargo date 2023-01-02 ISBN 978-1-6654-5209-0 Source Proceedings - 30th IEEE/ACM International Conference on Program Comprehension, ICPC 2022: Proceedings Event ICPC 2022, 2022-05-16 → 2022-05-17, Virtual at Pittsburgh, United States Series IEEE International Conference on Program Comprehension, 2022-March Bibliographical note Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type conference paper Rights © 2022 Casper Boone, C.E. Brandt, A.E. Zaidman Files PDF TestAxis_icpc22.pdf 3.69 MB PDF Fixing_Continuous_Integra ... mation.pdf 1.42 MB Close viewer /islandora/object/uuid:7dba51ff-c16b-4ae4-a252-6a975ceec23c/datastream/OBJ1/view