A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directions
Abstract Regression testing remains a promising research area for the last few decades. It is a type of testing that aims at ensuring that recent modifications have not adversely affected the software product. After the introduction of a new change in the system under test, the number of test cases...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-04-01
|
| Series: | IET Software |
| Subjects: | |
| Online Access: | https://doi.org/10.1049/sfw2.12104 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850215441203462144 |
|---|---|
| author | Amir Sohail Habib Saif Ur Rehman Khan Ebubeogu Amarachukwu Felix |
| author_facet | Amir Sohail Habib Saif Ur Rehman Khan Ebubeogu Amarachukwu Felix |
| author_sort | Amir Sohail Habib |
| collection | DOAJ |
| description | Abstract Regression testing remains a promising research area for the last few decades. It is a type of testing that aims at ensuring that recent modifications have not adversely affected the software product. After the introduction of a new change in the system under test, the number of test cases significantly increases to handle the modification. Consequently, it becomes prohibitively expensive to execute all of the generated test cases within the allocated testing time and budget. To address this situation, the test suite reduction (TSR) technique is widely used that focusses on finding a representative test suite without compromising its effectiveness such as fault‐detection capability. In this work, a systematic review study is conducted that intends to provide an unbiased viewpoint about TSR based on various types of search algorithms. The study's main objective is to examine and classify the current state‐of‐the‐art approaches used in search‐based TSR contexts. To achieve this, a systematic review protocol is adopted and, the most relevant primary studies (57 out of 210) published between 2007 and 2022 are selected. Existing search‐based TSR approaches are classified into five main categories, including evolutionary‐based, swarm intelligence‐based, human‐based, physics‐based, and hybrid, grounded on the type of employed search algorithm. Moreover, the current work reports the parameter settings according to their category, the type of considered operator(s), and the probabilistic rate that significantly impacts on the quality of the obtained solution. Furthermore, this study describes the comparison baseline techniques that support the empirical comparison regarding the cost‐effectiveness of a search‐based TSR approach. Finally, it isconcluded that search‐based TSR has great potential to optimally solve the TSR problem. In this regard, several potential research directions are outlined as useful for future researchers interested in conducting research in the TSR domain. |
| format | Article |
| id | doaj-art-807620f93e8f4204830872e89dc91f0d |
| institution | OA Journals |
| issn | 1751-8806 1751-8814 |
| language | English |
| publishDate | 2023-04-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Software |
| spelling | doaj-art-807620f93e8f4204830872e89dc91f0d2025-08-20T02:08:36ZengWileyIET Software1751-88061751-88142023-04-011729313610.1049/sfw2.12104A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directionsAmir Sohail Habib0Saif Ur Rehman Khan1Ebubeogu Amarachukwu Felix2Department of Computer Science COMSATS University Islamabad (CUI) Islamabad PakistanDepartment of Computer Science COMSATS University Islamabad (CUI) Islamabad PakistanDepartment of Software Engineering University of Malaya Kuala Lumpur MalaysiaAbstract Regression testing remains a promising research area for the last few decades. It is a type of testing that aims at ensuring that recent modifications have not adversely affected the software product. After the introduction of a new change in the system under test, the number of test cases significantly increases to handle the modification. Consequently, it becomes prohibitively expensive to execute all of the generated test cases within the allocated testing time and budget. To address this situation, the test suite reduction (TSR) technique is widely used that focusses on finding a representative test suite without compromising its effectiveness such as fault‐detection capability. In this work, a systematic review study is conducted that intends to provide an unbiased viewpoint about TSR based on various types of search algorithms. The study's main objective is to examine and classify the current state‐of‐the‐art approaches used in search‐based TSR contexts. To achieve this, a systematic review protocol is adopted and, the most relevant primary studies (57 out of 210) published between 2007 and 2022 are selected. Existing search‐based TSR approaches are classified into five main categories, including evolutionary‐based, swarm intelligence‐based, human‐based, physics‐based, and hybrid, grounded on the type of employed search algorithm. Moreover, the current work reports the parameter settings according to their category, the type of considered operator(s), and the probabilistic rate that significantly impacts on the quality of the obtained solution. Furthermore, this study describes the comparison baseline techniques that support the empirical comparison regarding the cost‐effectiveness of a search‐based TSR approach. Finally, it isconcluded that search‐based TSR has great potential to optimally solve the TSR problem. In this regard, several potential research directions are outlined as useful for future researchers interested in conducting research in the TSR domain.https://doi.org/10.1049/sfw2.12104minimisationoptimisationPareto optimisationparticle swarm optimisationreviewssoftware engineering |
| spellingShingle | Amir Sohail Habib Saif Ur Rehman Khan Ebubeogu Amarachukwu Felix A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directions IET Software minimisation optimisation Pareto optimisation particle swarm optimisation reviews software engineering |
| title | A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directions |
| title_full | A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directions |
| title_fullStr | A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directions |
| title_full_unstemmed | A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directions |
| title_short | A systematic review on search‐based test suite reduction: State‐of‐the‐art, taxonomy, and future directions |
| title_sort | systematic review on search based test suite reduction state of the art taxonomy and future directions |
| topic | minimisation optimisation Pareto optimisation particle swarm optimisation reviews software engineering |
| url | https://doi.org/10.1049/sfw2.12104 |
| work_keys_str_mv | AT amirsohailhabib asystematicreviewonsearchbasedtestsuitereductionstateofthearttaxonomyandfuturedirections AT saifurrehmankhan asystematicreviewonsearchbasedtestsuitereductionstateofthearttaxonomyandfuturedirections AT ebubeoguamarachukwufelix asystematicreviewonsearchbasedtestsuitereductionstateofthearttaxonomyandfuturedirections AT amirsohailhabib systematicreviewonsearchbasedtestsuitereductionstateofthearttaxonomyandfuturedirections AT saifurrehmankhan systematicreviewonsearchbasedtestsuitereductionstateofthearttaxonomyandfuturedirections AT ebubeoguamarachukwufelix systematicreviewonsearchbasedtestsuitereductionstateofthearttaxonomyandfuturedirections |