Enhancing Harmony Search Metaheuristic Algorithm for Coverage Efficiency, Test Suite Reduction, and Running Time in Combinatorial Interaction Testing
Optimization has developed powerful algorithms for solving complex problems efficiently. The effectiveness of these algorithms, also called metaheuristics, largely depends on the capabilities of their search techniques. Combinatorial Interaction Testing (CIT) is an efficient technique for detecting...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11050427/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849428079685926912 |
|---|---|
| author | Aminu Aminu Muazu Ahmad Sobri Hashim |
| author_facet | Aminu Aminu Muazu Ahmad Sobri Hashim |
| author_sort | Aminu Aminu Muazu |
| collection | DOAJ |
| description | Optimization has developed powerful algorithms for solving complex problems efficiently. The effectiveness of these algorithms, also called metaheuristics, largely depends on the capabilities of their search techniques. Combinatorial Interaction Testing (CIT) is an efficient technique for detecting faults caused by interactions among system factors. By systematically covering combinations of input values, CIT can uncover faults that arise from complex interactions. One key aspect of CIT is coverage efficiency, which ensures that the desired interaction coverage is achieved with the fewest possible test cases, optimizing the testing process. Additionally, test suite reduction and execution time plays a crucial role by minimizing the number of test cases and time respectively without significantly compromising critical coverage, thereby improving the overall efficiency of the testing process. The Harmony Search (HS) algorithm is a recent metaheuristic that mimics musicians’ improvisation to create pleasant compositions according to aesthetic standards widely used in different areas continuously adjusts solution variables to find the best outcome. However, several studies show that most metaheuristics including HS face challenges when adjusting parameters to improve their performance. In this paper, we introduce an improved version of Harmony Search, referred to as eHS, and utilize CIT techniques for coverage efficiency, test suite reduction, and execution time. A significant shortcoming of the algorithm is improper arrangement of the harmony memory and inadequate exploitation during improvisation when trying to solve complex problems. In order to improve algorithm efficiency, we specifically embedded one-parameter-at-a-time approach of generating CIT test case within the harmony memory and adjust the improvisation processes to accommodate CIT test suite reduction, execution time, and coverage efficiency performance respectively. Despite HS’s tendency to get stuck in local optima, we dynamically adjust its parameter values in our proposed eHS. The experimental results demonstrate that eHS outperforms the other algorithms for CIT in terms of coverage efficiency and test suite reduction. Specifically, eHS achieved the best CIT interaction coverage efficiency performance with 15 (60.00%) successes out of 25 entries, 30 out of 33 cases (90.91%) for CIT test suite size performance, and unfortunately, 00.00% for CIT execution time performance. This study concludes that eHS emerges as a valuable algorithm for generating CIT test suite. Finally, we proposed a potential possibilities for further exploration of HS for CIT. |
| format | Article |
| id | doaj-art-7fb97b407ea34580a608fb75c4a6f6a0 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-7fb97b407ea34580a608fb75c4a6f6a02025-08-20T03:28:48ZengIEEEIEEE Access2169-35362025-01-011311082811085210.1109/ACCESS.2025.358317611050427Enhancing Harmony Search Metaheuristic Algorithm for Coverage Efficiency, Test Suite Reduction, and Running Time in Combinatorial Interaction TestingAminu Aminu Muazu0https://orcid.org/0000-0001-6789-0579Ahmad Sobri Hashim1https://orcid.org/0000-0002-8128-0854Department of Computing, Faculty of Science, Management, and Computing, Universiti Teknologi PETRONAS, Seri Iskandar, MalaysiaDepartment of Computing, Faculty of Science, Management, and Computing, Universiti Teknologi PETRONAS, Seri Iskandar, MalaysiaOptimization has developed powerful algorithms for solving complex problems efficiently. The effectiveness of these algorithms, also called metaheuristics, largely depends on the capabilities of their search techniques. Combinatorial Interaction Testing (CIT) is an efficient technique for detecting faults caused by interactions among system factors. By systematically covering combinations of input values, CIT can uncover faults that arise from complex interactions. One key aspect of CIT is coverage efficiency, which ensures that the desired interaction coverage is achieved with the fewest possible test cases, optimizing the testing process. Additionally, test suite reduction and execution time plays a crucial role by minimizing the number of test cases and time respectively without significantly compromising critical coverage, thereby improving the overall efficiency of the testing process. The Harmony Search (HS) algorithm is a recent metaheuristic that mimics musicians’ improvisation to create pleasant compositions according to aesthetic standards widely used in different areas continuously adjusts solution variables to find the best outcome. However, several studies show that most metaheuristics including HS face challenges when adjusting parameters to improve their performance. In this paper, we introduce an improved version of Harmony Search, referred to as eHS, and utilize CIT techniques for coverage efficiency, test suite reduction, and execution time. A significant shortcoming of the algorithm is improper arrangement of the harmony memory and inadequate exploitation during improvisation when trying to solve complex problems. In order to improve algorithm efficiency, we specifically embedded one-parameter-at-a-time approach of generating CIT test case within the harmony memory and adjust the improvisation processes to accommodate CIT test suite reduction, execution time, and coverage efficiency performance respectively. Despite HS’s tendency to get stuck in local optima, we dynamically adjust its parameter values in our proposed eHS. The experimental results demonstrate that eHS outperforms the other algorithms for CIT in terms of coverage efficiency and test suite reduction. Specifically, eHS achieved the best CIT interaction coverage efficiency performance with 15 (60.00%) successes out of 25 entries, 30 out of 33 cases (90.91%) for CIT test suite size performance, and unfortunately, 00.00% for CIT execution time performance. This study concludes that eHS emerges as a valuable algorithm for generating CIT test suite. Finally, we proposed a potential possibilities for further exploration of HS for CIT.https://ieeexplore.ieee.org/document/11050427/Optimizationmetaheuristic algorithmharmony searchcombinatorial interaction testingtest suite reductioncoverage efficiency |
| spellingShingle | Aminu Aminu Muazu Ahmad Sobri Hashim Enhancing Harmony Search Metaheuristic Algorithm for Coverage Efficiency, Test Suite Reduction, and Running Time in Combinatorial Interaction Testing IEEE Access Optimization metaheuristic algorithm harmony search combinatorial interaction testing test suite reduction coverage efficiency |
| title | Enhancing Harmony Search Metaheuristic Algorithm for Coverage Efficiency, Test Suite Reduction, and Running Time in Combinatorial Interaction Testing |
| title_full | Enhancing Harmony Search Metaheuristic Algorithm for Coverage Efficiency, Test Suite Reduction, and Running Time in Combinatorial Interaction Testing |
| title_fullStr | Enhancing Harmony Search Metaheuristic Algorithm for Coverage Efficiency, Test Suite Reduction, and Running Time in Combinatorial Interaction Testing |
| title_full_unstemmed | Enhancing Harmony Search Metaheuristic Algorithm for Coverage Efficiency, Test Suite Reduction, and Running Time in Combinatorial Interaction Testing |
| title_short | Enhancing Harmony Search Metaheuristic Algorithm for Coverage Efficiency, Test Suite Reduction, and Running Time in Combinatorial Interaction Testing |
| title_sort | enhancing harmony search metaheuristic algorithm for coverage efficiency test suite reduction and running time in combinatorial interaction testing |
| topic | Optimization metaheuristic algorithm harmony search combinatorial interaction testing test suite reduction coverage efficiency |
| url | https://ieeexplore.ieee.org/document/11050427/ |
| work_keys_str_mv | AT aminuaminumuazu enhancingharmonysearchmetaheuristicalgorithmforcoverageefficiencytestsuitereductionandrunningtimeincombinatorialinteractiontesting AT ahmadsobrihashim enhancingharmonysearchmetaheuristicalgorithmforcoverageefficiencytestsuitereductionandrunningtimeincombinatorialinteractiontesting |