Mutation‐inspired symbolic execution for software testing

Abstract Software testing is a complex and costly stage during the software development lifecycle. Nowadays, there is a wide variety of solutions to reduce testing costs and improve test quality. Focussing on test case generation, Dynamic Symbolic Execution (DSE) is used to generate tests with good...

Full description

Saved in:
Bibliographic Details
Main Authors: Kevin J. Valle‐Gómez, Antonio García‐Domínguez, Pedro Delgado‐Pérez, Inmaculada Medina‐Bulo
Format: Article
Language:English
Published: Wiley 2022-10-01
Series:IET Software
Online Access:https://doi.org/10.1049/sfw2.12063
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849472822248734720
author Kevin J. Valle‐Gómez
Antonio García‐Domínguez
Pedro Delgado‐Pérez
Inmaculada Medina‐Bulo
author_facet Kevin J. Valle‐Gómez
Antonio García‐Domínguez
Pedro Delgado‐Pérez
Inmaculada Medina‐Bulo
author_sort Kevin J. Valle‐Gómez
collection DOAJ
description Abstract Software testing is a complex and costly stage during the software development lifecycle. Nowadays, there is a wide variety of solutions to reduce testing costs and improve test quality. Focussing on test case generation, Dynamic Symbolic Execution (DSE) is used to generate tests with good structural coverage. Regarding test suite evaluation, Mutation Testing (MT) assesses the detection capability of the test cases by introducing minor localised changes that resemble real faults. DSE is however known to produce tests that do not have good mutation detection capabilities: in this paper, the authors set out to solve this by combining DSE and MT into a new family of approaches that the authors call Mutation‐Inspired Symbolic Execution (MISE). First, this known result on a set of open source programs is confirmed: DSE by itself is not good at killing mutants, detecting only 59.9% out of all mutants. The authors show that a direct combination of DSE and MT (naive MISE) can produce better results, detecting up to 16% more mutants depending on the programme, though at a high computational cost. To reduce these costs, the authors set out a roadmap for more efficient versions of MISE, gaining its advantages while avoiding a large part of its additional costs.
format Article
id doaj-art-d9d81697a8b34e779d97ef945b56acf8
institution Kabale University
issn 1751-8806
1751-8814
language English
publishDate 2022-10-01
publisher Wiley
record_format Article
series IET Software
spelling doaj-art-d9d81697a8b34e779d97ef945b56acf82025-08-20T03:24:24ZengWileyIET Software1751-88061751-88142022-10-0116547849210.1049/sfw2.12063Mutation‐inspired symbolic execution for software testingKevin J. Valle‐Gómez0Antonio García‐Domínguez1Pedro Delgado‐Pérez2Inmaculada Medina‐Bulo3Escuela Superior de Ingeniería, Universidad de Cádiz Puerto Real SpainAston University Birmingham West Midlands UKEscuela Superior de Ingeniería, Universidad de Cádiz Puerto Real SpainEscuela Superior de Ingeniería, Universidad de Cádiz Puerto Real SpainAbstract Software testing is a complex and costly stage during the software development lifecycle. Nowadays, there is a wide variety of solutions to reduce testing costs and improve test quality. Focussing on test case generation, Dynamic Symbolic Execution (DSE) is used to generate tests with good structural coverage. Regarding test suite evaluation, Mutation Testing (MT) assesses the detection capability of the test cases by introducing minor localised changes that resemble real faults. DSE is however known to produce tests that do not have good mutation detection capabilities: in this paper, the authors set out to solve this by combining DSE and MT into a new family of approaches that the authors call Mutation‐Inspired Symbolic Execution (MISE). First, this known result on a set of open source programs is confirmed: DSE by itself is not good at killing mutants, detecting only 59.9% out of all mutants. The authors show that a direct combination of DSE and MT (naive MISE) can produce better results, detecting up to 16% more mutants depending on the programme, though at a high computational cost. To reduce these costs, the authors set out a roadmap for more efficient versions of MISE, gaining its advantages while avoiding a large part of its additional costs.https://doi.org/10.1049/sfw2.12063
spellingShingle Kevin J. Valle‐Gómez
Antonio García‐Domínguez
Pedro Delgado‐Pérez
Inmaculada Medina‐Bulo
Mutation‐inspired symbolic execution for software testing
IET Software
title Mutation‐inspired symbolic execution for software testing
title_full Mutation‐inspired symbolic execution for software testing
title_fullStr Mutation‐inspired symbolic execution for software testing
title_full_unstemmed Mutation‐inspired symbolic execution for software testing
title_short Mutation‐inspired symbolic execution for software testing
title_sort mutation inspired symbolic execution for software testing
url https://doi.org/10.1049/sfw2.12063
work_keys_str_mv AT kevinjvallegomez mutationinspiredsymbolicexecutionforsoftwaretesting
AT antoniogarciadominguez mutationinspiredsymbolicexecutionforsoftwaretesting
AT pedrodelgadoperez mutationinspiredsymbolicexecutionforsoftwaretesting
AT inmaculadamedinabulo mutationinspiredsymbolicexecutionforsoftwaretesting