Efficient mutation analysis by propagating and partitioning infected execution states

Download: PDF, slides (PDF), Major mutation framework and experimental data.

“Efficient mutation analysis by propagating and partitioning infected execution states” by René Just, Michael D. Ernst, and Gordon Fraser. In ISSTA 2014, Proceedings of the 2014 International Symposium on Software Testing and Analysis, (San Jose, CA, USA), July 2014, pp. 315-326.

Abstract

Mutation analysis evaluates a testing technique by measuring how well it detects seeded faults (mutants). Mutation analysis is hampered by inherent scalability problems — a test suite is executed for each of a large number of mutants. Despite numerous optimizations presented in the literature, this scalability issue remains, and this is one of the reasons why mutation analysis is hardly used in practice.

Whereas most previous optimizations attempted to statically reduce the number of executions or their computational overhead, this paper exploits information available only at run time to further reduce the number of executions.

First, state infection conditions can reveal — with a single test execution of the unmutated program — which mutants would lead to a different state, thus avoiding unnecessary test executions. Second, determining whether an infected execution state propagates can further reduce the number of executions. Mutants that are embedded in compound expressions may infect the state locally without affecting the outcome of the compound expression. Third, those mutants that do infect the state can be partitioned based on the resulting infected state — if two mutants lead to the same infected state, only one needs to be executed as the result of the other can be inferred.

We have implemented these optimizations in the Major mutation framework and empirically evaluated them on 14 open source programs. The optimizations reduced the mutation analysis time by 40% on average.

Download: PDF, slides (PDF), Major mutation framework and experimental data.

BibTeX entry:

@inproceedings{JustEF2014,
   author = {Ren{\'e} Just and Michael D. Ernst and Gordon Fraser},
   title = {Efficient mutation analysis by propagating and partitioning
	infected execution states},
   booktitle = {ISSTA 2014, Proceedings of the 2014 International
	Symposium on Software Testing and Analysis},
   pages = {315--326},
   address = {San Jose, CA, USA},
   month = jul,
   year = {2014}
}

(This webpage was created with bibtex2web.)

Back to Michael Ernst's publications.