MeMo: Automatically identifying metamorphic relations in Javadoc comments for test automation

Download: PDF, implementation.

“MeMo: Automatically identifying metamorphic relations in Javadoc comments for test automation” by Arianna Blasi, Alessandra Gorla, Michael D. Ernst, Mauro Pezzè, and Antonio Carzaniga. Journal of Systems and Software, vol. 181, Nov. 2021.


Software testing depends on effective oracles. Implicit oracles, such as checks for program crashes, are widely applicable but narrow in scope. Oracles based on formal specifications can reveal application-specific failures, but specifications are expensive to obtain and maintain. Metamorphic oracles are somewhere in-between. They test equivalence among different procedures to detect semantic failures. Until now, the identification of metamorphic relations has been a manual and expensive process, except for few specific domains where automation is possible. We present MeMo, a technique and a tool to automatically derive metamorphic equivalence relations from natural language documentation, and we use such metamorphic relations as oracles in automatically generated test cases. Our experimental evaluation demonstrates that 1) MeMo can effectively and precisely infer equivalence metamorphic relations, 2) MeMo complements existing state-of-the-art techniques that are based on dynamic program analysis, and 3) metamorphic relations discovered with MeMo effectively detect defects when used as test oracles in automatically-generated or manually-written test cases.

Download: PDF, implementation.

BibTeX entry:

   author = {Arianna Blasi and Alessandra Gorla and Michael D. Ernst and
	Mauro Pezz{\`e} and Antonio Carzaniga},
   title = {{MeMo}: Automatically identifying metamorphic relations in
	{Javadoc} comments for test automation},
   journal = {Journal of Systems and Software},
   volume = {181},
   month = nov,
   year = {2021}

(This webpage was created with bibtex2web.)

Back to Michael Ernst's publications.