Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

2023

“Please fix this mutant: How do developers resolve mutants surfaced during code review?”
by Goran Petrović, Marko Ivanković, Gordon Fraser, and René Just.
In Proceedings of the International Conference on Software Engineering (ICSE), May 14-20 2023.
BibTeX. PDF Download.

“On the Applicability of Language Models to Block-Based Programs”
by Elisabeth Griebl, Benedikt Fein, Florian Obermüller, Gordon Fraser, and René Just.
In Proceedings of the International Conference on Software Engineering (ICSE), May 14-20 2023.
BibTeX. PDF Download.

“JUGE: An Infrastructure for Benchmarking Java Unit Test Generators”
by Xavier Devroey, Alessio Gambi, Juan Pablo Galeotti, René Just, Fitsum Meshesha Kifetew, Annibale Panichella, and Sebastiano Panichella.
In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST), Apr 16-20 2023. Journal-first paper.
BibTeX. PDF Download.

2022

“Contextualized Programming Language Documentation”
by Hannah Potter, Ardi Madadi, René Just, and Cyrus Omar.
In Proceedings of the ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!), December 5-10 2022.
BibTeX. PDF Download.

“JUGE: An Infrastructure for Benchmarking Java Unit Test Generators”
by Xavier Devroey, Alessio Gambi, Juan Pablo Galeotti, René Just, Fitsum Meshesha Kifetew, Annibale Panichella, and Sebastiano Panichella.
Software Testing, Verification and Reliability (JSTVR), Dec. 2022.
BibTeX. PDF Download.
A previous version appeared as arXiv preprint arXiv:2106.07520, June 16 2021.

“Prioritizing Mutants to Guide Mutation Testing”
by Samuel J. Kaufman, Ryan Featherman, Justin Alvin, Bob Kurtz, Paul Ammann, and René Just.
In Proceedings of the International Conference on Software Engineering (ICSE), May 25-27 2022, pp. 1743-1754.
BibTeX. PDF Download, Defects4J, Major mutation framework.

“Repairing Brain-Computer Interfaces with Fault-Based Data Acquisition”
by Cailin Winston, Caleb Winston, Chloe N Winston, Claris Winston, Cleah Winston, Rajesh P N Rao, and René Just.
In Proceedings of the International Conference on Software Engineering (ICSE), May 25-27 2022.
BibTeX. PDF Download.

“Apéritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods Descriptions”
by Yuren Pang, Katharina Reinecke, and René Just.
Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI), Apr. 2022, pp. 1-15.
BibTeX. PDF Download.

“Tisane: Authoring Statistical Models via Formal Reasoning from Conceptual and Data Relationships”
by Eunice Jun, Audrey Seo, Jeffrey Heer, and René Just.
Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI), Apr. 2022, pp. 1-25.
BibTeX. PDF Download.

“How do Java mutation tools differ?”
by Domenico Amalfitano, Ana C R Paiva, Alexis Inquel, Luis Pinto, Anna Rita Fasolino, and René Just.
Communications of the ACM (CACM), Jan. 2022, pp. 1-23.
BibTeX. PDF Download.

“Hypothesis formalization: Empirical findings, software limitations, and design implications”
by Eunice Jun, Melissa Birchfield, Nicole De Moura, Jeffrey Heer, and René Just.
ACM Transactions on Computer-Human Interaction (TOCHI), vol. 29, no. 1, Jan. 2022, pp. 1-28.
BibTeX. PDF Download.
A previous version appeared as “Hypothesis Formalization: Empirical Findings, Software Limitations, and Design Implications” by Eunice Jun, Melissa Birchfield, Nicole de Moura, Jeffrey Heer, and René Just. arXiv preprint arXiv:2104.02712, April 06 2021.

2021

“Practical Mutation Testing at Scale: A view from Google”
by Goran Petrović, Marko Ivanković, Gordon Fraser, and René Just.
IEEE Transactions on Software Engineering (TSE), Aug. 2021, pp. 1-13.
BibTeX. PDF Download.
A previous version appeared as “Practical Mutation Testing at Scale” by Goran Petrović, Marko Ivanković, Gordon Fraser, and René Just. arXiv preprint arXiv:2102.11378, February 26 2021.

“Does mutation testing improve testing practices?”
by Goran Petrović, Marko Ivanković, Gordon Fraser, and René Just.
In Proceedings of the International Conference on Software Engineering (ICSE), May 23-29 2021, pp. 910-921.
BibTeX. PDF Download.

“Removing biased data to improve fairness and accuracy”
by Sahil Verma, Michael Ernst, and René Just.
arXiv preprint arXiv:2102.03054, February 5 2021.
BibTeX. PDF Download.

2020

“Defects4J as a Challenge Case for the Search-Based Software Engineering Community”
by Gregory Gay and René Just.
In Proceedings of the International Symposium on Search-Based Software Engineering (SSBSE), Oct. 2020.
BibTeX. PDF Download, Defects4J.

“Revisiting the Relationship Between Fault Detection, Test Adequacy Criteria, and Test Set Size”
by Yiqun T. Chen, Rahul Gopinath, Anita Tadakamalla, Michael D. Ernst, Reid Holmes, Gordon Fraser, Paul Ammann, and René Just.
In Proceedings of the International Conference on Automated Software Engineering (ASE), September 21-25 2020.
BibTeX. PDF Download, MP4 Talk (mp4), Defects4J, Major mutation framework.

“Quality of Automated Program Repair on Real-World Defects”
by Manish Motwani, Mauricio Soto, Yuriy Brun, René Just, and Claire Le Goues.
IEEE Transactions on Software Engineering (TSE), June 2020.
BibTeX. PDF Download.

2019

“Tea: A High-level Language and Runtime System for Automating Statistical Analysis”
by Eunice Jun, Maureen Daum, Jared Roesch, Sarah E Chasins, Emery D Berger, René Just, and Katharina Reinecke.
In Proceedings of the ACM User Interface Software and Technology Symposium (UIST), October 20-23 2019.
BibTeX. PDF Download.
A previous version appeared as arXiv preprint arXiv:1904.05387, April 10 2019.

“Code Coverage at Google”
by Marko Ivanković, Goran Petrović, René Just, and Gordon Fraser.
In Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC/FSE), August 26-30 2019, pp. 955-963.
BibTeX. PDF Download.

“Guiding Testing Effort Using Mutant Utility”
by Justin Alvin, Bob Kurtz, Paul Ammann, Huzefa Rangwala, and René Just.
In Proceedings of the International Conference on Software Engineering (ICSE), May 29-31 2019. Poster.
BibTeX. PDF Download, Defects4J, Major mutation framework.

“Medusa: Mutant Equivalence Detection Using Satisfiability Analysis”
by Benjamin Kushigian, Amit Rawat, and René Just.
In Proceedings of the International Workshop on Mutation Analysis (Mutation), April 22 2019.
BibTeX. PDF Download.

2018

“Do Automated Program Repair Techniques Repair Hard and Important Bugs?”
by Manish Motwani, Sandhya Sankaranarayanan, René Just, and Yuriy Brun.
Empirical Software Engineering Journal (ESEM), vol. 23, no. 5, Oct. 2018, pp. 2901-2947.
BibTeX. PDF Download.

“Comparing Developer-Provided to User-Provided Tests for Fault Localization and Automated Program Repair”
by René Just, Chris Parnin, Ian Drosos, and Michael D. Ernst.
In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), (Amsterdam, Netherlands), July 16-18 2018, pp. 287-297.
BibTeX. PDF Download, Defects4J, Major mutation framework.

“Do Automated Program Repair Techniques Repair Hard and Important Bugs?”
by Manish Motwani, Sandhya Sankaranarayanan, René Just, and Yuriy Brun.
In Proceedings of the International Conference on Software Engineering (ICSE), May 27 2018. Journal-first paper.
BibTeX. PDF Download, Extended abstract.

“An Industrial Application of Mutation Testing: Lessons, Challenges, and Research Directions”
by Goran Petrović, Marko Ivanković, Bob Kurtz, Paul Ammann, and René Just.
In Proceedings of the International Workshop on Mutation Analysis (Mutation), April 9 2018, pp. 47-53.
BibTeX. PDF Download.

2017

“Inferring Mutant Utility from Program Context”
by René Just, Bob Kurtz, and Paul Ammann.
In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), (Santa Barbara, CA, USA), July 10-12 2017, pp. 284-294.
BibTeX. PDF Download, slides(pdf), Defects4J, Major mutation framework.

“Evaluating and improving fault localization”
by Spencer Pearson, José Campos, René Just, Gordon Fraser, Rui Abreu, Michael D. Ernst, Deric Pang, and Benjamin Keller.
In Proceedings of the International Conference on Software Engineering (ICSE), May 20-28 2017, pp. 609-620.
BibTeX. PDF Download, slides(pdf), data and scripts, Defects4J, Major mutation framework.

“Customized Program Mutation: Inferring Mutant Utility from Program Context”
by René Just, Bob Kurtz, and Paul Ammann, University of Massachusetts.
Amherst technical report UM-CS-2017-004, (Amherst, MA, USA), Apr. 2017, pp. 1-17.
BibTeX. PDF Download, Defects4J, Major mutation framework.

“Private API Access and Functional Mocking in Automated Unit Test Generation”
by Andrea Arcuri, Gordon Fraser, and René Just.
In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST), March 13-17 2017, pp. 126-137.
BibTeX. PDF Download.

2016

“Tailored mutants fit bugs better”
by Miltiadis Allamanis, Earl T. Barr, René Just, and Charles Sutton.
arXiv preprint arXiv:1611.02516, Nov. 2016.
BibTeX. PDF Download.

“Evaluating & improving fault localization techniques”
by Spencer Pearson, José Campos, René Just, Gordon Fraser, Rui Abreu, Michael D. Ernst, Deric Pang, and Benjamin Keller.
University of Washington Department of Computer Science and Engineering technical report UW-CSE-16-08-03, (Seattle, WA, USA), Aug. 2016, pp. 1-27.
BibTeX. PDF Download, data and scripts, Defects4J, Major mutation framework.

“Unit testing tool competition: round four”
by Urko Rueda, René Just, Juan P Galeotti, and Tanja EJ Vos.
In Proceedings of the International Workshop on Search-Based Software Testing (SBST), May 2016, pp. 19-28.
BibTeX. PDF Download.

2015

“Do Automatically Generated Unit Tests Find Real Faults? An Empirical Study of Effectiveness and Challenges”
by Sina Shamshiri, René Just, José M. Rojas, Gordon Fraser, Phil McMinn, and Andrea Arcuri.
In Proceedings of the International Conference on Automated Software Engineering (ASE), (Lincoln, NE, USA), November 11-13 2015, pp. 201-211. ACM SIGSOFT Distinguished Paper Award.
BibTeX. PDF Download, subject programs.

“Static analysis of implicit control flow: Resolving Java reflection and Android intents”
by Paulo Barros, René Just, Suzanne Millstein, Paul Vines, Werner Dietl, Marcelo d'Amorim, and Michael D. Ernst.
In Proceedings of the International Conference on Automated Software Engineering (ASE), (Lincoln, NE, USA), November 11-13 2015, pp. 669-679.
BibTeX. PDF Download.

“Static analysis of implicit control flow: Resolving Java reflection and Android intents (extended version)”
by Paulo Barros, René Just, Suzanne Millstein, Paul Vines, Werner Dietl, Marcelo d'Amorim, and Michael D. Ernst.
University of Washington technical report UW-CSE-15-08-01, Aug. 2015.
BibTeX.

“Higher accuracy and lower run time: Efficient mutation analysis using non-redundant mutation operators”
by René Just and Franz Schweiggert.
Software Testing, Verification and Reliability (JSTVR), vol. 25, no. 5-7, Jan. 2015, pp. 490-507.
BibTeX. PDF Download, Major mutation system.

2014

“Are mutants a valid substitute for real faults in software testing?”
by René Just, Darioush Jalali, Laura Inozemtseva, Michael D. Ernst, Reid Holmes, and Gordon Fraser.
In Proceedings of the Symposium on the Foundations of Software Engineering (FSE), (Hong Kong), November 18-20 2014, pp. 654-665. ACM SIGSOFT Distinguished Paper Award.
BibTeX. PDF Download, slides(pdf), subject programs, Major mutation system.
A previous version appeared as University of Washington Department of Computer Science and Engineering technical report UW-CSE-14-02-02, Feb. 2014.

“Collaborative verification of information flow for a high-assurance app store”
by Michael D. Ernst, René Just, Suzanne Millstein, Werner M. Dietl, Stuart Pernsteiner, Franziska Roesner, Karl Koscher, Paulo Barros, Ravi Bhoraskar, Seungyeop Han, Paul Vines, and Edward X. Wu.
In Proceedings of the ACM Conference on Computer and Communications Security (CCS), (Scottsdale, AZ, USA), November 4-6 2014, pp. 1092-1104.
BibTeX. PDF Download, slides(pdf), SPARTA toolset.
A previous version appeared as University of Washington Department of Computer Science and Engineering technical report UW-CSE-14-04-02, Apr. 2014.

“Efficient mutation analysis by propagating and partitioning infected execution states”
by René Just, Michael D. Ernst, and Gordon Fraser.
In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), (San Jose, CA, USA), July 23-25 2014, pp. 315-326. ACM SIGSOFT Distinguished Paper Award.
BibTeX. PDF Download, slides(pdf), Major mutation system.

“The Major mutation framework: Efficient and scalable mutation analysis for Java”
by René Just.
In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), (San Jose, CA, USA), July 23-25 2014, pp. 433-436.
BibTeX. PDF Download, Major mutation system.

“Defects4J: A database of existing faults to enable controlled testing studies for Java programs”
by René Just, Darioush Jalali, and Michael D. Ernst.
In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), (San Jose, CA, USA), July 23-25 2014, pp. 437-440.
BibTeX. PDF Download, Defects4J website.

2013

“Using state infection conditions to detect equivalent mutants and speed up mutation analysis”
by René Just, Michael D. Ernst, and Gordon Fraser.
In Proceedings of the Dagstuhl Seminar 13021: Symbolic Methods in Testing, 2013. arXiv:1303.2784, preprint.
BibTeX. PDF Download.

“On effective and efficient mutation analysis for unit and integration testing”
by René Just.
Ph.D. dissertation, Ulm University, 2013.
BibTeX.

2012

“Using non-redundant mutation operators and test suite prioritization to achieve efficient and scalable mutation analysis”
by René Just, Gregory M Kapfhammer, and Franz Schweiggert.
In Proceedings of the International Symposium on Software Reliability Engineering (ISSRE), November 28-30 2012, pp. 11-20.
BibTeX. PDF Download.

“Do redundant mutants affect the effectiveness and efficiency of mutation analysis?”
by René Just, Gregory M. Kapfhammer, and Franz Schweiggert.
In Proceedings of the International Workshop on Mutation Analysis (Mutation), April 17 2012, pp. 720-725.
BibTeX. PDF Download.

2011

“Automating unit and integration testing with partial oracles”
by René Just and Franz Schweiggert.
Software Quality Journal (SQJ), vol. 19, no. 4, Dec. 2011, pp. 753-769.
BibTeX. PDF Download.

“MAJOR: An efficient and extensible tool for mutation analysis in a Java compiler”
by René Just, Franz Schweiggert, and Gregory M. Kapfhammer.
In Proceedings of the International Conference on Automated Software Engineering (ASE), November 9-11 2011, pp. 612-615.
BibTeX. PDF Download.

“Using conditional mutation to increase the efficiency of mutation analysis”
by René Just, Gregory M. Kapfhammer, and Franz Schweiggert.
In Proceedings of the International Workshop on Automation of Software Test (AST), May 23-24 2011, pp. 50-56.
BibTeX. PDF Download.


(This page was created with bibtex2web.)