Statistical Tests to Assess Randomized Algorithms

Post your commentary, answers, and any follow-up questions/confusions on Canvas the day before the lecture. (See the course website for suggestions regarding style and content.)

Readings

• A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering

Reading questions

1. Define the following two terms:

   • Effect size
   • Censored data

2. What is the difference between statistical and practical significance?

3. What is the difference between parametric and non-parametric tests?

4. Why is statistical analysis particularly important for randomized algorithms?