Fault detection vs. test adequacy vs. test set size

Post your commentary, answers, and any follow-up questions/confusions on Canvas the day before the lecture. (See the course website for suggestions regarding style and content.)

Readings

• Revisiting the Relationship Between Fault Detection, Test Adequacy Criteria, and Test Set Size

Reading questions

1. Describe the three variables of interest in this paper. Classify each one of them as either dependent variable, independent variable, or covariate. Briefly justify your choice.
2. At a high level, explain the conceptual challenges around studying the three variables of interest, and the issues that arise when attempting to study their relationship in a controlled setting.
3. At a high level, explain multicollinearity and the interpretation issues with the point biserial correlation – focus on the interpretation of using regression/correlation coefficients as effect size.