Analysis Design and Validity

Post your commentary, answers, and any follow-up questions/confusions on Canvas the day before the lecture. (See the course website for suggestions regarding style and content.)

Readings

• The Concept of External Validity
• Views on Internal and External Validity in Empirical Software Engineering

Reading questions

1. What are the four types of validity in the (revised) Campbellian validity system? Explain each in one sentence, in your own words.
2. Internal and external validity are at odds (i.e., exhibit a trade-off). Briefly explain why and give an example for that trade-off.
3. Consider experiment and non-experiment designs. Which of the two has higher internal/external validity? Briefly explain why.
4. Argue for or against an emphasis on external validity in your research/work area (briefly indicate the area in your argument).