Analysis Design and Validity

You may find the below reading(s) and reading questions useful when preparing for the corresponding lecture. Posts with follow-up questions or confusions to the course’s Ed board are encouraged – before and/or after the lecture.

Readings

• The Concept of External Validity
• Views on Internal and External Validity in Empirical Software Engineering

Reading questions

1. What are the four types of validity in the (revised) Campbellian validity system? Explain each in one sentence, in your own words.
2. Internal and external validity are at odds (i.e., exhibit a trade-off). Briefly explain why and give an example for that trade-off.
3. Consider experiment and non-experiment designs. Which of the two has higher internal/external validity? Briefly explain why.
4. Argue for or against an emphasis on external validity in your research/work area (briefly indicate the area in your argument).