Sample surveys, experiments, observational studies
Surveys, Experiments, and Observational Studies
Surveys, Experiments, and Observational Studies is a topic in Statistics & Probability in the California Common Core State Standards. It is aligned to Standard S-IC.3, which requires students to recognize the purposes of and differences among sample surveys, experiments, and observational studies.
Surveys estimate a population value, observational studies watch without intervening, and experiments apply a treatment.
Theory
Three kinds of statistical study differ in how data are collected:
- Survey: ask questions of a sample to estimate a population value.
- Observational study: record data without applying a treatment.
- Experiment: impose a treatment and compare groups.
The key distinction:
How to classify a study
- Was a treatment applied? If yes, it's an experiment.
- If only observed/asked, it's observational or a survey.
- Check for random assignment (experiments) vs random sampling (surveys).
- Match the conclusion: causation vs association.
A treatment is imposed, so it is an experiment.
No treatment is applied, so it is observational.
Only a randomized experiment can, because random assignment controls other factors.
Random sampling chooses who is studied (for surveys); random assignment sorts subjects into groups (for experiments).
Common pitfalls
Frequently asked questions
What is an experiment?
A study that applies a treatment and compares groups.
What is an observational study?
One that records data without applying a treatment.
Which study can show causation?
A randomized experiment.
What does an observational study show?
Association, not causation.