Why Do Samples Vary?
When we take a sample from a population and compute a statistic (like the mean), different samples give different values. This is called sampling variability.
Key concept: The value of a statistic changes from sample to sample — it is itself a random variable!
Why this matters for inference:
- We observe one sample and compute one statistic
- But our statistic might be higher or lower than the true parameter
- Understanding the pattern of variability lets us quantify our uncertainty
Example: A bag has 100 marbles — 60 red, 40 blue. Five groups each draw 20 marbles:
- Group 1:
- Group 2:
- Group 3:
- Group 4:
- Group 5:
All different! But they cluster around .