Type I and Type II Errors
Type I error
- Probability = (the significance level)
- Example: Concluding a treatment works when it actually doesn't
Type II error
- Probability = (depends on the true parameter value)
- Example: Concluding no treatment effect when the treatment actually works
Summary table:
| True | False | |
|---|---|---|
| Reject | Type I Error () | Correct (Power = ) |
| Fail to reject | Correct | Type II Error () |
Trade-off: Decreasing (being more strict) reduces Type I error risk but increases Type II error risk.