What's the relationship between statistical significance and sample size? If the sample size is very large, is it better to use a more restrictive or less restrictive alpha? For example, does it make more sense to have an alpha set to .05 or one set to .10 (Remember that it is easier to reject a null hypothesis if the alpha is .10 instead of .05)? What about when the sample size is very small?