Let us say that we have this following problem:
"A government agency claims that more than 50% of US tax returns were filed electronically last year. A random sample of 150 tax returns for last year contained 86 that were filed electronically. Test the claim at $\alpha = 0.05$ significance level."
In this problem our null hypothesis is: $H_0 : p \leq 0.50$ and $H_a : p > 0.50$. I've calculated the sample proportion : $\frac{x}{n} = \frac{86}{150} = 0.573$ and the standard error: $\sqrt{\frac{p(1-p)}{n}} = 0.0408$. Now my z-score is 1.79 which is greater than $z=1.64$, so I'm "required to reject the null hypothesis." But my question is how do I know that 86 out of 150 is not an unusual sampling to begin with? Why can't we reject the random sampling and support the claim given by $H_0$?
My last question deals with what to do with $H_a$. Once $H_0$ has been rejected do we say that there is "sufficient evidence for $H_a$" or do we say that "$H_a$ is true but under these conditions :"?