There are several equivalent formulations of the Riemann hypotheses that utilize the big O notation. For example, it is known that $M(x) = O\left(x^{\frac12+\epsilon}\right)$ for all $\epsilon > 0$, where $M(x)$ is the Mertens function is equivalent to the Riemann hypothesis being true.
Since $\epsilon$ can be chosen arbitrarily small, I'm wondering why $O\left(x^{\frac12 + \epsilon}\right)$ is not the same thing as $O\left(x^{\frac12}\right)$?
Using the definition of $O$, we get that if $f(x)=O\left(x^{\frac12+\epsilon}\right)$, then that there is an $M$ such that $|f(x)| \leq M|x^{\frac12+\epsilon}|$ for some $x > x_0$.
Since $\epsilon$ can chosen arbitrarily small, why can't we take the limit of the right-hand side, so that $\lim_{\epsilon \to 0} M|x^{\frac12+\epsilon}| = M|x^{\frac12}|$, which would suggest that $O(x^{\frac12 + \epsilon}) = O(x^{\frac12})$?