Observe the following limit:
$$ \lim_{h\to0}\frac{(2+h)^2-4}{h} $$ In order to find limit of this function we assume $h$ tends to zero. But at last we put $h=0$. Why?
Observe the following limit:
$$ \lim_{h\to0}\frac{(2+h)^2-4}{h} $$ In order to find limit of this function we assume $h$ tends to zero. But at last we put $h=0$. Why?
In the expression $$ \frac{(2+h)^2 - 4}{h} \ . $$ you cannot simply substitute $h = 0$ to find the limit at $0$, because you can't divide by $0$.
But when $h \ne 0$ simple algebra tells you that expression is equal to $$ 2 + h \ . $$ which is a polynomial in the variable $h$. Polynomials are continuous functions (you have to prove that) so the limit at $0$ is the value at $0$.
Early in your calculus course you probably don't know that about polynomials so the argument you make is something like "when $h$ is near $0$ we can see directly that $2+h$ is near $2$". There is no argument like that for the original expression, before you simplify algebraically.