There is an elementary phenomenon in differential topology, that I've never quite understood: It is well known that the mapping degree (Brouwer degree) $\operatorname{deg}(f) = \operatorname{deg}(f;y)$, $y \in N$, of a smooth map $f \colon M^n \to N^n$ ($M$ closed, $N$ connected) does not depend on the regular value $y$ used to compute it. So if $f$ is not surjective, one may simply pick a point $y \in N \backslash f(M)$ to conclude that $\operatorname{deg}(f) = \operatorname{deg}(f;y) = \sum_{x \in f^{-1}(y)} \operatorname{sign}(f_*)_x = 0$. But how do I know that for another value $z \in N$ with $f^{-1}(z) \neq \varnothing$ the sum $\sum_{x \in f^{-1}(z)} \operatorname{sign}(f_*)_x$ will actually add up to 0? Choosing $y \in N \backslash f(M)$ to conclude that $\operatorname{deg}(f) = 0$ has always appeared like a kind of "proof by definition" to me (using the quite unnatural definition that every $y \in N \backslash f(M)$ is a regular value, although $f^{-1}(y) = \varnothing$) and I have never understood, why it is allowed to make this kind of argument.
Can anybody help me understand this?