I read somewhere that if $F:U\in \Bbb{R}^n\to \Bbb{R}^m$ is differentiable at $X$ (where $X\in U$), then there exists an $m \times n$ matrix $A$ such that $$F(X+h)=F(X)+A\circ h+G(h)\|h\|$$ where $G(h)\to 0$ as $h\to 0$ (and as $\|h\|\to 0$). $A$ here is the matrix $F'(X)$.
What does this mean? I only see a weak analogy to differentiation in the form $\lim_{h\to 0}\frac{F(X+h)-F(X)}{h}$. I'm really having problems understanding this.
I'm given to understand that $A\circ h$ is the product of $A$ and $h$ where $h$ is an $n\times 1$ vector belonging to $\Bbb{R}^n$, and that $F(X)+A\circ h$ is the linear approximation of $A(X+h)$ while $G(h)\|h\|$ is the correction factor. Does this have a proof?
Thanks in advance!