I was trying to find out necessary conditions for it to be true. I was wondering about $f>g$. In fact, a slight modification of the above counter-example is sufficient to get another counter-example for the case $f>g$.
I came up with another counter-example. In fact the difference between two concave functions such that $f>g$ can be convex.
Let $f$ be defined over $\mathbb{R}$,
$$ f(x)= \left\{
\begin{array}{l}
-\vert x \vert^3 \quad\text{if}\quad x\in [-0.25,0.25] \\
-3/16\vert x\vert +1/32 \quad\text{else},
\end{array}
\right. $$
and $g(x)= -x^2$. Then $f$ and $g$ are concave and $f>g$ but $h = f-g$ is convex. You can see an illustration below. I have also illustrated the counter-examples given by Erik M and GLay.


