This is not true if $A$ is not convex. Let $A = \{x \in \mathbb R^2 \mid \def\abs#1{\left|#1\right|}\abs x < 1\} \setminus \{0\} \times (-1,0]$, define $f \colon A \to \mathbb R$ by
$$
f(x) = \begin{cases} \mathop{\rm sgn} x_1 \cdot x_1^2 & x_2 < 0\\
0 & x_2 \ge 0 \end{cases}
$$
Then $f$ is differentiable with
$$
Df(x) = \begin{cases} (\mathop{\rm sgn} x_1 \cdot 2x_1, 0) & x_2 < 0\\
0 & x_2 \ge 0
\end{cases}
$$
That is $\abs{{\rm grad}\, f(x)}\le 2$ for all $x \in A$. But for every $\epsilon \in(0,1)$ we have
\begin{align*}
f(\epsilon , \epsilon-1) &= (\epsilon - 1)^2\\
f(-\epsilon, \epsilon - 1) &= -(\epsilon -1)^2
\end{align*}
So
$$
\abs{f(\epsilon, \epsilon-1)-f(-\epsilon, \epsilon-1)} = 2(\epsilon-1)^2 \not\le 2\epsilon.
$$