Let $q = Re(a)>0$. Pick any $\epsilon > 0$.
Let $\delta > 0$ (the exact value of which we'll determine later). Since $\lim_{x \to \infty} b(x) = 0$, for large enough $u > 0$ we have $|b(x)| < \delta$ for all $x > u$. Thus,
$$
\left|\int_u^x e^{at} b(t) dt\right| \leq \int_u^x |e^{at} b(t)| dt \leq\int_u^x |e^{at} \cdot \delta| = \leq\int_u^x e^{qt} \cdot \delta = \delta\cdot\frac{e^{qx} - e^{qu}}{q}
$$
therefore
$$
\left|\frac{\int_u^x e^{at} b(t) dt}{e^{ax}}\right| \leq \delta\cdot\frac{e^{qx} - e^{qu}}{qe^{qx}}
$$
Now
$$
\lim_{x \to \infty}\delta\cdot\frac{e^{qx} - e^{qu}}{qe^{qx}} = \frac{\delta}{q}
$$
Let $\delta = \epsilon q$. We have:
$$
\lim_{x \to \infty} \left|\frac{\int_0^x e^{at} b(t) dt}{e^{ax}}\right| \leq \lim_{x \to \infty} \left|\frac{\int_0^u e^{at} b(t) dt}{e^{ax}}\right| + \lim_{x \to \infty} \left|\frac{\int_u^x e^{at} b(t) dt}{e^{ax}}\right| \leq \lim_{x \to \infty} \left|\frac{\int_0^u e^{at} b(t) dt}{e^{ax}}\right| + \lim_{x\to\infty} \delta\cdot\frac{e^{qx} - e^{qu}}{qe^{qx}} = 0 + \epsilon = \epsilon
$$
Since $\epsilon > 0 $ was arbitrary, $\lim_{x \to \infty} \left|\frac{\int_0^x e^{at} b(t) dt}{e^{ax}}\right| = 0$