Only a partial solution:
I will suppose we are looking for $x$ in the interval $I=(0;+\infty)$.
It is at least easy to show that the system has a unique solution. Consider $f$ and $g$ defined by $f(x)=(x^2+1)\arctan(x)$ and $g(x)=-x\ln(x)$. Then the system is equivalent to $f(x)=g(x)$.
Furthermore, $f''(x)=2\arctan(x)+\dfrac{2x}{x^2+1}$ and $g''(x)=-\dfrac1x$ so that $f$ and $g$ are both respectively strictly convex and strictly concave on $I$. Hence, the equation has at most two solutions on $I$. But, as $\lim\limits_{x \to 0} g(x) = \lim\limits_{x \to 0} f(x) = 0$, there is in fact only one solution in I.
Now, considering $h$, defined on $I$ by $h(x)=\arctan(x)\ln(x)$. Then we see that: $$h'(x)=\dfrac{\arctan{x}}x+\dfrac{\ln{x}}{x^2+1}$$
Hence, the system is equivalent to $h'(x)=0$.
But as $\lim\limits_{x \to 0} h(x) = h(1) = 0$, by Rolle's theorem, we know that the equation has a solution in $(0;1)$.
Furthermore, as $h$ is strictly increasing on $[1;+\infty)$, we can see that this solution corresponds to a global minimum of $h$.
Hence, we can show the existence and uniqueness of the solution and that it is equal to:
$$a=argmin_{x\in I}h(x)$$