To simplifiy, try to use $x-1 = t$ and $t\to 0$ in the limit:
$$\lim_{t\to 0} \frac{\sqrt{(1+t)^2+2(1+t)+5-8\sqrt{1+t}}}{\ln(1+t)}\\
=\lim_{t\to 0} \frac{\sqrt{t^2+4t+8(1-\sqrt{1+t})}}{\ln(1+t)}\\
= \lim_{t\to 0} \frac{\sqrt{t^2+4t-8\tfrac{t}{1+\sqrt{1+t}}}}{\ln(1+t)}$$
Now divide by $t$ on both numerator and denominator and rationalise, further use standard limits:
For $t\to 0^+$ we can take $t$ = $\sqrt{t^2}$
$$ \lim_{t\to 0} \frac{\sqrt{1+\tfrac{4(\sqrt{1+t}-1)}{t(1+\sqrt{1+t})}}}{\tfrac{\ln(1+t)}{t}} = \lim_{t\to 0} \frac{\sqrt{1+\tfrac{4t}{t(1+\sqrt{1+t})^2}}}{\tfrac{\ln(1+t)}{t}} = \sqrt{1+1} = \sqrt{2}$$
to get the limit as $\sqrt{2}$
But for $t\to 0^-$, $\sqrt{t^2} = -t$, so the limit will be $-\sqrt 2$
Thus $LHL \neq RHL$ and limit does not exist.