Choose the coordinate system so that $A = (0,0)$, $B = (\rho,0)$ and the other three vertices lie in the upper half plane. Identify the plane with complex numbers, the
five sides of the pentagon corresponds to
$$( AB, BC, CD, DE, EA ) \quad\leftrightarrow\quad (\rho,\rho\omega,\rho\omega^2,\rho\omega^3,\rho\omega^4)$$
where $\omega = e^{2\pi i/5}$ is the primitive $5^{th}$ root of unity.
Under this identification,
$$B = AB = \rho,\; C = AB+BC = \rho(1 + \omega)
\quad\text{ and }\quad
M = -\frac12 EA = -\frac{\rho}{2} \omega^4 = -\frac{\rho}{2} \bar{\omega}$$
Since $Z$ lies on the intersection of $AC$ and $BM$, there exists real numbers $\lambda, \mu$ such that
$$AZ = \lambda AC = (1-\mu) AB + \mu AM$$
This impies
$$\frac{Z}{\rho} = \lambda( 1 + \omega) = (1-\mu) - \mu\frac{\bar{\omega}}{2}
= \left[1 - \mu \left( 1 + \frac{\omega + \bar{\omega}}{2} \right)\right] + \frac{\mu}{2}\omega
$$
The square bracket in RHS is clearly a real number. By comparing the real
and imaginary part of the last equality, we get:
$$\lambda = 1 - \mu\left(1 + \frac{\omega + \bar{\omega}}{2} \right) = \frac{\mu}{2}
\implies \lambda = \frac{1}{3 + \omega + \bar{\omega}}
$$
This implies
$$|AB| = \rho
= \left|\frac{AZ}{\lambda(1 + \omega)}\right|
= 3 \left|\frac{3+\omega+\bar{\omega}}{1+\omega}\right|
= 3\left(\frac{3 + 2\cos\frac{2\pi}{5}}{2\cos\frac{\pi}{5}}\right)
= 3\left(\frac{2+\phi}{\phi}\right) = 3\sqrt{5}
$$
edit, and then click theimageicon at the top of your post. – barak manos Mar 11 '16 at 14:09