Vectorially, $X=\Omega\,x$ where $\Omega$ is the matrix made of the elements $\omega^{-kl}$, with $\omega=e^{2i\pi/n}$, which is an $n^{th}$ root of unity. We have to show that $\Omega^{-1}=\dfrac1n\Omega^*$, or $\Omega^*\Omega=nI$.
Taking a row of $\Omega^*$ and a column of $\Omega$, the elements of the product are
$$p_{kl}=\sum_{m=0}^{n-1}\omega^{km}\omega^{-ml}=\sum_{m=0}^{n-1}\left(\omega^{k-l}\right)^m.$$
Now $\omega^{k-l}$ is either $1$ (when $k=l$) or a different root of unity (when $k\ne l$), so that the sum of powers is either $n$ or $0$. Hence, $p_{kl}=n\delta_{kl}$.
The zero sum property is justified by
$$1+\omega+\omega^2+\cdots\omega^{n-1}=\frac{\omega^n-1}{\omega-1}=0$$ for $\omega\ne1$ and $\omega^n=1$.