Suppose $(X_n)_n\geq 1$ are i.i.d. $\mathbb E(X)=\mu$, $\sigma^2= \operatorname{Var}(X)<\infty$. I want to show $$\frac 1 {n(n-1)} \sum_{1\,\leq\, i,j\,\leq\, n,\,\, i\,\neq\, j} X_iX_j\to \mu^2$$ in probability.
Here is what I tried.
Applying Strong law of large number we have $$\frac 1 {n^2} \left( \sum_{1\leq i\leq n} X_i\right)^2\to \mu^2$$ in probability. For all $\epsilon>0$, $\mathbb P(|1/n^2(\sum_{1\leq i\leq n} X_i)^2-\mu^2|\geq\epsilon)\to 0 $. Expand this we have $\mathbb P(|(\sum_{1\leq i,j\leq n, i\neq j} X_iX_j-n(n-1)\mu^2+\sum_{1\leq i\leq n}X_i^2-n\mu^2|\geq n^2\epsilon)\to 0 $. I don't know how to proceed from here. In particular , I'm wondering how to use Var$(X)<\infty$.