I'm having some trouble with this question from a practice exam.
Let $G$ be finite group. Suppose for every $g \in G$ other than the identity element $e$, there is a subgroup $H \subset G$ of index $2$ that does not contain $g$.
Show that $g^2 = e$ for all $g \in G$.
My attempt:
Suppose $g \in G$. If $g = e$, obviously $g^2 = e$, so we can assume $g \not= e$. Let $H$ be the subgroup such that $|G:H| = 2$ and $g \not\in H$, which exists by assumption. Since left cosets and right cosets partition $G$, we must have $gH = Hg$, so $H$ is normal.
Since $g^2 \not\in gH$. $g^2H$ and $gH$ are two distinct cosets and partition $G$, and $g^2H = H$. Thus, $H = gHg$. Does this imply that $g = g^{-1}$? I don't think it does, but it looks a bit like conjugation, so maybe there's a theorem that I don't know about.
Or should I be following a different approach?