If you want a direct proof, suppose $b=(e_G,h)\in\{e_G\}\times H$ and $a=(g,k)\in G\times H$. Then $$aba^{-1}=(g,k)(e_G,h)(g^{-1},k^{-1})=(ge_Gg^{-1},khk^{-1}) = (e_G,khk^{-1})$$ recalling that the group structure on $G\times H$ is componentwise, so $(g,h)(g',h'):=(gg',hh')$ and $(g,h)^{-1}=(g^{-1},h^{-1})$. The RHS is clearly in $\{e_G\}\times H$ since $k,h\in H$ implies $khk^{-1}\in H$. Thus your subgroup is normal by the standard definition.
Alternatively if you want to use Hagen's more elegant method, you need to show that $\{e_G\}\times H=\ker\phi$ where $\phi:G\times H\to G$ takes $\phi(g,h)=g$. By definition, \begin{align*}\ker\phi &= \{(g,h)\in G\times H:\phi(g,h)=e_G\}\\&=\{(g,h)\in G\times H:g=e_G\} \\&= \{e_G\}\times H\end{align*} as desired. The first equality is just the definition - the kernel of a homomorphism is the set of all elements that get sent to the identity. Thus since kernels are normal we are done.
\timesas in $G\times H$ – Jordan Glen May 10 '15 at 20:39\times– Jordan Glen May 10 '15 at 20:43