Clearly, there are matrices $M$ for which there exists a vector $v$ such that $\langle v,Mv \rangle=0$ but $M v\ne 0$. In fact, a $90^{\circ}$ rotation in $2D$ has this property for all $v$: $$v^T \left[\begin{matrix}0 & 1 \\ -1 & 0\end{matrix}\right] v \equiv 0$$
What can we say about matrices that don't have this property? Matrices for which $\langle v,Mv \rangle=0 \implies M v=0$. The unit matrix is an example, as is $$\left[\begin{matrix}1 & 0 \\ 0 & 0\end{matrix}\right] $$ so there are non-invertible examples.
How can we check that $\langle v,Mv\rangle=0\implies M v=0$? Does it suffice that $M$ is symmetric/Hermitian?