a)$|M^2+MN^2|=0$
b) There is a 3x3 non zero matrix $U$ such that $(M^2-MN^2)U$ is a zero matrix
c) There is a 3x3 matrix $U$ such that if $(M^2+MN^2)U$ is a zero matrix then $U$ is a zero matrix.
d) $|M^2+MN^2|\ge 1$
One solution I thought was $$M^2-N^4=O$$
$$(M-N^2)(M+N^2)=O$$
$$M+N^2=O$$ $$M^2+MN^2=O$$ Therefore their determinant is also zero. But I think it’s wrong because when $(M-N^2)(M+N^2)$ is expanded we get $M^2+MN^2-N^2M-N^4$. I know we have $MN=NM$, but that doesn’t satisfy the requirements.
As for the rest of the options, I don’t know how to work them out, at least not until I know this one.
Thanks