Zero and units are excluded because it would generally make factorisation meaningless. For example, we say $6$ has two factors $2$ and $3$. These are the normal forms of the spaces of 2 by a unit, and 3 by a unit.
Were units to be included, the factorisation could be $2\cdot-3\cdot-1$, which suggests three factors. However $-3$ is a variety of $3$, in that each divides the other, and the product with $-1$ divides it without $-1$.
So factorisation is looking for numbers whose product divides the number and vice versa, but any lesser product is not divisible by the number. It is these that function as prime-like things.
The only time one includes units, if if the product of the primes in their normal forms do not give the expressed number, so eg $-6=-1\cdot2\cdot3$.
$0$ is also excluded, simply because it does not divide anything unless it's zero itself. So any non-zero thing is not a product of elements including $0$