"Unit" means one. "Unit square" is a square with length 1 on each side (restating what you already said: $X$ and $Y$ range from 0 to 1). "Unit circle" is a circle with radius 1. And so forth.
Edit: The words "over" or "on" can be used to refer to the domain of a particular function. This presents an interesting case, because while many of us are familiar with this usage, going through a half-dozen books on my shelf, I can't find any that formally declare/define that usage. As one example, in the Wikipedia article on functions, the word "over" gets used in the middle of an example without prior usage:
The unique function over a set $X$ that maps each element to
itself is called the identity function for $X$.
Likewise for the article on domains which starts using the word "on" in the middle of an example:
For example, the function $f$ defined by $f(x)=1/x$ has no value for
$f(0)$. Thus, the set of all real numbers, $\mathbb R$, cannot be its
domain. In cases like this, the function is either defined on $\mathbb R$\{0} or the "gap is plugged" by explicitly defining $f(0)$.
Another term that might have been used for the question here is support, which is the part of the domain that produces nonzero values for the function.