Expected value
$$E[X] = \sum_{k=1}^4 [k \times p(k)]$$
where, for each $k, ~p(k)$ will represent the probability of having exactly $k$ distinct numbers, and will equal
$$\frac{N\text{(umerator)}_k}{D\text{(enominator)}}.$$
For all values of $k$,
$$D = 6^4.$$
As the OP indicated,
$N_1 = 6 \times \binom{4}{4} = 6.$
To compute $N_2$ note that you can have either [3 of one number, 1 of a different number] or [2 of one number, 2 of another number].
In the first case, there are $(6 \times 5)$ ways of choosing the two numbers that show and $\binom{4}{1}$ ways of choosing the odd die out. In the second case, superficially, one would imagine that there are [again] $(6 \times 5)$ ways of choosing the two numbers and $\binom{4}{2}$ ways of grouping the 4 dice in pairs. This is wrong, as has already been indicated, because of overcounting. You have to divide the second case by $2$.
A safer way of enumerating the second case is to pretend that one of the dice is green, and the others are red. There are 3 potential partner dice that can be joined with the green die. Once the partnership is made, there are $6$ choices for the [green die + partner] and then $5$ choices for the other partnership.
Therefore
$N_2 = [6 \times 5 \times 4] + [6 \times 5 \times 3] = 210.$
To compute $N_3$, there must be 2 dice that roll the same number and two other dice that roll different numbers. There are $\binom{4}{2}$ ways of deciding which two dice get partnered. Then, there are $6$ choices for which number this partnership will roll.
For the other two dice, although it (wrongly) appears that an overcounting trap is present, similar to the second case for $N_2$, that is false. The easiest way to see this is to pretend that the two single dice are two colors, blue and green.
After one of the 6 numbers is assigned to the partnership, there are then $5$ choices for the blue die and then $4$ [remaining] choices for the green die.
Therefore
$N_3 = \binom{4}{2} \times 6 \times 5 \times 4 = 720.$
To compute $N_4$, simply assume that each die has a different color (e.g red, green, blue, yellow) and that there are 6 choices for the red die, then 5 choices for the green die, then 4 choices for the blue die, and then 3 choices for the yellow die.
Therefore
$N_4 = 6 \times 5 \times 4 \times 3 = 360.$
Before proceeding further, there is a sanity check. There are $6^4$ ways that dice of 4 different colors may be rolled. Therefore, $N_1 + N_2 + N_3 + N_4$ must equal $6^4 = 1296.$
Final answer:
$$\frac{1}{D} \times \sum_{k=1}^4 [k \times N_k] ~=~
\frac{(1 \times 6) + (2 \times 210) + (3 \times 720) + (4 \times 360)}{1296}$$
$$=~ \frac{4026}{1296} ~=~ \frac{671}{216}.$$