The question is not if I get a higher die roll or not but the question is "Is the probability that I beat the opponent higher".
Case 1: opponent rolls again on a 1,2,3 and keeps on a 4,5,6
He has a 1 if he rolls a 1, 2 or 3 in the first throw and a 1 in the second. That has a probability of $\frac{3}{6}*\frac{1}{6} = \frac{3}{36}$.
With the same probability he has a 2 or 3.
He has a 4 when he rolls a 4 with the first throw or a 1, 2 or 3 in the first throw and a 4 in the second throw. That has a probability of $\frac{1}{6}+\frac{3}{6}*\frac{1}{6} = \frac{9}{36}$
With the same probability he has a 5 or 6.
That means without throwing new you win when your opponent has a 1, 2 or 3. That has a propability of $\frac{3}{36}+\frac{3}{36}+\frac{3}{36}=\frac{9}{36}=\frac{1}{4}=0.25$
When you throw again you win on a 2-6 if your opponent has a 1 on 3-6 if your opponent has a 2 ...
That has a propability of $\frac{3}{36}*\frac{5}{6}+\frac{3}{36}*\frac{4}{6}+\frac{3}{36}*\frac{3}{6}+\frac{9}{36}*\frac{2}{6}+\frac{9}{36}*\frac{1}{6}+\frac{9}{36}*\frac{0}{6}=\frac{63}{216} = \frac{7}{24}\approx 0.29$
That means you should throw again.
Case 2: opponent rolls again on a 1,2,3,4 and keeps on a 5,6
That means he has a 1/2/3/4/5/6 with a probability of $\frac{4}{36}/\frac{4}{36}/\frac{4}{36}/\frac{4}{36}/\frac{10}{36}/\frac{10}{36}$
Without rethrowing you win with a probability of $\frac{4}{36}+\frac{4}{36}+\frac{4}{36}+\frac{4}{36}=\frac{16}{36}=\frac{4}{9}\approx0.44$.
With rethrowing you win with a propability of $\frac{4}{36}*\frac{5}{6}+\frac{4}{36}*\frac{4}{6}+\frac{4}{36}*\frac{3}{6}+\frac{4}{36}*\frac{2}{6}+\frac{10}{36}*\frac{1}{6}+\frac{10}{36}*\frac{0}{6}=\frac{66}{216} = \frac{11}{36}\approx 0.31$
That means you should not throw again.
Conclusion
The conclusion is that you should do the opposite of what your opponent does to maximize your winning probability.
But you can do the same calculations to show that doing the opposite of your opponent maximize the losing probability also. Only the tying probability decreases.
In fact the losing probability increases the same amount as the winning probability.
If a loss gives the same amount of minus points as the win gives plus points it doesn't matter if you reroll a 4 or not.
If only a win gives points then you should reroll a 4 when your opponents doesn't reroll a 4.