If you make $S1$ and $S2$ one block, you make their relative speaking positions also fixed. As per question, they can speak in any position as long as $S1$ speaks after $S2$. It is easy to see that $S1$ will speak after $S2$ in half of all permutations and before $S2$ in rest half.
So the answer is $\displaystyle \frac{10!}{2}$.
Edit: on your point about not being convinced on the same. Let's see this way. If $S2$ is in the first position, there are $9!$ ways for arranging rest of the speakers and all are permissible. If $S2$ is in second position, $8$ permissible positions for $S1$ and $8!$ ways for rest of the speakers. Continue with same logic and total number of permutations come to
$9! + 8! \cdot (8 + 7 + 6 + 5 + 4 + 3 + 2 + 1) = 1814400$.