Suppose $X$ and $Y$ are regular schemes (i.e. all local rings are regular) and flat over some base $S$. Assume further that $Y$ has relative dimension $0$ over $S$. Does it follow that $X \times_S Y$ is regular?
I'm really interested only in the special case that $S = Spec \ \mathbb Z$ and $Y = Spec (\mathcal O_L)$ where $\mathcal O_L$ is the ring of integers of a number field, so any suggestions that speak to this case would be most welcome!