By exchangeability of $X_1,X_2,\ldots,X_n$, the $X_1-Y,X_2-Y,\ldots, X_n-Y$ are identically distributed to each other.
Comparing the joint distribution of $(X_1-Y,X_2-Y,\ldots, X_n-Y)$ with that of $(-X_1+Y,-X_2+Y,\ldots, -X_n+Y)$ and using the symmetry of normal distributions, they are each symmetrically distributed about $0$.
They are not independent: for example if $n$ is odd then (with probability $1$) exactly one of $X_1-Y,X_2-Y,\ldots, X_n-Y$ is zero so each has probability $\frac1n$ of being $0$, and exactly half of the others are negative and the rest positive; with even $n$ and taking the median as halfway between the middle two values, exactly half are negative and half positive. So knowing the value of one $X_i-Y$ gives you some information about the distribution of the others.
This also means that with odd $n$ you have $\mathbb P(X_i -Y>0)=\frac{\frac{n-1}2}{n}=\frac12-\frac1{2n}$, while with even $n$ and taking the median as halfway between the middle two values you have $\mathbb P(X_i -Y>0)=\frac{\frac{n}2}{n}=\frac12$.