Yes, you're right about the derivatives (although, as pointed out in the comments and other answers, only for natural derivatives, i.e. differentiating a natural number of times (I guess you can generalise to integers if you keep choosing the right constant term for each antidifferentiation)).
As for the reason why, I like to think of $\sin$ as one part of a whole, namely as one coordinate of circular motion at unit speed along the unit circle in the plane. The velocity is always perpendicular to the position vector, so it rotates at the same rate, but stays $90^\circ$ ahead. The velocity vector rotates in a circular motion, which means that the acceleration does so too, only it's $90^\circ$ ahead of the velocity vector. The jerk vector is $90^\circ$ ahead of the acceleration vector, and so on.