$2i\pi$ is the period of the complex exponential. The inverse of this function is the logarithm, known to have the derivative $\frac1z$. That creates a close connection to the poles of complex functions, which makes $2i\pi$ appear in the residue formula, and corresponds to a phase jump; in geometric terms, a full turn.
In connection with the polar coordinates, it appears in several integrals with circular symmetry.
The latter integral is related to the Gamma function and explains why $\Gamma(\frac12)=\sqrt\pi$. I guess that this is also related to the $\sqrt\pi$ that appears in the Stirling formula for the factorial.
By a factorization process (a consequence of Fubini's theorem ?), $\pi$ ends-up in integrals that generalize those of the circle (area and volume of hyperspheres), with $\pi$ to powers depending on the dimensions (and involving $\Gamma$ of half-integers). This is why you find $\pi$ in some physics formulas having to do with spherical symmetry.
The Basel problem (sum of inverses of squares) can be proven from a factorization of the sine, itself related to the period. The generalization to higher degrees (sum of inverses of even powers) also leads to higher powers of $\pi$, this time together with the Bernouilli numbers.