In some sense the answer is no, but the reason is somewhat subtler. The issue is that a singularity of a general complex function $f$ is essentially a point where its absolute value is infinity, however, poles are only one particularly well-behaved sort of singularity, and not all singularities are poles.
For instance the function $$f(z)=e^{1/z}$$
is extremely poorly behaved at $z=0$, which you can sort of see by looking at a graph for real $z$. This is an example of an essential singularity, which is a singularity that is not a pole.
Note that this does not contradict the result mentioned in the other answer, because the limit $\lim_{z\to 0} e^{1/z}$ does not exist. Essentially, although $|f(0)|$ "should be" infinity, the limit does not actually exist because, if you pick just the right direction to approach zero (the imaginary axis), then the function actually does not blow up.
In fact, functions can have even worse singularities when they're clumped together, and these are certainly not poles. Examples of these are natural boundaries. You can see more information at the Wikipedia page.