Suppose $A$ is a square matrix (over $\mathbb{R}$ or $\mathbb{C}$, take your pick) such that $(I-A)^{-1}$ exists. Then is it necessarily true that
$$I + A + A^2 + \dots + A^n + \dots = (I-A)^{-1}$$ ?
There is a well known theorem which claims that if $||A|| \lt 1$ then $(I-A)^{-1}$ exists and the above is true.
What I am asking is something like the converse of that theorem. My hunch is that this is false, but I am unable to come up with a counter-example.