A function $f:X\rightarrow Y$ is called invertible if there exists a function $g:Y \rightarrow X$ such that:
$y=f(x)\Leftrightarrow x = g(y)$ for all $x\in X $ and for all $y \in Y$
In this case we call $g$ an inverse(function) of $f$ and write $g=f^{-1}$
I know that the concept of inverse functions can be visualised as follows:

I don't understand why there is a need for a double implication in '$y=f(x)\Leftrightarrow x = g(y)$'.
I thought $y=f(x) \Rightarrow x=g(y)$ would have suffice because:
The implication above means 'If x is mapped to y, then there is a rule such that y is mapped to x'. I feel that this statement completely describes the graphic above. So, what kind of graphic is actually being represented if we do not require that the converse be true too?
In this case, if the implication is true, then surely its converse would be true too (if I can move from left to right, then surely I can return back). Therefore, it is redundant to emphasis that the converse must be true too. What are some examples of functions where the converse is not true?

Now let g(1) = a. Clearly the converse does not hold.
– Jack Yoon Jul 14 '14 at 10:23