As an example how this could go wrong "This statement is false" We could proof this statement by contradiction as follows
Assume the statement is false $\implies$ The statement is false $\implies$ the statement is true. Which is a contradiction, hence the statement must be true.
Obviously, the statement being true leads to equally contradictory results, but in mathematics we I have never seen anyone continue to check also what happends if we assume the statement is true. And if we did, it would not be humanly possible to check all possible consequences of a statement being true.
Is there a mathematical axiom that claims that all statements are either true or false, and how can we be sure that this axiom itself does not lead to contradictions?