There are things called Fermat's near misses. These, according to a regular calculator, are "solutions" to Fermat's Last Theorem. The reason why they're not solutions is simply because there is a limit on how many digits the calculator can display.
I was also pleased to find out that calculators "think" that addition is not associative. In particular, here's a "counterexample":
$(10^{30}+(-10^{30}))+1 \neq 10^{30}+((-10^{30})+1)$
The LHS is $1$ (as one would expect), but the RHS, according to the calculator, is $0$.
Are there any other interesting examples of something like this?