You should always test if your software delivers results that are as accurate as you have a right to expect and you should perform any test that you can think of.
Consider the trivial problem of computing an average $$\mu = \frac{a+b}{2}.$$ If $a=6.377$ and $b=6.379$, then obviously $$\mu=6.378.$$ However, if your computer is using base-10 arithmetic and has 4 significant figures, then the computed sum is $$\hat{s} = 12.76$$ because the exact sum $$s = a + b = 12.756$$ has to be rounded to 4 significant figures. The computed average is therefore $$\hat{\mu} = 6.380.$$
We observe that the computed average of $a$ and $b$ is larger than either $a$ or $b$. We conclude that the basic definition is not a viable formula for computing an average. A better formula is $$\mu = a + \frac{b-a}{2},$$ but this formula is still vulnerable to overflow.
In the context of solving ordinary differential equations we typically have a powerful machinery that will allow you to test the quality of the numbers that have been produced. As a small illustration of what is possible, I offer you this link to an answer to a related question.