Let two real numbers $a>b$.
The percentage decrease from $a$ to $b$ is $\frac{\Delta}{a}$, and is surely smaller than the percentage increase from $b$ to $a$, $\frac{\Delta}{b}$.
If you want to make "sense" out of the two percentage changes, consider the harmonic mean of $a$ and $b$.
Consider a third real number $c$, such that $a>c>b$. You want the percentage decrease from $a$ to $c$ to be the same as the percentage increase from $b$ to $c$.
$$
\begin{align}
\frac{a-c}{a} &= \frac{c-b}{b} \\
1-\frac{c}{a} &= \frac{c}{b}-1\\
c&= \frac{2}{\frac{1}{a}+\frac{1}{b}}
\end{align}
$$
"Typically, it (harmonic mean) is appropriate for situations when the average of rates is desired."
In your case, the harmonic mean of your speed = $\frac{2}{1/80+1/100}=88.9$
Edit
I can ask a millionaire to give me 100 dollars. I can also give 100 dollars to a beggar with only 20 dollars. You see, although I had the same amount of money, what I asked of the millionaire is insignificant (small percentage decrease), whereas what I did to the beggar is quite the opposite (large percentage increase). This discrepancy in percentage change surely exists.
Now consider the arithmetic mean of the millionaire and beggar (1000020/2=500010 dollars). This number has virtually no meaning at all in reflecting the relative richness or poorness between the two individuals. In very crude terms this mean does not do justice in reflecting the participation of the beggar. The percentage increase of the beggar to this arithmetic mean is surely much larger (and meaningless) than the percentage decrease of the millionaire to this arithmetic mean.
Now try for yourself the harmonic mean: Find the two percentage differences from the harmonic mean to the millionaire and beggar respectively. and see what happens...
Perhaps think of harmonic mean as the useful one, or rather the "meaningful" one in this case
\%to make the $%$ appear. – Arthur Feb 21 '18 at 14:58