We can start with the remainder term of Taylor's theorem. In the case where we approximate $e^1$ by a Taylor series for $e^x$ centered at $0$, we have
$$
e = 1 + \frac1{1!} + \frac{1}{2!} + \frac1{3!} + \dots + \frac1{n!} + \frac{e^\xi}{(n+1)!}
$$
for some $\xi \in [0,1]$. In particular, since $e^x$ is increasing from $0$ to $1$, we know that the remainder term satisfies $R_n \le \frac{e^1}{(n+1)!}$.
But this isn't a very useful formula for the error term, since we're trying to figure out what $e$ is. So let's take a small instance of this formula and use it to get an upper bound on $e$. For example, we can take
$$
e = 1 + \frac1{1!} + \frac1{2!} + \frac{e^{\xi}}{3!} \le 1 + 1 + \frac12 + \frac e6 \implies \frac56 e \le \frac52 \implies e \le 3.
$$
Now we can say that the error term satisfies $R_n \le \frac{e}{(n+1)!} \le \frac{3}{(n+1)!}$.