It's easy to convince someone that the linear approximation is the best line which approximates a function at a point because everyone learns early that the derivative of a function is just the slope of that function at the point.
However...
Assuming I'd never heard of Taylor series, is there some way you could convince me that $f(a)-f'(a)(x-a) - \frac 12f''(a)(x-a)^2$ is the best quadratic function that describes the function $f$ at the point $x=a$?
Bonus points: How about the best cubic or quartic or quintic or .... approximation?