When we're introduced to $\mathbb{R}^3$ in multivariable calculus, we first think of it as a collection of points. Then we're taught that you can have these things called vectors, which are (equivalence classes of) arrows that start at one point and end up at another.
At this point $\mathbb{R}^3$ is an affine space, not a vector space: for two points $x, y \in \mathbb{R}^3$, the operation $x + y$ is meaningless (my professor likes to say: "You can't add Chicago and New York!") but the operation $x - y$ gives a vector (the vector which points from New York to Chicago). You can also add a point and a vector, which gives you a translated point.
The distinction between the point $(0, 1, 2)$ and the vector $\langle 0, 1, 2 \rangle$ is sometimes made.
But then we quickly move on to treating $\mathbb{R}^3$ as a vector space, where instead of a point $A$, you have vectors starting at the origin with their tip at $A$. For example, parameterized curves such as
$$r(t) = (t, t^2, 3t)$$
are called "vector-valued functions" and not "point-valued functions". So, my question is, what is the reason that we historically don't define two spaces -- $\mathbb{R}^3$ and $\mathbb{R}^3_{\text{affine}}$? (I'm sure there's better notation).
For example, my "point-valued function" $r(t)$ would be a function $\mathbb{R} \rightarrow \mathbb{R}^3_{\text{affine}}$, but its derivative $r'(t)$ (the velocity vector) would be a function $\mathbb{R} \rightarrow \mathbb{R}^3$. What would this make more difficult?
In particular, I know that $\mathbb{R}^3 \iff \mathbb{R}^3_{\text{affine}}$ is a bijection, and that we use this sometimes, but how often in multivariable calculus? If we are using it all the time, then it wouldn't make sense to emphasize the distinction.