Let $M$ be a manifold and $p \in M$, then we have the tangent space $T_pM$ that has a basis $\left\{ \left(\frac{\partial}{\partial x^i}\right)_p \right \}$. The cotangent space $T^\ast_p M$ has then a basis $\{ (dx^i)_p \}$.
I'm trying to figure out why the cotangent space has the proposed base. If $V$ is a finite dimensional vector space with base $\{e_1, \dots e_n \}$, then $V^\ast$ has a basis $\{f^1, \dots f^n \}$, where $f^i : V \to \Bbb R$ and $f^i(e_j) = \delta_i^j$.
In the cotangent space case $\{ (dx^i)_p \}$ would be a basis if $$(dx^i)_p\left(\frac{\partial}{\partial x^j}\right)_p = \delta_i^j.$$
Now $(dx^i)_p : T^\ast_p M \to \Bbb R$ is just any linear map so how can I know anything about $(dx^i)_p\left(\frac{\partial}{\partial x^j}\right)_p$ without defining what $(dx^i)_p$ does first?
I'm told that $dx^i$ is "just a notation", but it should apparently be defined to be something in order for this to work out?