The idea here is that we have strong notions for why $1$ and $-1$ are different in all kinds of ways, we have a natural ordering on the real numbers by $<$ which is compatible with the field operations: $$a<b\implies a+c<b+c$$
and $$a<b \text{ and } c>0 \implies ac<bc$$
This lead us to the natural consequence that any positive number had 2 square roots, because multiplying a negative times itself just turned itself positive, i.e. the solutions to $x^2=4$ are $2$ and $-2$. We still have a lot of strong other things from the ordered field axioms that distinguish positive and negative.
When we want to add numbers to our system so $x^2=-1$ has a solution, it turns out there is no way to make the complex numbers (The smallest algebraicly closed field containing the reals, i.e. every polynomial equation has a solution) into an ordered field. We could order the complex numbers, but not in a way that is compatible with the arithmetic operations.
So, we invent a symbol as our solution, we call it $i$ and toss it in with our real numbers. Problem: Now we no longer have the nice properties such as every number has an additive inverse, so we have to create a $-i$ as well. Equal problems, we no longer have you can multiply any two numbers and get a number, what's $5\cdot i$? Also you can no longer add two numbers and get a number, what's $5+i$? So we can't just toss in $i$ and call it a day. Instead we take the algebraic closure of $\mathbb{R}\cup \{i\}$, in other words, the smallest set of numbers such that we can do all the usual arithmetic operations and have it work. It turns out this is the complex numbers, all numbers of the form $a+bi$, where $a,b\in \mathbb{R}$
Since there is no order though, as far as all of the equations are concerned, if we swapped out what symbol we called $'i'$ with what our system calls $'-i'$, there would be absolutely no change.
After all, we cannot claim $i>0$ or $i<0$ in a meaningful way, which is how we distinguish positive and negative real numbers
I could start with $\mathbb{R} \cup \{-i\}$, and the system would work identically.
Now, once we add a geometric representation of the complex numbers and identify $i$ as the vertical unit, we get a geometric difference between $i$ and $-i$, that being multiplying by $i$ is a counterclockwise 90 degree angle, whereas $-i$ is a clockwise 90 degree angle. But that's just a visual representation and not inherent to the formulae.