I have a dot product defined by a matrix $$ A= \begin{pmatrix} 2 & 0 & 1+i \\ 0 & 3 & -1 \\ 1-i & -1 & 3 \\ \end{pmatrix} $$ and I want to find an orthogonal complement of a subspace $$W=span\{(-i,1,1+i),(-1-i,1,3)\}$$
I think I need to find the null space of $$W.A=0$$ where W is a matrix with row vectors $$(-i,1,1+i)(-1-i,1,3)$$.
The thing is, I am not sure whether to conjugate the vectors of subspace first or not, as I tried and my complement ended up being $$(-3-3i,i,1)$$ but it doesn't seem right.
Can someone give me a general idea how to solve otrthogonal complement of complex subspace when the dot product is defined by a orthogonal matrix?
I'm sorry I am not a native english speaker so using the verb define is maybe not used with matrixes.
– Zuzana Mitterová Feb 27 '18 at 20:03