given a finite permutation group $G$ and a list of subgroups of $G$ list1. I want to compute the fixed points of $U$ acting on $G/V$ via right multiplication, where $U, V \in$ list1 (i.e. a submatrix of the table of marks of $G$ ).
If the groups are not too big, one can use $ fix_X( G/V ) = | \{ Y^g : g\in G, X \leq Y^g \}|\cdot [ N_G( Y ) : Y ]$, where $Y^g = g^{-1}Yg$ is the right conjugacy operation of $G$ on its subgroups. My implementation in GAP using this formula works fine.
In my opinion $ | \{ Y^g : g\in G, X \leq Y^g \}| = | \{ ^gX : g\in G, ^gX \leq Y \}| $ holds; $^gX = gXg^{-1}$ being the left conjugcy operation. But using this formula in my GAP code the results are wrong.
Before posting my code: Is there any mistake in the above equality?
if'-cases which could setcano' to true), and (line 866, end of the for loop) discard those double cosets that already are to large. Email me directly if you want to do this and need help. – ahulpke Jan 10 '15 at 19:57AcendingChain(G,V)and then descend the chain and determine fixed cosets and their stabilizers iteratively. If the indices of the chain are too large, see whether one can use maximal subgroups to refine. – ahulpke Jan 11 '15 at 16:36