Suppose that two matrices $A$ and $B$ commute. If I delete the $i$th row and $i$th column from each, do they necessarily commute? Does the answer change if we guarantee that $A$ and $B$ are Hermitian?
For example, consider the matrices
$A= \begin{bmatrix} \frac{4}{3} & \frac{1}{3\sqrt{2}} & -\frac{1}{\sqrt{6}} \\ \frac{1}{3\sqrt{2}} & \frac{7}{6} & -\frac{1}{2\sqrt{3}}\\ -\frac{1}{\sqrt{6}} & -\frac{1}{2\sqrt{3}} & \frac{3}{2} \end{bmatrix} $ and $B= \begin{bmatrix} \frac{5}{3} & \frac{\sqrt{2}}{3} & -\frac{\sqrt{2}}{\sqrt{3}} \\ \frac{\sqrt{2}}{3} & \frac{4}{3} & -\frac{1}{\sqrt{3}}\\ -\frac{\sqrt{2}}{\sqrt{3}} & -\frac{1}{\sqrt{3}} & 2 \end{bmatrix} $.
A patient calculation shows that $AB - BA = 0$. Let's construct the truncated matrices $A_r$ and $B_r$ formed by deleting the third column and third row.
Then $A_r= \begin{bmatrix} \frac{4}{3} & \frac{1}{3\sqrt{2}} \\ \frac{1}{3\sqrt{2}} & \frac{7}{6} \end{bmatrix} $ and $B_r= \begin{bmatrix} \frac{5}{3} & \frac{\sqrt{2}}{3} \\ \frac{\sqrt{2}}{3} & \frac{4}{3} \end{bmatrix} $.
Another patient, but faster calculation shows that $A_r B_r - B_r A_r=0$. Then for these particular matrices, the answer to the question is yes.
A similar calculation can be done for the non-Hermitian $A= \begin{bmatrix} \frac{11}{7} & 0 & -\frac{4}{7} \\ -\frac{1}{7} & 1 & \frac{1}{7}\\ -\frac{3}{7} & 0 & \frac{10}{7} \end{bmatrix}$ and $B= \begin{bmatrix} \frac{15}{7} & 0 & -\frac{8}{7} \\ -\frac{2}{7} & 1 & \frac{2}{7}\\ -\frac{6}{7} & 0 & \frac{13}{7} \end{bmatrix}$, again affirming yes for this particular example.
This question has a physical motivation from quantum mechanics, where whether or not two Hermitian matrices commute determines whether or not they are simultaneously observable. I'm imagining the case where we are unable to access a certain state, which would correspond to deleting the row and column corresponding to that state.