Consider a set of vectors $S = \{u_1, \dots, u_k\}$ in $\mathbb{R}^n$. (I'm generally interested in scenarios when $k << n$, not sure how much this matters.)
Let $G_k$ denote the Gram matrix of the vectors in $S$, and let $G_{(k-1)}$ denote the Gram matrix of the vectors $S\setminus\{u_k\}$. Is there a way to relate $G_k^{-1}$ to $G_{(k-1)}^{-1}$ in any way? I notice that for the family of vectors I'm considering the topleft $(k-1) \times (k-1)$ block of $G_{k}^{-1}$ is numerically close to $G_{(k-1)}^{-1}$. Is there a way to quantify this closeness?