Let's say that I have a submanifold cut out of $\mathbb{R}^{n+k}$ as $f^{-1}(0)$ where $f:\mathbb{R}^{n+k} \rightarrow \mathbb{R}^k$ is smooth and $0$ is a regular value. The Lagrange multiplier criterion tells me that if $x\in f^{-1}(0)$ is a critical point of $g|_{f^{-1}(0)}$ where $g:\mathbb{R}^{n+k} \rightarrow \mathbb{R}$, then there is a linear function $\lambda:\mathbb{R}^k \rightarrow \mathbb{R}$ such that $DG(x) + \lambda DF(x) = 0$. One can use this to probe for critical points of $g$ by first considering solutions of the system of equations $DG(x) + \lambda DF(x) = 0$ and $f(x) = 0$ for varying $\lambda$.
Can you adapt this in a useful way to the scenario where $g$ is a vector valued function? i.e. $g:\mathbb{R}^{n+k} \rightarrow \mathbb{R}^{l}$ and $\lambda:\mathbb{R}^k \rightarrow \mathbb{R}^{l}$
If not, then what is a good approach to computing the sets of critical points of such vector valued functions.