Let $m,n\in\mathbb{N}$, with $m,n>1$. Suppose $K\in \mathbb{M}_{mn\times mn}(\mathbb{C})$ is positive semidefinite. We can always write
$$K=\sum_{i,j=1}^m E_{i,j}\otimes K_{i,j},$$
for some collection of matrices $K_{i,j}\in \mathbb{M}_{n\times n}(\mathbb{C}) $, where $E_{i,j}\in \mathbb{M}_{m\times m}(\mathbb{C})$ is the matrix with 1 in the entry $(i,j)$ and zeros everywhere else. This amounts to writing $K$ in the block diagonal form
$$\begin{pmatrix} K_{1,1} &\dots &K_{1,m} \\ \vdots &\ddots &\vdots \\ K_{m,1}& \dots & K_{m,m} \end{pmatrix}$$.
Under what conditions can we find a collection of non-square matrices $A_k\in \mathbb{M}_{mn\times n}(\mathbb{C})$ such that $K_{i,j}=A_i^*A_j$ for all $i,j\in \{1,\dots,m \}$?
In other words, when can we write
$$K=\begin{pmatrix} A_1^*A_1 &\dots &A_1^*A_m \\ \vdots &\ddots &\vdots \\ A_m^*A_1& \dots & A_m^*A_m \end{pmatrix}=\begin{pmatrix} A^*_{1}\\ \vdots\\ A^*_{m}\end{pmatrix} \begin{pmatrix} A_{1} &\dots &A_{m} \end{pmatrix}$$
for some collection of matrices $A_k\in \mathbb{M}_{mn\times n}(\mathbb{C})$?