Let me use a slightly different notation: We have $R' \to R \to M$, where $R$ is $R'$-projective of rank $s$ and $M$ is $R$-projective of rank $r$.
The previous exercise states that
if $M$ is $R$-projective of rank $r$, then for any maximal ideal $m$ of $R$, $\dim_{R/m} M/mM = r$.
Since you already showed that $M$ is $R'$-projective, it suffices to show that for a maximal ideal $m$ of $R'$, $\dim _{R'/m} M/mM = sr$.
The extension $R'/m \to R/ mR$ is integral and $R'/m$ is a field.
Hence $R / mR$ is a finite product of Artinian local rings, and $M /mM$ is a module over this product. Write
$$R/ mR \cong R_1 \times R_2 \times \cdots \times R_q.$$
Here, each $R_i$ is a localization of $R / mR$ at a maximal ideal, and $R_i$ is finite over $R'$.
We conclude that
$\dim_{R'/mR'} R/mR = \sum \dim_{R'/mR'} R_i = s$.
Now, we apply the exercise to $R$ and $M$. As $M$ is $R$-projective, for each maximal ideal $n$ of $R$, $\dim_{R/n} M/ nM = r$.
Let $n_i$ be the maximal ideal which is the kernel of the morphism
$$
R \to R/ mR \cong R_1 \times R_2 \times \cdots \times R_q \to R_i.$$
Then $(R/mR)/ n_i(R/mR) \cong R/n_i R$, and $\dim_{R/{n_i}} M/{n_i}M = r$.
Lastly, we these numbers together. We have that
$M/mM \cong \oplus (R/{n_i})^r$, and
$$\dim_{R'/m} M/mM
= \sum r \dim_{R'/m} R_i = r \sum \dim_{R'/m} R_i = r \dim_{R'/m} R/mR = rs.$$