I think your way of getting (*) is very nice.
For $c\not=1$, we have
$$\begin{align}F_{\text{min}}&=\begin{cases}(a-bc)^2&\text{if $\ \frac{a-bc}{1-c}\leqslant 0$}
\\\\0&\text{if $\ 0\lt\frac{a-bc}{1-c}\leqslant b$}
\\\\(a-b)^2&\text{if $\ b<\frac{a-bc}{1-c}$}\end{cases}
\\
\\\\F_{\text{max}}&=\begin{cases}(a+b)^2&\text{if $\ c<1$}
\\\\(a+bc)^2&\text{if $\ 1<c$}\end{cases}\end{align}$$
Proof :
Let
$$F(x,y):=\bigg(\sqrt{a^2-x^2}-y\bigg)^2+\bigg(c\sqrt{b^2-y^2}-x\bigg)^2$$
where $-a\leqslant x\leqslant a$ and $-b\leqslant y\leqslant b$.
For every $(X,Y)$ satisfying $X\geqslant 0$ and $Y\geqslant 0$, we have
$$F(X,Y)\leqslant F(-X,Y)\leqslant F(-X,-Y)$$
$$F(X,Y)\leqslant F(X,-Y)\leqslant F(-X,-Y)$$
So, from these, we can say the followings :
To get the minimum, we only need to consider the case where $x\geqslant 0$ and $y\geqslant 0$.
To get the maximum, we only need to consider the case where $x\leqslant 0$ and $y\leqslant 0$.
We have
$$\frac{\partial F}{\partial x}=\frac{2}{\sqrt{a^2-x^2}}\bigg(xy-c\sqrt{b^2-y^2}\sqrt{a^2-x^2}\bigg)$$
So, we get
$$\frac{\partial F}{\partial x}=0\iff x=\pm x_0$$
where $$x_0:=\frac{ac\sqrt{b^2-y^2}}{\sqrt{y^2+c^2(b^2-y^2)}}$$
The minimum :
For $0\leqslant x\leqslant a$, we have $F(x,y)\geqslant F(x_0,y)$.
Then, let
$$g(y):=F(x_0,y)=\bigg(\sqrt{y^2+c^2(b^2-y^2)}-a\bigg)^2\qquad (0\leqslant y\leqslant b)$$
We get
$$g'(y)=\underbrace{\frac{2(1-c^2)^2}{(\sqrt{y^2+c^2(b^2-y^2)}+a)\sqrt{y^2+c^2(b^2-y^2)}}}_{\text{positive}}\bigg(y^2-\frac{a^2-b^2c^2}{1-c^2}\bigg)y$$
Now, we have three cases to consider :
If $\frac{a^2-b^2c^2}{1-c^2}\leqslant 0$, then since $y^2-\frac{a^2-b^2c^2}{1-c^2}\geqslant 0$, we have $g(y)\geqslant g(0)=(a-bc)^2$.
If $\frac{a^2-b^2c^2}{1-c^2}\gt b^2$, then since $y^2-\frac{a^2-b^2c^2}{1-c^2}\leqslant 0$, we have $g(y)\geqslant g(b)=(a-b)^2$.
If $0\lt \frac{a^2-b^2c^2}{1-c^2}\leqslant b^2$, then we have $g(y)\geqslant g\bigg(\sqrt{\frac{a^2-b^2c^2}{1-c^2}}\bigg)=0$.
The maximum :
For $-a\leqslant x\leqslant 0$, we have $F(x,y)\leqslant F(-x_0,y)$.
Then, let
$$i(y):=F(-x_0,y)=\bigg(\sqrt{y^2+c^2(b^2-y^2)}+a\bigg)^2\qquad (-b\leqslant y\leqslant 0)$$
We get
$$i'(y)=\underbrace{\frac{2(\sqrt{y^2+c^2(b^2-y^2)}+a)}{\sqrt{y^2+c^2(b^2-y^2)}}}_{\text{positive}}(1-c^2)y$$
Now, we have two cases to consider :
If $1-c^2\gt 0$, then we have $i(y)\leqslant i(-b)=(a+b)^2$.
If $1-c^2\lt 0$, then we have $i(y)\leqslant i(0)=(a+bc)^2$.
Therefore, we get the conclusion written at the top.$\ \blacksquare$