The differentiation of the second term is an application of Leibniz's Rule:
$$\frac{\mathrm{d}}{\mathrm{d}\theta} \left (\int_{a(\theta)}^{b(\theta)} f(x,\theta)\,\mathrm{d}x \right )= f\big(b(\theta),\theta\big)\cdot b'(\theta) \,-\, f\big(a(\theta),\theta \big)\cdot a'(\theta)\,+\, \int_{a(\theta)}^{b(\theta)}\partial_{\theta} f(x,\theta)\,\mathrm{d}x $$
Note that the first two terms come from the fundamental theorem of calculus, whereas the the last one must be proven additionally. It is the last one that you accepted above, and the first two that are unclear:
\begin{align*}
U_t ={}& (S(t)\Phi(x))_t + \frac{d}{dt}\int_0^t S(t-s)F(x, s) ds \\
{}={}& (S(t)\Phi(x))_t + \left(S(t-s)F(x, s)\right)\big|_{s = t} + \int_0^t \frac{d}{dt}S(t-s)F(x, s) ds \\
{}={}& (S(t)\Phi(x))_t + S(0)F(x, t) + \int_0^t AS(t-s)F(x, s) ds \\
\end{align*}
Edit: the rule proved
We are in the case where we have:
$$\phi(\alpha)=\hspace{-4mu}\int\limits_{a(\alpha)}^{b(\alpha)}\hspace{-8mu}f(x,\alpha)\,dx,$$
and need to compute $\phi'(\alpha_0)$, the derivative of $\phi$ with respect to $\alpha$ in the point $\alpha_0$. We first write out the "variation" of $\phi$, that is:
$$\Delta\phi=\phi(\alpha+\Delta\alpha)-\phi(\alpha)=\hspace{-16mu}\int\limits_{a(\alpha+\Delta\alpha)}^{b(\alpha+\Delta\alpha)}\hspace{-20mu}f(x,\alpha+\Delta\alpha)\,dx-\hspace{-4mu}\int\limits_{a(\alpha)}^{b(\alpha)}\hspace{-8mu}f(x,\alpha)\,dx.$$
We split the first integral into three parts:
- The integral from $a(\alpha)$ to $a(\alpha+\Delta\alpha)$, which will have a minus sign since the limits must be swapped to get to it;
- The integral from $a(\alpha)$ to $b(\alpha)$, which we then put together with the $-\phi(\alpha)$;
- The integral from $b(\alpha)$ to $b(\alpha+\Delta\alpha)$.
With that, we get that:
$$\Delta\phi=-\hspace{-16mu}\int\limits_{a(\alpha)}^{a(\alpha+\Delta\alpha)}\hspace{-20mu}f(x,\alpha+\Delta\alpha)\,dx+\hspace{-4mu}\int\limits_{a(\alpha)}^{b(\alpha)}\hspace{-8mu}[\phi(\alpha+\Delta\alpha)-\phi(\alpha)]\,dx+\hspace{-16mu}\int\limits_{b(\alpha)}^{b(\alpha+\Delta\alpha)}\hspace{-20mu}f(x,\alpha+\Delta\alpha)\,dx.$$
By the mean value theorem, the first integral is $f(\xi_1,\alpha+\Delta\alpha)\cdot(a(\alpha+\Delta\alpha)-a(\alpha))$, where $\xi_1\in[a(\alpha),a(\alpha+\Delta\alpha)]$ (or with swapped extremes if $a$ is decreasing in $[\alpha,\alpha+\Delta\alpha]$), and the third integral can be similarly manipulated. We then place the middle term at the end and get:
\begin{align*}
\Delta\phi={}&-(a(\alpha+\Delta\alpha)-a(\alpha))\cdot f(\xi_1,\alpha+\Delta\alpha)+(b(\alpha+\Delta\alpha)-b(\alpha))\cdot f(\xi_2,\alpha+\Delta\alpha)+{} \\
&{}+\hspace{-4mu}\int\limits_{a(\alpha)}^{b(\alpha)}\hspace{-8mu}[\phi(\alpha+\Delta\alpha)-\phi(\alpha)]\,dx.
\end{align*}
What we now want is to compute the limit of $\frac{\Delta\phi}{\Delta\alpha}$ for $\Delta\alpha\to0$. Notice how:
- $\xi_1\to a(\alpha)$ and $\xi_2\to b(\alpha)$, as can be deduced by the constraints of the mean value theorem;
- Supposing $a,b$ are differentiable, the coefficients of the evalued $f$, divided by $\Delta\alpha$, tend to $a'(\alpha),b'(\alpha)$;
- Supposing $f$ is continuous, the $\Delta\alpha$ vanishes when it tends to zero, yielding $f(a(\alpha),\alpha)$ and $f(b(\alpha),\alpha)$;
- Provided the limit can harmlessly pass under the integral, we get the integral of the derivative of $f$ as a last term.
In summary, if nothing goes wrong in the above, we get:
$$\phi'(\alpha)=b'(\alpha)\cdot f(b(\alpha),\alpha)-a'(\alpha)\cdot f(a(\alpha),\alpha)+\hspace{-4mu}\int\limits_{a(\alpha)}^{b(\alpha)}\hspace{-8mu}f_\alpha(x,\alpha)\,dx,$$
as we wanted to prove. $\square$
Proof adapted from Wikipedia.
eqnarrayis frowned upon by many users of TeX.alignor other amsmath environments are better. I took the liberty of changing youreqnarray*to analign*. Also, I added a\bigto lengthen the vertical evaluation bar of $|_{s=t}$. Here is a TeX SX answer with three links elaborating on whyalignand friends are better thaneqnarray. The other answers are also interesting. – MickG Jun 20 '15 at 19:56