Suppose we are asked to prove this one using induction:
$$k! = \int_0^\infty e^{-x}x^{k} dx \,\,\, (*)$$
For $k=0$, it is clear after evaluating the appropriate improper integral that,
$$0! = \int_0^{\infty} e^{-x} dx = 1$$
For the induction case, is it possible just to do this?
Assuming $(*)$ holds now, we just multiply everything by $(k+1)$ to both sides so that we get,
$$k!(k+1) = k\int_0^\infty e^{-x}x^{k} dx + \int_0^\infty e^{-x}x^{k} dx = (k+1)!$$
Therefore by induction, $(*)$ is true for all natural number with zero included. Do we need to even do integration by part here? I thought it is only needed if we want to specifically prove the special recursive relation of Gamma function.
Further steps:
\begin{align}k!(k+1) &= (k+1)! = (k+1)\int_0^\infty e^{-x}x^{k} dx \\ &= -e^{-x}x^{k+1}\Big|_0^{\infty} + (k+1)\int_0^\infty e^{-x}x^{k} dx \\ &= \int_0^\infty e^{-x}x^{k+1} \end{align}