Wikipedia defines support as the subsetset of the domain where the function is not equal to zero (see https://en.wikipedia.org/wiki/Support_(mathematics)).
Therefore, if a real function $f:\ \mathbb{R}\rightarrow\mathbb{R}$ has a finite support, then there's a subset of $\mathbb{R}$ where it is not zero, and everywhere else it is mapped to zero.
E.g. a function $f$ that is equal to $x^{2}+1$ when $|x|<1$ and zero everywhere else, has finite support, since it is non-zero in the set $(-1, 1)$, and zero in $\mathbb{R}\backslash(-1, 1)$. To be precise, the set $(-1, 1)$ is the function's support (supp($f$)).
In your example, you can show that for all functions that vanish at infinity, like $f$, that is $\lim_{x\rightarrow\pm\infty}f=0$, it is true that the intgral
$
\int_{a}^{\infty}f\, dx
$
decreases as $a$ increases ($\exists\delta>0$ such as this is true $\forall a>\delta$), and the same holds for negative infinity. Thus, try assigning to $\eta$
$
\eta= \left\{
\begin{array}{ll}
f, & x\in (-q, q) \\
0, & x\in \mathbb{R}\backslash(-q, q)
\end{array}
\right.
$
so that the integral of their absolute difference $\int_{\mathbb{R}}|f-\eta|\, dx$ decreases as $q$ increases. Hence, you have a function $\Phi(q)=\int_{\mathbb{R}}|f-\eta|\, dx,\ q>0$, that is decreasing. From this point on, try a theorem (e.g. Bolzano's theorem) to show that $\Phi:\ (0, \infty)\rightarrow(0, \max(\Phi))$, is equal to $\epsilon$ at at least one point.