The importance of zeros of functions comes into play when you start getting into complex analysis, where instead of dealing with functions of your everyday numbers, you deal with functions of complex numbers. In complex analysis, both zeros and their opposites (called poles, for which $1/f(z)) = 0$) allow you to know almost everything about the function. Pretty much everything you do is either talking about poles or talking about zeros, and from that you can solve much harder problems like finding infinite sums and integrals.
The main idea is that many times you can write a function as a product of other, simpler functions. This is the same as with factorization of polynomials, where you can factor a polynomial in terms of very simple functions like $x^2-1 = (x+1)(x-1)$. Because the right hand side is a product of two functions, it can only be zero when either $x+1=0$ or $x-1=0$.
Going all the way, if you have a nice function $f(z)$ (no poles and differentiable), you can factorize it as $g(z)=f(z) (z-a_1)(z-a_2)...$, where $\{a_i\}$ is a set of complex numbers (possibly repeated), and $f(z)$ is a function with no zeros. In particular, $f(z)$ will be either a constant or a product of $e^{(z^k)}$'s. This is the Weierstrass factorization theorem. A lot of the time however, the $f(z)$ will just be a constant, meaning that most of information needed to define the function is located with where the zeros are, and their multiplicity (the number of repeats of a zero in the above factorization). There are technicalities to worry about, but I'll skip them for clarity.
In the case of the Riemann-Zeta function $\zeta(z)$, the point at which primes and the importance of zeros comes into play is when you write the function as a product. $\zeta(z)$ is defined at the start as:
$$\zeta(z) = \sum_{n=1}^{\infty} \frac{1}{n^z}$$
So $\zeta(2) = 1+\frac{1}{2^2}+\frac{1}{3^2}+\frac{1}{4^2}+...=\frac{\pi^2}{6}$. Making a product out of it gives (after some clever tricks):
$$\zeta(z) = \prod_{\mbox{$p$ prime}} \frac{1}{1-p^{-z}}=\frac{1}{1-2^{-z}}\frac{1}{1-3^{-z}}\frac{1}{1-5^{-z}}...$$
So zeros of the zeta function become related to the prime numbers (although not in a straight forward manner since the factors above are not simple like $(z-c)$). There are more details left out, for instance the definition of $\zeta(z)$ has to be extended here, but this is where it starts.
If you get into complex analysis, you'll be able to solve integrals and sums that you couldn't do otherwise. Like getting that answer of $\frac{\pi^2}{6}$, I found out how that was calculated in a complex analysis class (it involved factorizing $\sin(z)/z$).