I will propose an elementary proof that depends only on Riemann sums (although in comments there is more simple and elegant one).
First step is to consider $|f|$. Since $f$ is Riemann integrable then $|f|$ is also Riemann integrable and moreover $0 < |\int\limits_0^1 f(x)dx| \le \int\limits_0^1 |f(x)|dx$. So, $\int\limits_0^1 |f(x)|dx > 0$.
In the second step we prove proposition by contradiction. Assume that for all open intervals $I \subset [0,1]$ and for all $\delta > 0$ there exists $x \in I$ s.t. $|f(x)| < \delta$. Now we consider lower Riemann (Darboux) sum that correspond to a partition $0 = x_0 < x_1 < \dots < x_n = 1$:
$$s = \sum\limits_{i = 1}^n (x_i - x_{i-1})\inf\limits_{x \in [x_{i-1}, x_i]}|f(x)|.
$$
From our assumption we have that $\inf\limits_{x \in [x_{i-1}, x_i]}|f(x)| = 0$. Therefore $s = 0$. But lower Riemann sums converge to $\int\limits_0^1 |f(x)|dx$ as partition diameter tends to $0$. Therefore $\int\limits_0^1 |f(x)|dx = 0$. That's a contradiction.