I think maybe that you're forgetting the (conditional) expectation in the definition of Fisher Information. One thing that maybe helped lead to this confusion is that the likelihood function in your notes is denoted $\ell(\boldsymbol{\theta})$ rather than $\ell(\mathbf{X};\boldsymbol{\theta})$.
The definition of Fisher Information is:
$$
\mathcal{I}(\boldsymbol{\theta}) = \mathbb{E}(-\frac{\partial^2}{\partial \boldsymbol{\theta}^2}\ell(\mathbf{X};\boldsymbol{\theta})|\boldsymbol{\theta})
$$
We have
$$
\mathbb{E}_{x}( \dfrac{\partial^2 \ell(\mathbf{X};\boldsymbol{\theta})}{\partial\alpha\partial\sigma} | \alpha,\beta,\sigma) = 0
$$ which is clear since $\mathbb{E}_{x_i}( (x_i - \alpha-\beta z_i) | \alpha,\beta,\sigma) = 0$ for all $i$. Likewise $
\mathbb{E}_{x}( \dfrac{\partial^2 \ell(\mathbf{X};\boldsymbol{\theta})}{\partial\beta\partial\sigma} | \alpha,\beta,\sigma) = 0$.
It's easy to show that: $\mathbb{E}(\frac{\partial^2}{\partial\sigma^2}\ell(\mathbf{X};\boldsymbol{\theta})| \alpha,\beta,\sigma)) = \frac{-2n}{\sigma^2}$.