You can use the definition of cone generated by some vectors: $\vec H = (h_x, h_y, h_z)$ belongs to the cone generated by $\vec A$, $\vec B$ and $\vec C$ (I assume they are linearly independent) if and only if there are three non-negative real numbers $\lambda, \mu, \eta$ such that $$\vec H = \lambda \vec A + \mu \vec B + \eta \vec C;$$ thus you have to solve the linear system given by the three equations (I assume $\vec A$, $\vec B$, $\vec C$, $\vec H$ are given)
$$h_x = \lambda a_x + \mu b_x + \eta c_x,$$
$$h_y = \lambda a_y + \mu b_y + \eta c_y,$$
$$h_z = \lambda a_z + \mu b_z + \eta c_z.$$
The solutions $\lambda, \mu, \eta$ are non-negative if and only if $\vec H$ belongs to the cone generated by $\vec A$, $\vec B$ and $\vec C$ (and they are all strictly positive iff $\vec H$ belongs to the interior of the cone).