Imagine a small disk floating in a river, perhaps it's a cork or something.

As the water brushes against it a torque is induced. Let's see if we can figure out what the net torque is. First we need to know the force at a given point on the circumference. What we need to look at is the relative velocity of the point with respect to the center. If the center of the cork is $(x, y)$, our point is $(x + \Delta x, y + \Delta y)$, and the velocity field is denoted by $F$, then the relative velocity is: $$F(x + \Delta x, y + \Delta y) - F(x, y)$$

Now for small $\Delta x$ and $\Delta y$ this is approximately equal to the jacobian matrix of $F$ times the vector $(\Delta x, \Delta y)$: $$\begin{pmatrix}\partial_xF_x & \partial_yF_x \\ \partial_xF_y & \partial_yF_y\end{pmatrix}\begin{pmatrix}\Delta x \\ \Delta y\end{pmatrix} = \begin{pmatrix}\partial_xF_x\Delta x + \partial_yF_x\Delta y \\ \partial_xF_y\Delta x + \partial_yF_y\Delta y\end{pmatrix}$$
Now divide the circumference of the cork into a fixed number of arcs.

We will approximate the force on an arc as the relative velocity of the water at the center point of the arc times the length of the arc, which we'll call $\ell$, times some proportionality constant. By changing units we can always make the proportionality constant 1 so we will ignore it.
Now we need the component of the force which is perpendicular to the radius connecting the center of our cork to the center of our arc. To get this we just need to project our force onto $(-\Delta y, \Delta x)$. Then multiplying by the length of the level arm, ie the radius of our cork, which we'll call r, we get the torque contributed by that arc:
$$\begin{align}\tau &= \left(\begin{pmatrix}-\Delta y \\ \Delta x\end{pmatrix} \cdot \begin{pmatrix}\partial_xF_x\Delta x + \partial_yF_x\Delta y \\ \partial_xF_y\Delta x + \partial_yF_y\Delta y\end{pmatrix}\right)\ell r \\ &= (\partial_xF_y\Delta x^2 + \partial_yF_y\Delta x\Delta y - \partial_xF_x\Delta x\Delta y - \partial_yF_x\Delta y^2)\ell r\end{align}$$
Then just sum up the torque contribution of each arc: $$\tau = \sum_i \tau_i$$
The next step is to make our approximation better by increasing the number of arcs. First turn $\Delta x$ and $\Delta y$ into $r\cos(\theta)$ and $r\sin(\theta)$ respectively. Turn that sum into an integral, and turn the length of each arc $\ell$ into $rd\theta$ and integrate from $0$ to $2\pi$.
$$\tau = \int_0^{2\pi}\left[\partial_yF_x(r\cos(\theta))^2 + \partial_yF_y(r\cos(\theta))(r\sin(\theta)) - \partial_xF_x(r\cos(\theta))(r\sin(\theta)) - \partial_xF_y(r\sin(\theta))^2\right]r^2d\theta$$
Now that looks like quite the monster, but it's a lot easier to integrate than you'd think. the two terms in the middle just come out to $0$. and the $\cos^2(\theta)$ and $\sin^2(\theta)$ just turn into $\pi$. So we're left with: $$\tau = \pi r^2(\partial_yF_x - \partial_xF_y)$$
Now obviously $\pi r^2$ is just the area of our cork and the bit on the right is the z-component of the curl of $F$. So the relationship you were looking for is that the curl is the torque per unit area that a small cork will feel in a velocity field $F$.
Now it's easy to extend this to 3d. Imagine a ball instead of a disk, totally submerged in a river. The same basic argument can be applied in the 3 coordinate planes and you will get the 3 components of the curl. This also gives you a justification for why the components of the curl actually constitute a real vector. We know already that torques are vectors and that an arbitrary torque in 3d can be decomposed into torques along the 3 coordinate axes. And so we just go in reverse, we have 3 torques along the coordinate axes acting on this ball, so they must be the components of an arbitrary torque.