I’ve two discrete distributions, say $p$, $q$. I am looking for a distance measure (need not be a metric, something like KL divergence is also fine) that satisfies the following:
- If support of $q$ is a subset of support of $p$, then the distance should be zero.
- If support of $q$ contains values not in support of $p$, then the distance should indicate how far should $q$ be moved so that it’s support becomes a subset of support of $p$.