As Stafanos said, it is usually a "population parameter" that you are testing. However, if you are performing a nonparametric hypothesis test, then its more appropriately, and perhaps most generally, called a "population statistic", as this term will apply to any underlying distribution.
So what's the difference between a population statistic and population parameter?
Population statistic: any value that can be can be calculated from the CDF of the distribution (or derivatives thereof). For nonparametric distributions, this is a purely theoretical notion, as you usually cannot write down the distribution in closed form. However, operationally, the above is equivalent to saying that it can be approximated as a function of the empirical distribution function or the underlying data, such that it converged to the true value. Essentially, any consistent function of the data can be viewed as an approximation of an underlying population statistic.
Population parameter: This is a type of population statistic that is applicable to distirbutions that can be completely described by a function characterized by a finite number of parameters.
Most of the time, you are testing a population parameter, but sometimes you care more about population statistics (such as testing equality of variance in non-normal data).