3

I am trying to detemine if the expression below is concave or convex using operations that preserve convexity http://web.stanford.edu/class/ee364a/lectures/functions.pdf.

$Var[x] = E(x^2) - E(x)^2$

  • $E(x)$ is concave / convex because it is a sum of linear terms
  • $E(x)^2$ is convex because of power 2
  • $E(x^2)$ is concave / convex because it still is a sum of linear terms.

Would this be correct ? So then what would $E(x^2) - E(x)^2$ be since it is convex - affine ?

Kong
  • 884
  • is $x$ a continuous or discrete random variable? – Jürgen Sukumaran Apr 18 '18 at 12:06
  • 1
    $E(x^2)$ is convex, because it is a sum of convex terms. So you get convex-convex, which is inconclusive. – LinAlg Apr 18 '18 at 12:10
  • What does it mean for a function of a random variable to be convex? – littleO Apr 18 '18 at 12:12
  • @LinAlg Ah right, I missed out that $x^2$ is convex. Lets say that the expression is convex minus affine. What would the result be ? Since an affine function is both convex and concave. A convex + affine function would still be convex I believe. – Kong Apr 18 '18 at 12:16
  • @LittleO it means for random variables $x$ and $y$ that $\lambda$ Var[$x$] + $(1-\lambda)$Var[$y$] $\geq$ Var[$\lambda x + (1-\lambda) y$]. – LinAlg Apr 18 '18 at 12:18
  • 1
    @kong subtracting an affine function from a convex function is the same as adding an affine function to a convex function, since the additive inverse of an affine function is again affine. – LinAlg Apr 18 '18 at 12:19
  • @LinAlg So convex - affine = convex. Thanks ! – Kong Apr 18 '18 at 12:22

1 Answers1

3

It is hard to say based on the expression you have. It is much easier by using this expression: $$\text{Var}[x] = \min_{\mu \in \mathbb{R}}\mathbb{E}(x-\mu)^2.$$ It is clear that $f(x,\mu) = \mathbb{E}(x-\mu)^2$ is jointly convex, and partial minimization preserves convexity.

LinAlg
  • 19,822
  • Thanks ! But this is not as intuitive as showing that the expression is a composition of convex functions sadly. – Kong Apr 18 '18 at 12:24