Questions tagged [jensen-inequality]

For questions about proving and using Jensen's inequality for convex functions. To be used necessarily with the [inequality] tag.

Jensen's inequality states that for a convex function $f$, for $\lambda\in[0,1]$, we have $$f\left[\lambda x+(1-\lambda)y\right]\leq\lambda f(x)+(1-\lambda)f(y).$$ In the context of measure-theoretic probability theory, Jensen's inequality states that given a probability space $(\Omega,\mathcal F,\mathbb P)$, given a $\mathbb P$-integrable function $f$ and convex function $\psi$, then $$\psi\left(\int_\Omega f\,\mathrm d\mathbb P\right)\leq\int_\Omega\psi( f)\mathrm d\mathbb P.$$

Jensen's inequality is sometimes written in terms of the expectation operator, i.e. if $X$ is a random variable and $\psi$ is a convex function as above, then $$\psi(\mathbb E[X])\leq\mathbb E[\psi(X)].$$ It is a broad generalization of the fact that variance is non-negative (i.e. that $\mathbb E(X^2) \le (\mathbb E X)^2$) with many consequences. For example, it gives one way to prove the AM-GM inequality.

It also has uses in combinatorics (via e.g. the discrete version: $ \sum_i\alpha_i=1,\alpha_i\ge 0$ implies $\psi(\sum_i\alpha_i x_i) \le \sum_i \alpha_i \psi(x_i)$), real analysis, harmonic analysis, and geometry.

External links: Wikipedia page on Jensen's inequality

483 questions
1
vote
1 answer

Prove the following from Jensen's inequality

$n \cdot \left( \frac{n+1}{2} \right)^{\left( \frac{n+1}{2} \right)} \leqslant \sum_{k=1}^{n} k^k \text{ for } n \in \mathbb{N}$ I've tried to transform the left part of inequality, but nothing worked out: $$n \cdot \left( \frac{n+1}{2}…
Donald
  • 131
1
vote
1 answer

Show that for a, b, c > 0 with a + b + c = 1, $(a + \frac 1a)^2 + (b + \frac 1b)^2 + (c + \frac 1c)^2 ≥ \frac {100}{3}$

For this question I took the function as $x^2$ and using the second derivative I found it to be 2. This is greater than 0 for all x values meaning that the function is convex. Then I used Jensen's Inequality which got me $$\frac {(a + \frac 1a)^2 +…
1
vote
1 answer

Can Jensen be applied to multivariable functions?

I was wondering, suppose we have a symmetric two variable function, in my case: $f(x,y)=\frac{1}{x+y+1}$ with the restriction that $0\le x,y \le 1$, I took the second partial derivative with respect to $x$ which is $\frac{2}{(x+y+1)^3}$, since the…
1
vote
1 answer

Is it a typo in Jensen's inequality?

I am reading a book where it is written: For any $n \geq 1$, $E(|x|^n) \geq (E(|x|))^n$ I understand that it is simple apllication of Jensen' inequality for function $f(x) = |x|^n$, but I have some question about right side of the equation.…
0
votes
0 answers

Counterexample for Jensen's inequality for rank one convex function

We all know the Jensen's inequality is for all probability measures $\mu$ and all convex $h:\mathbb{R}^N\to\mathbb{R}$ it holds that \begin{equation} h\left(\int Xd\mu(X)\right)\leq \int h(X)d\mu(X). \end{equation} But the the definition of laminate…
0
votes
0 answers

Jensen inequality cross entropy

I don't remember how to do math Prove that $\sum_{j=1}^{k} r_{j}{\log p_{j}} -\sum_{j=1}^{k} r_{j}{\log r_{j}} <=0$ Can I just put all expressions in one sum symbol, use log probability $\log(p_{j})-log(r_{j})=log(p_{j}/r_{j})$. Then we use Jensen…
zzz247
  • 37