Questions tagged [convex-analysis]

Convex analysis is the study of properties of convex sets and convex functions. For questions about optimization of convex functions over convex sets, please use the (convex-optimization) tag.

Convex analysis is the study of properties of convex sets and convex functions.

Formally, a set $S$ is convex if, for all $x, y \in S$ and $t \in [0,1]$, $tx + (1-t)y \in S$. Intuitively, this says that for any two points in $S$, the line segment connecting those points is also in $S$.

Formally, a function $f: S \to \mathbb{R}$ defined on a convex set $S$ is convex, if for all $x,y \in S$ and $t \in [0,1]$, $f(tx + (1-t)y) \leq t f(x) + (1-t) f(y)$. Intuitively, this says that, for any two points on the graph of $f$, the line segment connecting those points lies above the graph of $f$.

Some of the more important results in convex analysis include Carathéodory's Theorem, Jensen's Inequality, Minkowski's Theorem, and the supporting hyperplane theorem.

9641 questions
4
votes
5 answers

Is $\mathbb R^n\setminus\{\mathbf 0\}$ a convex set?

Is $\mathbb R^n\setminus\{\mathbf{0}\}$ a convex set? I read the convex analysis book (R.T. Rockafellar), in the book he wrote " convex cone may or may not contain the origin point". Then a question occur to me that the whole space $\mathbb{R}^n$ …
bin
  • 155
4
votes
2 answers

What is the right way to prove that the intersection of an infinite number of convex sets is convex?

I am wondering how to prove that the intersection of an infinite number of convex sets is convex. I can prove that the intersection of two convex sets is convex, and I believe that I can simply do an induction on this result, but I've heard that it…
Elements
  • 2,638
4
votes
1 answer

Proof of supporting hyperplane theorem in Boyd and Vandenberghe

On page 51 of $\textit{Convex Optimization}$ by Boyd and Vandenberghe, they prove the Supporting Hyperplane Theorem using the Separating Hyperplane Theorem. That is, they prove that for a nonempty convex set $C\subseteq\mathbb{R}^n$ and any…
Satana
  • 1,099
4
votes
0 answers

Prove the function is concave, using log-sum-exp and geometric mean.

Suppose $p<1,p\ne0$. Show that the function $$ f(x) = \left(\sum_{i=1}^{n} x_i^p \right)^{\frac{1}{p}} $$ with dom$\ f=\Bbb{R}_{++}^n$ is concave, where dom represents domain and $\Bbb{R}_{++}=\{x\in\Bbb{R}:x>0\}$. Hint. Adapt the proofs for the…
Danny_Kim
  • 3,423
4
votes
1 answer

Proof that a coordinate-wise convex function is convex?

I feel like this should be straightforward, but does anyone have a proof of the following? Let $f: \mathbb{R}^n \to \mathbb{R}$ satisfy the following. For each coordinate $i$, for an arbitrary vector $x_{i}$, define $ f_i(y)$ to be $f$ restricted to…
4
votes
1 answer

Vector space is to manifold as convex cone is to?

In convex analysis, a convex cone can be viewed as being like a one-sided version of a subspace. (And the polar cone is analogous to the orthogonal complement. It's a nice analogy.) A smooth manifold has a tangent space at every point. Is there…
4
votes
1 answer

Convex hull approximated from inside by only finite number of elements?

In approximating the convex hull "from inside", i.e. $$ \text{conv}S = \{ x \in \mathbb{R}^n \mid x= \sum_{i=1}^k \lambda_i x^i, x^i \in S, \lambda_i \geq 0, \sum_{i=1}^k \lambda_i= 1 \} \text{,}$$ in the case where $S$ is infinite - why can we…
Suedklee
  • 409
4
votes
1 answer

Describing a set of normals

In a finite dimensional (think Euclidean) ambient space, let $S$ a compact, convex set and $x$ not in $S$. The two sets can be (weakly) separated, i.e. there exists a vector (normal) that defines a hyperplane separating the point and the set. In…
NilsD
  • 71
4
votes
1 answer

Is there a geometric interpretation for a function's $\alpha$-sublevel set?

In Boyd and Vandenberghe's "Convex Optimization": The $\alpha$-sublevel set set of a function $f:\mathbb{R}^n \rightarrow \mathbb{R}$ is defined as $$C_\alpha=\{x \in \mathbf{dom} f|f(x)\leq\alpha\}.$$ After stating that "sublevel sets of a…
asimoes
  • 105
  • 1
  • 8
4
votes
3 answers

Why is the empty set convex?

Why is it the empty set, trivially convex? I see this results stated into a proof as something known, but I do not understand what's the idea idea behind it. How could I reason about convex combinations if the set has no elements?
PhDing
  • 504
4
votes
0 answers

Supporting hyperplane to a compact, convex set in Hilbert space at a given boundary point

Does one always exist? I see that it is true in finite dimensions.
Rick
  • 41
4
votes
0 answers

Is $A$ convex if and only if $-\ln(i_{A})$ is convex?

Is it correct that we have : $A \subset \mathbb{R}^n$ is convex if and only if $-\ln(i_{A})$ is a convex function? where here $i_A$ takes the value 1 at $x \in A$ and $+\infty$ elsewhere. I have found this statement a little bit weird since one…
user2015
  • 125
4
votes
1 answer

Relative interior commutes with cartesian product

I have been reading Convex Analysis by Rockafellar. One of the proofs made use of the fact that $\text{ri}(A\times B) = \text{ri}(A) \times \text{ri}(B)$, where $A$ and $B$ are convex sets, $\times$ denotes the Cartesian product of sets, and…
Vokram
  • 1,587
4
votes
1 answer

Convex functions, prove another definition.

I have the next problem: Suppose $f$ is continuos then $f:\mathbb{R}^n\to R$ is convex iff $\forall x,y \in \mathbb{R}^n \left( \int_0^1 f(x+\theta (y-x))d\theta \leq \dfrac{f(x)+f(y)}{2}\right)$. The implication $\Rightarrow$ is really easy but I…
Erick
  • 466
4
votes
1 answer

Convex Hull of a union

Let $X_1,\ldots,X_k \subseteq \mathbb{R}^n$ be convex sets. It was claimed (in some notes on convex optimization that I was reading) $$\operatorname{Co}\left(\bigcup_{i=1}^k X_i\right)=\left\{\sum_{i=1}^k t_i x_i : x_i \in X_i,t_i\geq 0,\sum_{i=1}^k…
Jason
  • 2,065