Questions tagged [hessian-matrix]

The Hessian matrix of function is used to second derivative test when $f$ has a critical point $x$. If the Hessian is positive definite at $x$, then $f$ attains a local minimum at $x$. If the Hessian is negative definite at $x$, then $f$ attains a local maximum at $x$. If the Hessian has both positive and negative eigenvalues then $x$ is a saddle point for $f$.

The Hessian matrix or Hessian is a square matrix of second-order partial derivatives of a scalar-valued function, or scalar field. It describes the local curvature of a function of many variables.

Specifically, suppose $f : \mathbb{R}^n \rightarrow \mathbb{R}$ is a function taking as input a vector $x \in \mathbb{R}^n$ and outputting a scalar $f(x) \in \mathbb{R}$; if all second partial derivatives of $f$ exist and are continuous over the domain of the function, then the Hessian matrix $H$ of $f$ is a square $n \times n$ matrix

845 questions
4
votes
0 answers

Hessian-Matrix of a Determinant

Let $f:\mathbb{R}^{n}\rightarrow \mathbb{R}$ be a polynomial function and let $H_f(x)$ denote its Hessian. Now define $p:=\det(H_f(x))$. Is there a nice way to relate the Hessian of $p$ i.e. $H_p(x)$ with the Hessian of $f$?
Alina
  • 141
3
votes
2 answers

Hessian of a composition of maps

I have three maps: $$f:\mathbb{R}^m\rightarrow\mathbb{R}^n\,,\quad g:\mathbb{R}^n\rightarrow\mathbb{R}^p\,,\quad h:\mathbb{R}^p\rightarrow\mathbb{R}$$ and I would like to compute the Hessian matrix $H_{h\circ g\circ f}$ of the composite map $h\circ…
aleio1
  • 995
2
votes
3 answers

Finding the Hessian of matrices?

The function is given in matrix form as $f(x)=x^TAx $ How would you find the Hessian of such a function?
minnn
  • 248
1
vote
1 answer

What is the Hessian of log det X?

I know that $f(X) = \log \det X$ is concave on domain $S^n_{++}$, but what is the Hessian of f(X)? Is there any book I can refer to?
YF Yan
  • 37
0
votes
0 answers

Can i have a hessian matrix which has some elements that equal zero?

I read somewhere that in order to have a hessian matrix and be able to conduct further investigation to it, all the variables must be differentiable and they must all exist. Now i have come up with a hessian matrix in which i have 3 zeros. One in…
0
votes
1 answer

Giving $\nabla^{2} f(\mathbf{x}) \succeq mI$,how to calculate $\|(\nabla^{2} f(\mathbf{x}))^{-1}\| $

In the 《Introduction to Nonlinear Optimization Theory, Algorithms, and Applications with MATLAB》page 85, "Combining the latter equality with the fact that $\nabla^{2} f(\mathbf{x}) \succeq mI$ implies that $\|(\nabla^{2} f(\mathbf{x}))^{-1}\| \leq…
0
votes
1 answer

Why has the kernel of the 2x2 hessian 3 linear functions?

I have calculated something characteristic polynome and such things but i think thats the wrong way to see this. My try is : On $\mathbb{R}^2$ the Hessian matrix can be relaized as $$ \mathbf{H}_\mathbb{R^2}= \begin{pmatrix} \partial_{xx} &…
0
votes
0 answers

Hessian equals to zero

I'm trying to find maxima/minima points for the following function: $g(x,y) = -5x^2-3y^2+x-xy^2+2$ I found three points, $p_1 =(0.1,0), p_2 =(-3,-\sqrt{31}), p_3= (-3,\sqrt{31})$. But for two of them the Hessian matrix was equal to zero. I tried to…
0
votes
1 answer

Negative Definite Hessian implies Concave proof

I am struggling to find some proof about concavity and hessian matrix, How can I proof: If the Hessian Matrix of $f$ is Negative Definite, then $f$ is concave. I will appreciate it if you can share with me the link to the proof thanks.
cavvot
  • 13
0
votes
1 answer

Prove that the point is a local maximum if Hessian is null

$f = (x + y + z)^7 - x^6 - y^6 - z^6$. $(0, 0, 0)$ is one of the stationary points and its' Hessian is null. At first I've tried to prove that it's not an extremum, but now I think that it's a local maximum, but I don't know how to prove it…
0
votes
1 answer

Question about "Derivative" v.s. "Gradient" v.s. "Hessian matrix"

I learned them from 'An Introduction to Optimization' by Edwin K. P. Chong and Stanislaw H. Zak. Derivative of $f$ $$Df(x)=\left[\begin{matrix} \frac{{\partial}f}{{\partial}x_1} (x) & \cdots & \frac{{\partial}f}{{\partial}x_n} …
Danny_Kim
  • 3,423
0
votes
1 answer

What is y's value for stationary points in this function?

I'm trying to find stationary points for $f(x,y)=x^2e^{-y}$ so I took partial derivatives to find the gradient vector and got $\langle 2xe^{-y} , -x^2 e^{-y}\rangle$ Now I'm trying to find at what points the gradient vector becomes vector $<0,0>$ so…
Floella
  • 473
0
votes
1 answer

Second Order Derivative Test and Hessian

I have question about global optimum and negative (positive) semidefiniteness. I know that the sufficient conditions (for KKT) is the concavity (convexity) of the objective function. (The constraints are affine.) I know that if the Hessian is…
Larusso
  • 125