Questions tagged [svd]

In linear algebra, the singular value decomposition (SVD) is a factorization of a real or complex matrix, with many useful applications in signal processing and statistics.

In linear algebra, the singular-value decomposition (SVD) is a factorization of a real or complex matrix.

Formally, the singular value decomposition of an $m \times n$ real or complex matrix $M$ is a factorisation of the form $UAV^*$ where $U$ is an $m\times m$ real or complex unitary matrix, $A$ is an $m\times n$ rectangular diagonal matrix with non-negative real numbers on the diagonal, and $V$ is an $n\times n$ real or complex unitary matrix.

The singular-value decomposition can be computed using the following observations:

  • The left-singular vectors of $M$ are a set of orthonormal eigenvectors of $MM^*$.
  • The right-singular vectors of $M$ are a set of orthonormal eigenvectors of $M^*M$.
  • The non-zero singular values of $M$ (found on the diagonal entries of $A$) are the square roots of the non-zero eigenvalues of both $M^*M$ and $MM^*$.

Source: Wikipedia.

1502 questions
1
vote
1 answer

Understanding (and computing) the svd of a matrix

I thought I understood how to compute the singular value decomposition $A = U D V^T$ of a matrix $A$, based on this tutorial: http://www.math.ucla.edu/~pskoufra/M33A-SingularValueDecompositionExample.pdf To summarize, given a matrix $A$, you find…
Zur Luria
  • 1,514
1
vote
1 answer

SVD of a matrix

Can someone please tell me the Singular Value Decomposition of A= $\begin{bmatrix} 1 & 0\\ 1 & 0\\ \end{bmatrix} $. I calculated U= $$\begin{bmatrix} \frac{1}{\sqrt2} & \frac{1}{\sqrt2}\\ \frac{-1}{\sqrt2} & \frac{1}{\sqrt2}\\ \end{bmatrix} $$ and…
1
vote
0 answers

Find the minimum $\min\limits_x\Vert y-Ax\Vert_2^2$ given $A$'s singular value decomposition

Let $A\in \mathbb R^{5\times 3}$ with left singular vectors $u_1,\ldots,u_5$, right singular vectors $v_1,\ldots,v_3$ and singular values $\sigma_1,\sigma_2,\sigma_3=4,2,1$ Suppose $y=2u_1+3u_2+4u_3+5u_5$. Find the minimum $ \min\limits_x\Vert…
Vons
  • 11,004
1
vote
0 answers

Singular value decomposition of weighted matrix

If I compute the singular value decomposition of a matrix A and then want to compute the SVD of a matrix A' that is the same as A except that each row is scaled by a different number, is there a more efficient way of computing the SVD of A', given…
1
vote
0 answers

What's the effect of normalizing for SVD?

$\mathbf{X} \in \mathbb{R}^{M\times N}$, $M$ is the number of data, $N$ is the dimension of data. Then one can have SVD as $\mathbf{X= U\Sigma V^\top} $. However, now I do the SVD on the tranlsated and scaled $\mathbf{X}$, $$ Y = (\mathbf{X} -…
1
vote
1 answer

SVD equivalent for infinite dimensional spaces

How SVD can be extended to arbitrary linear operators? Any references?
Palo
  • 79
1
vote
0 answers

Eigenvalues from LDLT with all L=1

I have a matrix in LDLT $X=LDL^T$ form, where all nonzero elements in L (i.e. diagonal and below), are $1$. So only D matters (which is diagonal). What can we tell about the eigenvalues/vectors of this matrix? It is possible to assume for simplicity…
Troy McClure
  • 804
  • 4
  • 12
1
vote
1 answer

What is the singular value decomposition for [2 -1 2]

Somehow its easier to find SVD for higher order matrices but i cant get my head around a 1*n matrix.
1
vote
1 answer

Singular value decomposition of matrix products

For $A ∈ C^{m×n}$ and $B ∈ C^{n×k}$ with $m ≥ k$ and $n ≥ k$, how can I prove that $\sigma_k(AB) ≤ \sigma_1(A) \sigma_k(B)$ ?
Mike
  • 59
1
vote
0 answers

Why do the singular vectors $u_i$ and $v_i$ become oscillatory as $\sigma_i$ decreases?

I am confused with the statement "The characteristic feature of the SVD promises that as $\sigma_i$ decreases, the singular vectors $u_i$ and $v_i$ become more and more oscillatory", which is in my assignment of solving ill-posed problems. I…
user26767
  • 299
1
vote
2 answers

Why $||U\Sigma V^\intercal - X_k||_F = ||\Sigma - U^\intercal X_k V ||_F$

Here $U\Sigma V^\intercal $ is the svd decomposition of M.I know that U and V are othogonal but i dont know which property it is using. This in reference to the post Proof of Eckart-Young-Mirsky theorem $$||M-X_k||_F = ||U\Sigma V^\intercal -…
biswpo
  • 235
1
vote
1 answer

how to calculate variance on SVD parameter estimation?

How do i Calculate the variance of a estimated parameter by SVD? I know that there is an uncertainty on the dataset, but how can that be used to calculate variance of an parameter?
John
  • 43
1
vote
0 answers

SVD, ALSWR tutorial

Please advise good introductory books for neophyte on the following subjects: LSA (Latent Semantic Analysis) SVD (Single Value Decomposition). SGD(Stochastic Gradient Descent) ALSWR(Alternating-Least-Squares with Weighted-λ-Regularization). …
zork
  • 111
1
vote
1 answer

The less than full rank case, can be done with SVD decomposition?

The matrix is $$ A = \left( \begin{matrix} 1 & 2 \\ 2 & 4 \\ 3 & 6 \end{matrix} \right), $$ The rank is 1, there only one nonzero eigenvalue, and when I was doing the svd decomposition, I can only find the V and but not U. In U, I can only get…
cliff
  • 13
0
votes
1 answer

Finding the unitary matrices U and V of an SVD product using the product UV of the unitary matrices?

Given the SVD decomposition of a know matrix $M$ such as : $M = U S V^t $ Now consider the matrices $U$, and $V$ are unknown, and only their matrix product $U V^t$ and the matrices $M$ and $S$ are known, how we can find the matrices $U$ and $V$ ? I…