Questions tagged [mean-square-error]

This tag is for questions about mean-square-error. In statistics, the mean squared error (MSE) of an estimator measures the average of the squares of the errors or deviations, that is, the difference between the estimator and what is estimated.

In statistics, the mean squared error (MSE) of an estimator measures the average of the squares of the errors or deviations, that is, the difference between the estimator and what is estimated. MSE is a risk function, corresponding to the expected value of the squared error loss or quadratic loss. The difference occurs because of randomness or because the estimator doesn't account for information that could produce a more accurate estimate.

The MSE is the second moment (about the origin) of the error, and thus incorporates both the variance of the estimator and its bias. For an unbiased estimator, the MSE is the variance of the estimator. Like the variance, MSE has the same units of measurement as the square of the quantity being estimated.

The MSE assesses the quality of an estimator or a predictor. Definition of an MSE differs according to whether one is describing an estimator or a predictor.

Def

Predictor:

If $\hat{Y}$ is a vector of n predictions, and $Y$ is the vector of observed values corresponding to the inputs to the function which generated the predictions, then the MSE of the predictor can be estimated by $$\operatorname{MSE}=\frac{1}{n}\sum_{i=1}^n(\hat{Y_i} - Y_i)^2$$

Estimator:

The MSE of an estimator $\hat{\theta}$ with respect to an unknown parameter $\theta$ is defined as $$\operatorname{MSE}(\hat{\theta})=\operatorname{E}\big[(\hat{\theta}-\theta)^2\big]$$

271 questions
6
votes
3 answers

Why root mean "square" error?

Root-mean-square error is frequently used in for calculating the error between a predicted value and actual value. The formula for RMSE is given below: $\mathrm{RMSE} = \sqrt{\frac{\sum_{t=1}^{n}{(y_t - \hat{y}_t)^2}}{n}}$ My question is; why we…
user13791
  • 647
3
votes
0 answers

root mean square distance between two simplices

As the title says, I want to compute the root mean square distance between two n-dimensional simplices. Say I have two surfaces $S$ and $S'$, the mean error is $$ d_m(S,S') = \frac{1}{|S|} \int\int_{p \epsilon S} d(p,S')dS\,. $$ where $|S|$ denotes…
edgar
  • 61
2
votes
1 answer

Why MSE formula is looking so different?

Here's what I randomly found on course online (Google Course, Andrew NG, etc.) about Mean Squared Error (MSE) prediction - actual or actual - prediction, It's maybe identical by squared but I never see anyone write F = am instead of F = ma before.…
katopz
  • 123
2
votes
1 answer

Standard error of RMSE?

If I want to calculate the RMSE between an estimated value $\hat{x}$ and its reference value $x_{\textrm{ref}}$, let \begin{equation} y_i = \hat{x}_i-x_{i,\textrm{ref}} \end{equation} Since \begin{equation} \textrm{RMSE} =…
hatmatrix
  • 263
1
vote
1 answer

The standard error of the mean

I came across this formula for the standard error of the mean in a book and wondered how I might be misunderstanding it? $$\widehat{SE} = \sqrt{\sum_{i=1}^n \frac{(x_i-\bar{x})^2}{n(n-1)}}$$ I would have thought it should be $$\widehat{SE} =…
1
vote
0 answers

What's the intuitive purpose of RMSE (root mean square error) compared to MAE (mean average error)?

When I want to find out what the average difference / error there is between two datasets, such as a predicted output vs. observed output of any system (i.e.: I predict output to be 100V, how does the actual measured output compare?) , intuitively I…
plu
  • 215
  • 2
  • 7
1
vote
3 answers

Minimum Mean Square Error Estimate Example

We have data from 2D normal (gaussian) distribution. $$\begin{bmatrix}y\\x\end{bmatrix}\,\text{~}\,\mathcal{N}\left(\begin{bmatrix}2\\4\end{bmatrix},\begin{bmatrix}10&2\\2&20\end{bmatrix}\right)$$ where $\mathcal{N}(\mu,P)$ and $\mu$ is mean and $P$…
user50222
  • 978
0
votes
1 answer

differentiating MSE

I have a error signal which I want to minimize using MSE. This error signal at time $k$ is a vector of length $3$: $e_k = C^{T} R_k - B^{T} A_k = [c_0, \ldots, c_{N_c-1}] \begin{bmatrix} r_{2k}\\ \vdots \\ r_{2k-N_c+1} \end{bmatrix} - [B_0, B_1,…
Elnaz
  • 629
0
votes
2 answers

least square adjustment of resection

By setting up at an unknown point, and measuring the horizontal angles between three points with known coordinates, it is possible to calculate the coordinates of the unknown point. This process is known as resection. If 3 known points are used then…
Nurlan
  • 111
0
votes
1 answer

Which value affected a certain RMS result?

I got four measurements which I want to process with an RMS as follows: $$ r = \sqrt{\frac{a*m_1^2+b*m_2^2+c*m_3^2+d*m_4^2}{a+b+c+d}} $$ Now I get a value for $r$ which is nice. But to do further research on the result, I need to know what impacts…
elyptikus
  • 121
0
votes
1 answer

MSE of the MME of $\theta$

A random sample of size $n$ is taken from a gamma distribution with parameters $α = 8 $and $λ = 1/θ$. The sample mean is $\bar{x}$ and $θ$ is to be estimated. Determine the mean square error of the MME of $θ$. My…
Mathxx
  • 7,570