Questions tagged [regression]

This tag is for questions on (linear or nonlinear) regression, which is a way of describing how one variable, the outcome, is numerically related to predictor variables. The dependent variable is also referred to as $~Y~$, dependent or response and is plotted on the vertical axis (ordinate) of a graph.

Regression is a statistical measurement used in finance, investing and other disciplines that attempts to determine the strength of the relationship between one dependent variable (usually denoted by $~Y~$) and a series of other changing variables (known as independent variables).

Types of Regression –

  • Linear regression
  • Logistic regression
  • Polynomial regression
  • Stepwise regression
  • Stepwise regression
  • Ridge regression
  • Lasso regression
  • ElasticNet regression

The two basic types of regression are linear regression and multiple linear regression.

The general form of each type of regression is:

  • Linear regression: $~Y = a + b~X + u~$
  • Multiple regression: $~Y = a + b_1~X_1 + b_2~X_2 + b_3~X_3 + ... + b_t~X_t + u~$

Where:

  • $Y =~$ the variable that you are trying to predict (dependent variable).
  • $X =~$ the variable that you are using to predict Y (independent variable).
  • $a =~$ the intercept.
  • $b =~$ the slope.
  • $u =~$ the regression residual.

There are multiple benefits of using regression analysis. They are as follows:

$1.~$ It indicates the significant relationships between dependent variable and independent variable.

$2.~$ It indicates the strength of impact of multiple independent variables on a dependent variable.

Reference:

https://en.wikipedia.org/wiki/Regression_analysis

This tag often goes along with the tag.

2700 questions
0
votes
1 answer

Can a dummy variable help me in a linear regression where my slope changes based on that variable

Sorry if that wasn't a particularly helpful title, let me explain the situation. If I have a scatter chart of y ~ x1 and I notice that if I filter the data by tiers of a different variable, my slope changes (for instance, a positive relationship…
Jeremy
  • 1
0
votes
1 answer

Least squares with known error in y

so I want to do a linear least squares regression on my data, however I have known experimental error on my data points in $y$ and relatively few numbers of points so I would like to use values measured instead of the usual residual method. It seems…
0
votes
1 answer

Why is the SSE <= SST?

I can think of a regression line producing a larger sum of squared errors (SSE) than the total sum of squares (SST). I read that should not be possible, how come? My understanding is that the regression line is just a linear model, so if this model…
XY6
  • 153
0
votes
1 answer

Identical observations in linear regression

I want to do a linear regression $Y = X\beta + e$, but some of the observations (rows in $X$) are identical (about 30 000 out of 50 000 remain after deleting all duplicates), so when I try to calculate the OLS estimate $\hat{\beta} = (X^t X)^{-1}…
H.v.M.
  • 165
  • 8
0
votes
1 answer

linear regression analysis

i am given data for analysis following data:relationship between height and weight,question is :is relationship between them linear?like $y$=$a$+$b$*$x$+$e$ where e is error,or quadratic?or cubic?data is following(y denoted height, x-weight) y …
0
votes
2 answers

How we can linearize this equation?

I have an equation that it seems to be a non-linear equation. I want to compute the parameters a1 till a4.I want to simply do a linear regression to find the parameters, which is much easier than a non-linear regression. Y = exp (a1 log (x) +…
sacvf
  • 103
0
votes
1 answer

Maximum and minimum penalty in lasso regression family

I am trying to adjust penalty, lambda, in group lasso regression, but I have no idea about it. Just to clarify, group lasso regression is a kind of multiple linear regression which use penalties on estimated coefficients to keep them small. Also, it…
0
votes
1 answer

how to apply weighting factor to linear regression

Say if I have two sets of data, x and y. And I am required to apply a weighting factor,1/x, to the regression line. Does that mean I should plot 1/y versus 1/x and then get the regression? Could anyone help me with this please? Thanks.
0
votes
1 answer

Questions about Multi linear regression model.

I have two questions about multi linear regression model. First question. Suppose 2 independent samples Sample1 : $y_1$, ... $y_{n_1}$ and $x_1$, ..., $x_{n_1}$ Sample2 : $y_{n_1 +1}$, ... $y_{n_1 +n_2}$ and $x_{n_1 +1}$, ..., $x_{n_1 +n_2}$ and…
smw1991
  • 147
0
votes
0 answers

Relationship among parameters from models with different link function and scaled response variable

Given the model, $\log(A_i) = \alpha + \beta \, covar_i$, with $i=1,\dots,1000$, $\alpha=4$, $\beta=0.2$, and covariate $covar \sim U(-1,1)$, I derived $\log(A)$ values (in $\texttt{R}$) as: alpha <- 4; beta <- 0.2; ni <- 1000 covar <- runif(ni,…
0
votes
2 answers

Relationship between Kriging and Gaussian process regression models

In the science of Bayesian modeling one method involves using Gaussian processes to derive regression functions on data. I notice in looking at the plots for such regressions that they resemble Kriging plots. For example, This plot shows three…
0
votes
2 answers

Calculate $m_1, m_2 $ for $y = m_1x_1 + m_2x_2$

Given these values: $$x_1 = \left\{1, 3, 6, 8\right\}$$ $$x_2 = \left\{2, 8, 5, 10\right\}$$ $$y = \left\{8.6, 30.8, 34.1, 53.8\right\}$$ And this formula $$y = m_1x_1 + m_2x_2$$ How do I determine $m_1$ and $m_2$? (In this case I purposely chose…
0
votes
1 answer

Can we see the beta coefficients in OLS as mean values?

Can we see the beta coefficients in OLS as mean values? I mean the estimator β alone. y=Xβ+ε
0
votes
0 answers

Multivariate regression with nonindependent variables

I'm trying to run a multivariate regression in which not all variables are independent, and an not sure if this is possible. The reason is as follows: Let's say we have a large number of contracts, and we want to know how likely they are to…
0
votes
1 answer

How to find the deviated form of beta 1 in OLS

How to find the deviated form of beta 1 in OLS Y=β1+β2X+u estimated β1=(ΣX^2ΣY-ΣXΣXY)/(nΣX^2-(ΣX)^2) I do not know how to turn this part (ΣX^2ΣY-ΣXΣXY)into deviated form. I found that estimated β2=(nΣXY-ΣXΣY)/(nΣX^2-(ΣX)^2)=Σxy/Σx^2 x & y in…
1 2 3
15
16