Questions tagged [regression]

This tag is for questions on (linear or nonlinear) regression, which is a way of describing how one variable, the outcome, is numerically related to predictor variables. The dependent variable is also referred to as $~Y~$, dependent or response and is plotted on the vertical axis (ordinate) of a graph.

Regression is a statistical measurement used in finance, investing and other disciplines that attempts to determine the strength of the relationship between one dependent variable (usually denoted by $~Y~$) and a series of other changing variables (known as independent variables).

Types of Regression –

  • Linear regression
  • Logistic regression
  • Polynomial regression
  • Stepwise regression
  • Stepwise regression
  • Ridge regression
  • Lasso regression
  • ElasticNet regression

The two basic types of regression are linear regression and multiple linear regression.

The general form of each type of regression is:

  • Linear regression: $~Y = a + b~X + u~$
  • Multiple regression: $~Y = a + b_1~X_1 + b_2~X_2 + b_3~X_3 + ... + b_t~X_t + u~$

Where:

  • $Y =~$ the variable that you are trying to predict (dependent variable).
  • $X =~$ the variable that you are using to predict Y (independent variable).
  • $a =~$ the intercept.
  • $b =~$ the slope.
  • $u =~$ the regression residual.

There are multiple benefits of using regression analysis. They are as follows:

$1.~$ It indicates the significant relationships between dependent variable and independent variable.

$2.~$ It indicates the strength of impact of multiple independent variables on a dependent variable.

Reference:

https://en.wikipedia.org/wiki/Regression_analysis

This tag often goes along with the tag.

2700 questions
0
votes
1 answer

For a general linear regression , are Y and Y hat independent?

For a general linear regression , are $Y$ and $\hat{Y}$ independent? $Y$=XB+e $\hat{Y}$=X$\hat{B}$ I think they are dependent, because if they rely on the same data, they should have some sort of relationship. that is to say , $\hat{Y}$=HY , so…
user1919987
  • 197
  • 3
  • 6
  • 17
-1
votes
1 answer

Linear Regression question 1

I would really be grateful if someone could let me know how to answer Part (a) of Question 1. I believe i should scatter plot both x and y values separately for year 2000 and year 2001 on same graph and prove that there is a change. am I doing it…
-1
votes
1 answer

Why this interaction is happening in multiple regression?

I attach R code. b<-rnorm(9999,0,999) s<-rnorm(9999,0,1) This has nearly 0 correlation. and I can make a y with this b, and s. y <- s + b (I omit error variance so that I Can see what's going on clearly.) summary(lm(y~s+b+s:b)) the…
yoo
  • 133
-1
votes
1 answer

Regression of a time series approaching a power law

I have a time series that has a power-law $A \cdot t^{b}$ behaviour for $t\xrightarrow{}\infty$, while for low $t$ it is far from that. Something like this: How can I make a linear fit and find an estimation for $A$ and $b$? How many points shall…
-1
votes
2 answers

What are the relationships between no. of inputs and no. of outputs in regression?

What are the relationships between no. of inputs and no. of outputs in regression? Particularly, what if $|y| > |x|$? What if $|y|<|x|$? Why not always $|y|=|x|$? Where $|\cdot|$ denotes the cardinality.
mavavilj
  • 7,270
-1
votes
1 answer

linear regression-slope

Your friend in the U.S. gives you a simple regression fit for predicting house prices from square feet. The estimated intercept is -44850 and the estimated slope is 280.76. You believe that your housing market behaves very similarly, but houses are…
jam
  • 1
1 2 3
15
16