Questions tagged [regression]

This tag is for questions on (linear or nonlinear) regression, which is a way of describing how one variable, the outcome, is numerically related to predictor variables. The dependent variable is also referred to as $~Y~$, dependent or response and is plotted on the vertical axis (ordinate) of a graph.

Regression is a statistical measurement used in finance, investing and other disciplines that attempts to determine the strength of the relationship between one dependent variable (usually denoted by $~Y~$) and a series of other changing variables (known as independent variables).

Types of Regression –

  • Linear regression
  • Logistic regression
  • Polynomial regression
  • Stepwise regression
  • Stepwise regression
  • Ridge regression
  • Lasso regression
  • ElasticNet regression

The two basic types of regression are linear regression and multiple linear regression.

The general form of each type of regression is:

  • Linear regression: $~Y = a + b~X + u~$
  • Multiple regression: $~Y = a + b_1~X_1 + b_2~X_2 + b_3~X_3 + ... + b_t~X_t + u~$

Where:

  • $Y =~$ the variable that you are trying to predict (dependent variable).
  • $X =~$ the variable that you are using to predict Y (independent variable).
  • $a =~$ the intercept.
  • $b =~$ the slope.
  • $u =~$ the regression residual.

There are multiple benefits of using regression analysis. They are as follows:

$1.~$ It indicates the significant relationships between dependent variable and independent variable.

$2.~$ It indicates the strength of impact of multiple independent variables on a dependent variable.

Reference:

https://en.wikipedia.org/wiki/Regression_analysis

This tag often goes along with the tag.

2700 questions
1
vote
0 answers

Regression question (details inside). Measuring the incremental impact on the dependent variable of one category over other categories

Formulate a regression equation you would use to test for the differences in ROE between firms that used tier 1 investment banks as their advisors and those that used tier 2 or tier 3 banks (note: tier 2 and tier 3 banks are separate categories).…
1
vote
0 answers

derive the distribution(a multiple regression problem)

(Multiple regression model with p's predictor variables.) Derive the distribution of $$\frac{(b-\beta)X'X(b-\beta)}{MSE\cdot p}$$ As far as I know, $b\sim N(\beta,\sigma^2 (X'X)^{-1})$ $b-\beta \sim N(0,\sigma^2…
Fra Di
  • 31
0
votes
1 answer

Minimum number of observations in non-linear regression

Are 5 observations enough to verify the following non-linear regression model in the form: $ Y= C K_0^{\alpha_0}K_1^{\alpha_1}K_2^{\alpha_2}$ And in general how many observations do I need for models of this kind?
chen h.
  • 723
0
votes
2 answers

Equation going infinitely towards y = 10

I'm programming a site on which I sell services, and the more the customers spends, the more discount they will have. Please have a look at the diagram below. Spending 700 USD will result in 5% discount. I don't want the discount to ever go above…
0
votes
2 answers

How to do non-linear regression with this function

I have observed that my data matches the function : $ a e^{bx}+c $ I want to get the parameters a ,b and c. I know how to solve this problem if c equals 0. But how to solve it when c involves in?
0
votes
0 answers

Ordered logistic regression with likert scales

I'm currently have a bit of difficulty determining how to analyze this data via logistic regression analysis. Q18 = DV (satisfaction score ranging from 1-10) Q10_1 = IV (Customer Service likert score from 1-5) Q10_2 = IV (Sales likert score from…
moku
  • 225
  • 2
  • 10
0
votes
1 answer

How to create a model with high multicollinearity

I am going to create a model strictly for predictive purposes. Some of my independent variables are highly correlated. When I try to create the regression with all of the variables together, then, I should not trust the p-values? Is it a better idea…
User0
  • 287
  • 2
  • 16
0
votes
1 answer

Can I make one of my predictors categorical and continuous?

I would like to add age as a predictor for my regression, but I would also like to make it a binary categorical predictor with a cutoff of 18 years of age. I would like to do this because I suspect that age as a continuous predictor is loosely…
User0
  • 287
  • 2
  • 16
0
votes
0 answers

Multiple regression - interpretation of coefficients

Assume that one has two input variables (X1, X2) and one output variable (Y). One can approach regression in two ways: One can first run a univariate regression between X1 and X2, have a residual vector (e.g. lets call it X1v2-res), and then run a…
0
votes
1 answer

Testing for a random walk with drift

I was wondering if someone could help me clarify something from my lecture notes. It concerns the last step. I was wondering why we test if $\frac{\hat{\beta}}{\textrm{SE}(\hat{\beta}}<0$ and what the rejection rule is in this case. I am quite…
0
votes
2 answers

Naive question re. normal equation for linear regression

The typical normal equation for linear regression is $\theta=(X^TX)^{−1} X^T Y$ such that the gradient of $J(\theta)$ is zero. Why does $X^{-1} Y$ not work? What are the numerical reasons for this?
Paul
  • 1
0
votes
1 answer

Linearilization of non-linear relationships (Linear Regression)

How do you linearise the following equation? $$ Y = \frac{\beta_{1}x}{\beta_{0} + x} + E. $$ $\beta_{0}$ and $\beta_{1}$ are the parameters and $E$ is the regression error term.
Bree
  • 203
0
votes
0 answers

Question about sample variance with linear algebra

Given random variabes $Y_1,\dots,Y_n$ with mean $\mu$ and variance $\sigma^2$, I am supposed to prove that the sum of $(Y_i-(\text{mean of }y))^2$ can be expressed as $$y^T\left(I_{n\times n} -…
guest
  • 45
0
votes
1 answer

Linear Regression Problem ("Regression Towards the Mean")

I am having my mind turned upside down with a problem I am dealing with. So imagine we have a situation where we have pairs of points where x=heights of fathers and y=heights of the sons of these fathers. The mean of $X$ is equal to the mean $Y$ and…
guest
  • 45
0
votes
2 answers

Regression Analysis

When I have a table of values like \begin{array}{c|ccccc} x & 1 & 2 & 3 & 4 & 5 \\ y & 3 & 6 & 8 & 9 & 0 \\ y & 4 & 6 & 1 & 2 & 4 \end{array} and know that it is a simple linear regression model, what is the value of $n$? I think it is either $5$ or…
Lucy
  • 1