Questions tagged [regression]

This tag is for questions on (linear or nonlinear) regression, which is a way of describing how one variable, the outcome, is numerically related to predictor variables. The dependent variable is also referred to as $~Y~$, dependent or response and is plotted on the vertical axis (ordinate) of a graph.

Regression is a statistical measurement used in finance, investing and other disciplines that attempts to determine the strength of the relationship between one dependent variable (usually denoted by $~Y~$) and a series of other changing variables (known as independent variables).

Types of Regression –

  • Linear regression
  • Logistic regression
  • Polynomial regression
  • Stepwise regression
  • Stepwise regression
  • Ridge regression
  • Lasso regression
  • ElasticNet regression

The two basic types of regression are linear regression and multiple linear regression.

The general form of each type of regression is:

  • Linear regression: $~Y = a + b~X + u~$
  • Multiple regression: $~Y = a + b_1~X_1 + b_2~X_2 + b_3~X_3 + ... + b_t~X_t + u~$

Where:

  • $Y =~$ the variable that you are trying to predict (dependent variable).
  • $X =~$ the variable that you are using to predict Y (independent variable).
  • $a =~$ the intercept.
  • $b =~$ the slope.
  • $u =~$ the regression residual.

There are multiple benefits of using regression analysis. They are as follows:

$1.~$ It indicates the significant relationships between dependent variable and independent variable.

$2.~$ It indicates the strength of impact of multiple independent variables on a dependent variable.

Reference:

https://en.wikipedia.org/wiki/Regression_analysis

This tag often goes along with the tag.

2700 questions
3
votes
1 answer

Logarithmic Functions algebra question

This is my first post and I honestly just want a second opinion on my answer to a question I got incorrect on an exam before I go arguing over it with my professor. Basically, is this mathematically correct to do? $\log y = B_0 + B_1 \log x_1 - 2…
3
votes
1 answer

Why does the regression line of $x$ on $y$ and $y$ on $x$ meet at $\bar{x}$ and $\bar{y}$?

Why does the least squares regression line of $x$ on $y$ and $y$ on $x$ intersect at $\bar{x}$ and $\bar{y}$? Also, why are the form of regression lines as they are? For the general form $y-\bar{y}=b(x-\bar{x})$, what is $b$, and how is this…
user2246
  • 453
  • 2
  • 5
  • 9
3
votes
2 answers

How to calculate hyperbola from data points?

I have 4 data points, from which I want to calculate a hyperbola. It seems that the Excel trendline feature can't do it for me, so how do I find the relationship? The points are: (x,y) (3, 0.008) (6, 0,006) (10, 0.003) (13, 0.002) Thanks!
3
votes
3 answers

Fitting curve for Newton's cooling law data programatically?

The data are for the model $T(t) = T_{s} - (T_{s}-T_{0})e^{-\alpha t}$, where $T_0$ is the temperature measured at time 0, and $T_{s}$ is the temperature at time $t=\infty$, or the environment temperature. $T_{s}$ and $\alpha$ are parameters to be…
ZhangChn
  • 131
3
votes
2 answers

How to interpret $exp(L)$ in a scientific paper about logistic regression?

I am reading a paper by Bolton and Chapman about predicting horse races and I am having trouble understanding a certain formula. To give you the context, the paragraph is called: "Estimating the Parameters of the Multinomial Logit Model". It…
pswies
  • 33
  • 2
3
votes
2 answers

Can I consider shooting% as an independent variable

First time poster in the math section (a few posts in the stats section) and I am looking for clarification on a variable query that I have. Basically I enjoy sports and enjoy putting a mathematical answer (where I can as I don't have a great…
user8812
  • 131
2
votes
1 answer

Understanding polynomial regression

I'm looking for a good tutorial on how to calculate a "line of best fit" for non-linear data. I found this site: http://easycalculation.com/statistics/learn-regression.php which gives a very good tutorial on calculating a linear equation, but I…
2
votes
4 answers

How to fit a curve to my data

I have a datasheet. It looks like an hyperbola. How can I fit a curve to it? And how can I plot a curve of the first derivative? Time (x)second Normalized data (y) 0 100.00% 100 102.60% 200 104.39% 300 …
Joe
  • 21
2
votes
1 answer

Is there a site that will allow me to calculate a best fit for a set of data?

I have a bunch of x's and their corresponding y values, but do not have a Wolfram Pro account. Is there another site where I can input my dataset and have it spit out a best-fit regression (be it linear, cubic, quadratic, etc)?
user51819
  • 1,161
  • 1
  • 8
  • 15
2
votes
3 answers

Polynomial best fit line for very large values

not only are the x values large, the difference between them and the y values is huge. My data…
anon425
  • 21
2
votes
1 answer

Simple linear regression - understanding given

The question is to fill out the missing numbers (A-L) of a simple linear regression model. I am having problems with converting and interpreting the given table in terms of variables. Would it be possible for someone to confirm and clarify things…
Kartik
  • 237
2
votes
1 answer

Probit model question (regression)

I'm reading a thesis and I need your help to understand the equation below. $$\Pr(\text{failure}=1 \mid X_1,X_3,X_3,X_4)=\int_{-\infty}^z \varphi(k) \, dk\tag{1}$$ $\varphi(k)$ is the standard normal density and $z=\beta_1 X_1+\beta_2 X_2+\beta_3…
name
  • 23
2
votes
1 answer

how to find two numbers to minimize the sum of squares

Suppose we are given a sequence of positive numbers $0
afzd
  • 103
2
votes
0 answers

Coefficient of determination

$$ \displaystyle \sum^n_{i = 1} (y_i - \bar{y})^2 = ( \displaystyle \sum^n_{i = 1} (y_i - \bar{y})^2 - \displaystyle \sum^n_{i = 1} (y_i - \hat{y}_i)^2 ) + \displaystyle \sum^n_{i = 1} (y_i - \hat{y}_i)^2$$ My book says the LHS is the total…
Ylyk Coitus
  • 970
  • 2
  • 10
  • 18
2
votes
1 answer

Confusion with linear regression coefficient when variables are reversed

Given $Y$ and $X$ in a typical linear regression model, where $$Y = \beta_1 X + \epsilon_1 $$ We know that $\hat{\beta_1} = (X^TX)^{-1}X^TY$. Assuming that the sample mean of $X$ and $Y$ is zero, and denoting the sample s.d. as $\sigma_x$ and…
Sean Lee
  • 1,295
1
2
3
15 16