Question 1

What is a residual in regression analysis?

Accepted Answer

A residual is the vertical distance between an actual data point and its predicted value on the regression line. It represents the difference between the observed value of y and the estimated value from the regression equation. Residuals measure how far each data point deviates from the fitted line, indicating prediction accuracy.

Question 2

How do you determine if a regression line is the best fit?

Accepted Answer

The best fit line minimizes the sum of squared residuals, known as the least-squares property. By squaring each residual and summing all squared values, the regression line with the smallest total represents the best fit. Any other line drawn through the data produces a larger sum of squared errors, making it inferior.

Question 3

What does it mean when a residual is positive or negative?

Accepted Answer

A positive residual occurs when the actual data point lies above the regression line, meaning the line underestimates the true value. A negative residual occurs when the data point lies below the line, indicating the line overestimates the true value. The sign reveals whether predictions are systematically too low or too high.

Question 4

How are residuals calculated from a regression equation?

Accepted Answer

To calculate a residual, substitute the x-value into the regression equation to find the predicted y-value. Then subtract the predicted value from the observed y-value. The resulting difference is the residual for that data point. This process repeats for all data points in the dataset.

Question 5

Why is minimizing the sum of squared residuals important?

Accepted Answer

Minimizing squared residuals ensures the regression line fits the data as closely as possible overall. Squaring emphasizes larger deviations and prevents positive and negative residuals from canceling each other out. This criterion, called the least-squares property, guarantees the most accurate linear model for prediction and inference.

Question 6

Can residuals help identify problematic data points?

Accepted Answer

Yes, unusually large residuals indicate data points that deviate significantly from the regression line, suggesting potential outliers and influential points that may distort the model. Examining residuals reveals which observations fit the linear pattern poorly and may warrant further investigation or special consideration in analysis.

Question 7

How does the least-squares method relate to correlation strength?

Accepted Answer

The least-squares regression line minimizes prediction error regardless of correlation strength. However, stronger correlations produce smaller residuals overall, indicating the linear relationship explains more variation. Understanding both residuals and interpreting the linear correlation coefficient provides complete insight into model fit and relationship strength.

残差と最小二乗特性