What do coefficients mean in linear regression?

Coefficients in linear regression represent how much the model’s predicted target changes when an input feature changes by one unit.

In a multiple linear regression model, each coefficient describes the effect of its feature while the other included features are held constant.

Basic equation

A linear regression model can be written as:

ŷ = b0 + b1x1 + b2x2 + ... + bnxn

where each b value is a coefficient.

Positive coefficient

A positive coefficient means the predicted target tends to increase as the feature increases.

For example:

Sales = 100 + 4 × Advertising Spend

If the advertising-spend feature increases by one unit, the predicted sales value increases by 4 units.

Negative coefficient

A negative coefficient means the predicted target tends to decrease as the feature increases.

For example:

House Price = 500000 - 20000 × Distance

If distance increases by one unit, the predicted house price decreases by 20,000 units, assuming the other included features remain unchanged.

The magnitude shows the change per unit

A larger absolute coefficient means a larger change in the prediction for a one-unit change in that feature.

However, coefficient magnitudes should not be compared blindly when features use different units or scales.

For example, a coefficient for income measured in rupees may look much smaller than a coefficient for age measured in years simply because the units are very different.

Coefficients in multiple regression

In a model with several features, a coefficient should be interpreted as:

the expected change in the prediction for a one-unit increase
in that feature, while the other included features are held constant

This conditional interpretation is important.

Categorical variables can also have coefficients

After categorical variables are encoded, their coefficients usually represent differences relative to a reference category.

For example, with one-hot encoding, a category coefficient can indicate how much the prediction differs from the omitted baseline category.

Coefficients do not prove causation

A positive or negative coefficient describes an association learned by the model.

It does not automatically mean that changing the feature will cause the target to change.

Multicollinearity can make coefficients unstable

If predictors contain strongly overlapping information, individual coefficient values can become unstable or difficult to interpret.

This is why multicollinearity matters especially when coefficient interpretation is important.

In short, a linear regression coefficient tells you how the model’s predicted target changes for a one-unit change in a feature, with its sign showing direction and its magnitude showing the size of that modeled change.