When should polynomial regression be used?

Polynomial regression should be used when the relationship between the input and a continuous target is curved, but can still be represented reasonably well using powers of the input features.

It is a useful extension of linear regression when a straight line clearly underfits the data.

Use it when the data shows a smooth curved pattern

For example, suppose increasing advertising spend improves sales rapidly at first, but the improvement slows at higher spending levels.

A straight line may miss that shape, while a quadratic model such as:

ŷ = b0 + b1x + b2x²

can capture the curvature.

Use it when the relationship is nonlinear but still fairly simple

Polynomial regression works well for patterns such as:

• gradual upward or downward curves
• U-shaped relationships
• inverted U-shaped relationships
• relationships with one or a few smooth bends

It is especially useful when you want a model that remains relatively interpretable.

Use validation to choose the degree

The polynomial degree controls how flexible the curve becomes.

For example:

• degree 1 gives a straight line
• degree 2 allows one quadratic curve
• degree 3 allows more complex curvature

A degree should be chosen based on validation performance rather than simply increasing it until the training data is fitted closely.

Do not use a high degree just to fit every point

Very high-degree polynomials can follow noise in the training data and produce unstable predictions.

This is a form of overfitting.

Be careful with extrapolation

Polynomial models can behave unpredictably outside the range of the training data because higher-order terms can grow very quickly.

So they are usually safer for interpolation within the observed data range than for long-range extrapolation.

When polynomial regression may not be the best choice

Consider another model when:

• the relationship has many irregular changes
• there are many features and interactions
• the data contains sharp thresholds or discontinuities
• a tree-based or other nonlinear model captures the pattern more naturally

In short, use polynomial regression when a straight-line model is too simple but the underlying relationship is still smooth enough to be represented by a low-degree polynomial. Choose the degree with validation and avoid unnecessarily complex curves.