What is instance normalization?

Instance normalization is a normalization technique that normalizes each individual sample independently, usually across the spatial dimensions of each channel.

It is commonly used in image-generation and style-transfer models.

How does it differ from batch normalization?

Batch normalization calculates statistics using multiple examples from the mini-batch.

Instance normalization calculates its statistics separately for each individual example.

For an image tensor, it typically computes the mean and variance for each channel across that image's height and width.

How does it work?

For one sample and one channel, it calculates:

mean = average of spatial activations

variance = variance of spatial activations

Then it normalizes:

x̂ = (x - mean) / sqrt(variance + ε)

and usually applies learnable scale and shift parameters:

y = γx̂ + β

Why normalize each instance separately?

Different images can have very different contrast, brightness, or style-related statistics.

Normalizing each image independently reduces the influence of those instance-specific statistics.

This can be useful when the model should focus more on structural content than on absolute appearance statistics.

Where is instance normalization commonly used?

It is especially common in:

• Neural style transfer.
• Image-to-image translation.
• Some generative models.

Does it depend on batch size?

No.

Because every sample is normalized independently, instance normalization works consistently even when the batch size is very small or equal to one.

What is the trade-off?

Removing instance-specific mean and variance can be useful for style-related tasks, but those statistics may contain important information in other problems.

So instance normalization is not automatically better than batch normalization.

For related methods, see “What is batch normalization?” and the next article “What is group normalization?”.

In short, instance normalization normalizes each sample independently, typically per channel across spatial dimensions, making it especially useful for style-transfer and image-generation tasks.