Article 3KH1H Generalized normal distribution and kurtosis

Generalized normal distribution and kurtosis

by
John
from John D. Cook on (#3KH1H)

The generalized normal distribution adds an extra parameter I^2 to the normal (Gaussian) distribution. The probability density function for the generalized normal distribution is

generalized_normal_pdf.svg

Here the location parameter I1/4 is the mean, but the scaling factor If is not the standard deviation unless I^2 = 2.

For small values of the shape parameter I^2, the distribution is more sharply pointed in the middle and decays more slowly in the tails. We say the tails are "thick" or "heavy." When I^2 = 1 the generalized normal distribution reduces to the Laplace distribution.

Here are examples with I1/4 = 0 and If = 1.generalized_normal_thin.svg

The normal distribution is a special case corresponding to I^2 = 2. Large values of I^2 make the distribution flatter on top and thinner (lighter) in the tails. Again I1/4 = 0 and If = 1 in the plots below.

generalized_normal_thick.svg

One way to measure the thickness of probability distribution tails is kurtosis. The normal distribution has kurtosis equal to 3. Smaller values of kurtosis correspond to thinner tails and larger values to thicker tails.

There's a common misunderstanding that kurtosis measures how pointy the distribution is in the middle. Often that's the case, and in fact that's the case for the generalized normal distribution. But it's not true in general. It's possible for a distribution to be flat on top and have heavy tails or pointy on top and have thin tails.

Distributions with thinner tails than the normal are called "platykurtic" and distributions with thicker tails than the normal are called "leptokurtic." The names were based on the misunderstanding mentioned above. The platy- prefix means broad, but it's not the tails that are broader, it's the middle. Similarly, the lepto- prefix means "thin", referring to being pointy in the middle. But leptokurtic distributions have thicker tails!

The kurtosis of the generalized normal distribution is given by

generalized_normal_kurtosis

We can use that to visualize how the kurtosis varies as a function of the shape parameter I^2.

generalized_normal_kurtosis_plot.svg

The Laplace distribution (I^2 = 1) has kurtosis 6 and the normal distribution (I^2 = 2) has kurtosis 3.

You can use the fact that I(x) ~ 1/x for small x to show that in the limit as I^2 goes to infinity, the kurtosis approaches 9/5.

Related post: Computing skewness and kurtosis in one pass

NFhs5ByHZJ4
External Content
Source RSS or Atom Feed
Feed Location http://feeds.feedburner.com/TheEndeavour?format=xml
Feed Title John D. Cook
Feed Link https://www.johndcook.com/blog
Reply 0 comments