Professional Documents
Culture Documents
BE G I NNE R S T AT I S T I C S
Introduction
Statistical Moments plays a crucial role while we specify our probability distribution to work with since,
with the help of moments, we can describe the properties of statistical distribution. Therefore, they are
helpful to describe the distribution.
In Statistical Estimation and Testing of Hypothesis, which all are based on the numerical values arrived for
each distribution, we required the statistical moments.
So, In this article, we will be discussing primary statistical moments in a detailed manner.
Table of Contents
– Raw Moments
– Centered Moments
– Standardized Moments
In Statistics, Moments are popularly used to describe the characteristic of a distribution. Let’s say the
random variable of our interest is X then, moments are defined as the X’s expected values.
– These are very useful in statistics because they tell you much about your data.
– The four commonly used moments in statistics are- the mean, variance, skewness, and kurtosis.
To be ready to compare different data sets we will describe them using the primary four statistical
moments.
Let’s discuss each of the moments in an exceedingly detailed manner:
– The first central moment is the expected value, known also as an expectation, mathematical expectation,
mean, or average.
It is defined as the sum of all the values the variable can take times the probability of that
value occurring. Intuitively, we can understand this as the arithmetic mean.
Case-2: When all outcomes don’t have the same probability of occurrence
This is the more general equation that includes the probability of each outcome and is defined as the
summation of all the variables multiplied by the corresponding probability.
Conclusion
For equally probable events, the expected value is exactly the same as the Arithmetic Mean. This is one of
the most popular measures of central tendency, which we also called Averages. But, there are some other
common measures also like, Median and Mode.
– It measures the spread of values in the distribution OR how far from the normal.
– Variance represents how a set of data points are spread out around their mean value.
For Example, for a sample dataset, you can find the variance as mentioned below:
Standard deviation
Standard deviation is just a square root of the variance and is commonly used since the unit
of random variable X and Standard deviation is the same, so interpretation is easier.
Mathematical proper ties: The function of variance in both Continuous and differentiable.
For a Population, the Standard Deviation of a sample is a more consistent estimate: If we picked the
repeated samples from a normally distributed population, then the standard deviations of samples are less
spread out as compared to mean
absolute deviations.
Symmetrical distribution
If both tails of a distribution are symmetrical, and the skewness is equal to zero, then that distribution is
symmetrical.
Positively Skewed
In these types of distributions, the right tail (with larger values) is longer. So, this also tells us about
‘outliers’ that have values higher than the mean. Sometimes, this is also referred to as:
– Right-skewed
– Right-tailed
Negatively skewed
In these types of distributions, the left tail (with small values) is longer. So, this also tells us about
‘outliers’ that have values lower than the mean. Sometimes, this is also referred to as:
– Left-skewed
– Left-tailed
For Example, For a Normal Distribution, which is Symmetric, the value of Skewness equals 0 and that
distribution is symmetrical.
In general, Skewness will impact the relationship of mean, median, and mode in the described manner:
– For a positively skewed distribution: Mode < Median < Mean (large tail of high values)
– For a negatively skewed distribution: Mean < Median < Mode (large tail of small values)
But the above generalization is not true for all possible distributions.
For Example, if one tail is long, but the other is heavy, this may not work. The best way to explore your data
is to first compute all three estimators and then try to draw conclusions based on the results, rather than
just focusing on the general rules.
Since, (Mode = 3*Median-2*Mean)
For Negatively skewed (left): Reflect and square[sqrt(constant-x)], reflect and log, reflect
and inverse, etc.
The Fourth Moment
– It focuses on the tails of the distribution and explains whether the distribution is flat or rather with a
high peak. This measure informs us whether our distribution is richer in extreme values than the normal
distribution.
– Kur tosis<3 [Lighter tails]: Negative kurtosis indicates a broad flat distribution.
– Kur tosis>3 [Heavier tails]: Positive kurtosis indicates a thin pointed distribution.
Mesokur tic
These types of distributions are having the kurtosis of 3 or excess kurtosis of 0. This category includes
the normal distribution and some specific binomial distributions.
Leptokur tic
These types of distributions are having a kurtosis greater than 3, or excess kurtosis greater than 0. This is
the distribution with fatter tails and a more narrow peak.
Platykur tic
These types of distributions are having the kurtosis smaller than 3 or excess kurtosis less than
0(negative). This is a distribution with very thin tails compared to the normal distribution.
– Kurtosis is defined as the average of the standardized data raised to the fourth power. Any standardized
values less than |1| (i.e. data within one standard deviation of the mean) will contribute petty to kurtosis.
– The standardized values that will contribute immensely are the outliers.
– Therefore, the high value of Kurtosis alerts about the presence of outliers.
Raw Moments
The raw moment or the n-th moment about zero of a probability density function f(x) is the expected value
of X^n. It is also known as the Crude moment.
Centered Moments
A central moment is a moment of a probability distribution of a random variable defined about the mean of
the random variable’s i.e, it is the expected value of a specified integer power of the deviation of the
random variable from the mean.
Standardized Moments
A standardized moment of a probability distribution is a moment that is normally a higher degree central
moment, but it is normalized typically by dividing the standard deviation which renders the moment scale-
invariant.
Endnotes
I hope that you have enjoyed the article. If you like it, share it with your friends also. Something not
mentioned or want to share your thoughts? Feel free to comment below And I’ll get back to you. 😉
If you want to read my previous blogs, you can read from here.
Here is my Linkedin profile if want to connect with me. Also, You can mail me if you have any doubts about
this article.
The media shown in this ar ticle is not owned by Analytics Vidhya and are used at the Author’s discretion.
CHIRAG GOYAL
I am currently pursuing my Bachelor of Technology (B.Tech) in Computer Science and Engineering from
the Indian Institute of Technology Jodhpur(IITJ). I am very enthusiastic about Machine learning, Deep
Learning, and Artificial Intelligence. Feel free to connect with me on Linkedin.