Unit II-Full
Unit II-Full
TYPES OF DATA
Any statistical analysis is performed on data, a collection of actual
observations or scores in a survey or an experiment.
Data
A collection of actual observations or scores in a survey or an experiment.
Qualitative Data
A set of observations where any single observation is a word, letter, or
numerical code that represents a class or category.
Example:
Ranked Data
A set of observations where any single observation is a number that
indicates relative standing.
1 SXCCE
IT22601-DS-UNIT-II III CSE
B
anything that can take on different values across your data set (e.g., height or
test scores).
There are 4 levels of measurement:
Nominal: the data can only be categorized
Ordinal: the data can be categorized and ranked
Interval: the data can be categorized, ranked, and evenly spaced
Ratio: the data can be categorized, ranked, evenly spaced, and has a
natural zero.
1- Independent 1- Suburbs
M- Male
2- Democrat 2- City
F- Female
3- Republican 3- Town
3 SXCCE
IT22601-DS-UNIT-II III CSE
B
Example
Status at workplace, tournament team rankings, order of product quality,
and order of agreement or satisfaction are some of the most common
examples of the ordinal Scale. These scales are generally used in market
research to gather and evaluate relative feedback about product
satisfaction, changing perceptions with product upgrades, etc.
For example, a semantic differential scale question such
as: How satisfied are you with our services?
Very Unsatisfied – 1
Unsatisfied – 2
Neutral – 3
Satisfied – 4
Very Satisfied – 5
This scale not only assigns values to the variables but also measures the
rank or order of the variables, such as:
Grades
Satisfaction
Happiness
Interval
Unlike the ratio scale, interval data has no true zero; in other
words, a value of zero on an interval scale does not mean the
variable is absent. This is best explained using temperature as an
example. A temperature of zero degrees Fahrenheit doesn’t mean
there is “no temperature” to be measured—rather, it signifies a
very low or cold temperature.
4 SXCCE
IT22601-DS-UNIT-II III CSE
B
Ratio
The fourth and final level of measurement is the ratio level. Just like the
interval scale, the ratio scale is a quantitative level of measurement with
equal intervals between each point. What sets the ratio scale apart is that
it has a true zero. That is, a value of zero on a ratio scale means that the
variable you’re measuring is absent.
Population is a good example of ratio data. If you have a population
count of zero people, this means there are no people!
5 SXCCE
IT22601-DS-UNIT-II III CSE
B
6 SXCCE
IT22601-DS-UNIT-II III CSE
B
TYPES OF VARIABLES
Variable
A characteristic or property that can take on different values.
Example
'income' is a variable that can vary between data units in a population (i.e.
the people or businesses being studied may not have the same incomes)
and can also vary over time for each data unit (i.e. income can go up or
down).
Constant
A characteristic or property that can take on only one value.
Example
The size of a shoe or cloth or any apparel will not change at any point.
7 SXCCE
IT22601-DS-UNIT-II III CSE
B
Discrete Variable
Discrete variable is a variable whose value is obtained by counting.
Examples include most counts, such as the number of children in a family
(1, 2,3, etc.); the number of foreign countries you have visited; and the
current size of the U.S. population.
Continuous Variable
A continuous variable is defined as a variable which can take an
uncountable set of values or infinite set of values.
The height can’t take any values. It can’t be negative and it can’t be
higher than three metres. But between 0 and 3, the number of possible
values is theoretically infinite. A student may be 1.6321748755 … metres
tall. The reported height would be rounded to the nearest centimetre, so it
would be
1.63 metres. The age is another example of a continuous variable that is
typically rounded down.
Approximate Numbers
Numbers that are rounded off, as is always the case with values for
continuous variables.
Experiment
A study in which the investigator decides who receives the special treatment.
Independent Variable
In an experiment, an independent variable is a treatment manipulated by
the investigator.
Dependent Variable
A variable that is believed to have been influenced by the independent
variable.
Example
If one wants to measure the influence of different quantities of nutrient
intake on the growth of an infant, then the amount of nutrient intake can
be the independent variable, with the dependent variable as the growth of
an infant measured by height, weight or other factor(s) as per the
requirements of the experiment.
8 SXCCE
IT22601-DS-UNIT-II III CSE
B
9 SXCCE
IT22601-DS-UNIT-II III CSE
B
10 SXCCE
IT22601-DS-UNIT-II III CSE
B
Example: Listed in Table 2.2 is the class 210–219 and its frequency of zero. It
would be incorrect to skip this class because of its zero frequency.
3. All classes should have equal intervals.
Example: 130–139, 140–149, 150–159, etc. It would be incorrect to use 130– 139,
140–159, etc., in which the second class interval (140–159) is twice as wide as
the first class interval (130–139).
Optional
4. All classes should have both an upper boundary and a lower boundary.
Example: 240–249. Less preferred would be 240–above, in which no maximum
value can be assigned to observations in this class.
5. Select the class interval from convenient numbers, such as 1, 2, 3, . . . 10,
particularly 5 and 10 or multiples of 5 and 10.
Example: 130–139, 140–149, in which the class interval of 10 is a convenient
number. Less preferred would be 130–142, 143–155, etc., in which the class
interval of 13 is not a convenient number.
6. The lower boundary of each class interval should be a multiple of the class
interval.
Example: 130–139, 140–149, in which the lower boundaries of 130, and 140, are
multiples of 10, the class interval. Less preferred would be 135–144, 145–154,
etc., in which the lower boundaries of 135 and 145 are not multiples of 10, the
class interval.
7. Aim for a total of approximately 10 classes.
Example: The distribution in Table 2.2 uses 12 classes. Less preferred would be
the distributions in Tables 2.3 and 2.4. The distribution in Table 2.3 has too few
classes (3), whereas the distribution in Table 2.4 has too many classes (24).
11 SXCCE
IT22601-DS-UNIT-II III CSE
B
Table 2.5 Quantitative data: weights (in pounds) of male Statistics students
1. Find the range, that is, the difference between the largest and
smallest observations. The range of weights in Table 2.5 is 245 133
= 112.2.
2. Find the class interval required to span the range by dividing the
range by the desired number of classes (ordinarily 10). In the
present example,
12 SXCCE
IT22601-DS-UNIT-II III CSE
B
5. Determine where the lowest class should end by adding the class
interval to the lower boundary and then subtracting one unit of
measurement. In the present example, add 10 to 130 and then
subtract 1, the unit of measurement, to obtain 139—the number at
which the lowest class should end.
7. Indicate with a tally the class in which each observation falls. For
example, the first score in Table 2.5, 160, produces a tally next to
160–169; the next score, 193, produces a tally next to 190–199;
and so on.
9. Supply headings for both columns and a title for the table.
OUTLIERS
13 SXCCE
IT22601-DS-UNIT-II III CSE
B
Percentages or Proportions
Some people prefer to deal with percentages rather than proportions
because percentages usually lack decimal points. A proportion always
varies between 0 and 1, whereas a percentage always varies between 0
percent and 100 percent.
To convert the relative frequencies in Table 2.6 from proportions to
percentages, multiply each proportion by 100; that is, move the decimal
14 SXCCE
IT22601-DS-UNIT-II III CSE
B
point two places to the right. For example, multiply .06 (the proportion for
the class 130–139) by 100 to obtain 6 percent.
15 SXCCE
IT22601-DS-UNIT-II III CSE
B
Features of histograms
Equal units along the horizontal axis (the X axis, or abscissa) reflect the
various class intervals of the frequency distribution.
Equal units along the vertical axis (the Y axis, or ordinate) reflect
increases in frequency.
The intersection of the two axes defines the origin at which both
numerical scales equal 0.
Numerical scales always increase from left to right along the horizontal
axis and from bottom to top along the vertical axis. It is considered good
practice to use wiggly lines to highlight breaks in scale, such as those
along the horizontal axis in Figure 2.5, between the origin of 0 and the
smallest class of 130–139.
16 SXCCE
IT22601-DS-UNIT-II III CSE
B
17 SXCCE
IT22601-DS-UNIT-II III CSE
B
18 SXCCE
IT22601-DS-UNIT-II III CSE
B
Stem and leaf displays are ideal for summarizing distributions, such as
that for weight data, without destroying the identities of individual
observations.
A device for sorting quantitative data on the basis of leading and trailing
digits.
Constructing a Display
The leftmost panel of Fig.2.7, shows the weights of the 53 male statistics
students.
To construct the stem and leaf display for these data, first note that, when
counting by tens, the weights range from the 130s to the 240s. Arrange a
column of numbers, the stems, beginning with 13 (representing the 130s)
and ending with 24 (representing the 240s). Draw a vertical line to
separate the stems, which represent multiples of 10, from the space to be
occupied by the leaves, which represent multiples of 1.
Fig 2.7 Constructing stem and leaf display from weights of male Statistics students
Next, enter each raw score into the stem and leaf display.
In the shaded coding in Fig 2.7, the first raw score of 160 reappears as a
leaf of 0 on a stem of 16. The next raw score of 193 reappears as a leaf of
3 on a stem of 19, and the third raw score of 226 reappears as a leaf of 6
on a stem of 22, and so on, until each raw score reappears as a leaf on its
appropriate stem.
Interpretation
The weight data have been sorted by the stems. All weights in the 130s
are listed together; all of those in the 140s are listed together, and so on.
19 SXCCE
IT22601-DS-UNIT-II III CSE
B
TYPICAL SHAPES
Whether expressed as a histogram, a frequency polygon, or a stem and
leaf display, an important characteristic of a frequency distribution is its
shape.
Figure 2.8 shows some of the more typical shapes for smoothed
frequency polygons.
Bimodal
Any distribution that approximates the bimodal shape reflects the
coexistence of two different types of observations in the same
distribution. For instance, the distribution of the ages of residents in a
neighborhood consisting largely of either new parents or their infants has
a bimodal shape.
The Bimodal shape of the histogram is shown in fig.2.9.
20 SXCCE
IT22601-DS-UNIT-II III CSE
B
Negatively Skewed
A lopsided distribution caused by a few extreme observations in the
negative direction (to the left of the majority of observations), as in panel
D of Figure 2.8, is a negatively skewed distribution. T
The distribution of ages at retirement among U.S. job holders has a
pronounced negative skew, with most retirement ages at 60 years or older
and relatively few retirement ages spanning the wide range of ages
younger than 60.
21 SXCCE
IT22601-DS-UNIT-II III CSE
B
Gaps are placed between adjacent bars of bar graphs to emphasize the
discontinuous nature of qualitative data.
A bar graph also can be used with quantitative data to emphasize the
discontinuous nature of a discrete variable, such as the number of children in
a family.
22 SXCCE
IT22601-DS-UNIT-II III CSE
B
23 SXCCE
IT22601-DS-UNIT-II III CSE
B
6. Using the scaled axes, construct bars (or dots and lines) to reflect the
frequency of observations within each class interval. For frequency
polygons, dots should be located above the midpoints of class intervals,
and both tails of the graph should be anchored to the horizontal axis.
7. Supply labels for both axes and a title for the graph.
24 SXCCE
IT22601-DS-UNIT-II III CSE
B
Being bell shaped, the normal curve peaks above a point midway along
the horizontal spread and then tapers off gradually in either direction
from the peak.
The values of the mean, median (or 50th percentile), and mode, located at
a point midway along the horizontal spread, are the same for the normal
curve.
Importance of Mean and Standard Deviation
When using the normal curve, two bits of information are
indispensable: values for the mean and the standard deviation.
For example, for the original distribution of 3091 men, the mean height
equals 69 inches and the standard deviation equals 3 inches.
25 SXCCE
IT22601-DS-UNIT-II III CSE
B
z SCORES
A z score is a unit-free, standardized score that, regardless of the original
units of measurement, indicates how many standard deviations a score is
above or below the mean of its distribution.
To obtain a z score, express any original score, whether measured in
inches, milliseconds, dollars, IQ points, etc., as a deviation from its mean
(by subtracting its mean) and then split this deviation into standard
deviation units (by dividing by its standard deviation), that is,
A z score of 2.00 always signifies that the original score is exactly two
standard deviations above its mean.
Similarly, a z score of –1.27 signifies that the original score is exactly
1.27 standard deviations below its mean. A z score of 0 signifies that the
original score coincides with the mean.
Converting to z Scores
Replace X with 66 (the maximum permissible height), μ with 69 (the
mean height), and σ with 3 (the standard deviation of heights) and solve
for z as follows:
This informs that the cutoff height is exactly one standard deviation
below the mean.
26 SXCCE
IT22601-DS-UNIT-II III CSE
B
27 SXCCE
IT22601-DS-UNIT-II III CSE
B
FINDING PROPORTIONS
Finding Proportions for One Score
1. Sketch a normal curve and shade in the target area.
2. Plan your solution according to the normal table.
3. Convert X to z.
Exam scores for a large psychology class approximate a normal curve with a
mean of 230 and a standard deviation of 50. Furthermore, students are graded
“on a curve,” with only the upper 20 percent being awarded grades of A. What
is the lowest score on the exam that receives an A?
Solution
1. Sketch a normal curve and, on the correct side of the mean, draw a
line representing the target score, as in Figure 2.16. It’s often helpful to
visualize the target score as splitting the total area into two sectors—one
to the left of (below) the target score and one to the right of (above) the
target score. For example, in the present case, the target score is the point
along the base of the curve that splits the total area into 80 percent,
or .8000 to the left, and 20 percent, or .2000 to the right. The mean of a
normal curve serves as a valuable frame of reference since it always splits
the total area into two equal halves—.5000 to the left of the mean and
.5000 to the right of the mean. Since more than .5000—that is, .8000—of
the total area is to
28 SXCCE
IT22601-DS-UNIT-II III CSE
B
the left of the target score, this score must be on the upper or right side of the
mean. On the other hand, if less than .5000 of the total area had been to
the left of the target score, this score would have been placed on the
lower or left side of the mean.
2. Plan your solution according to the normal table. In problems of this type,
plan how to find the z score for the target score. Because the target score
is on the right side of the mean, concentrate on the area in the upper half
of the normal curve, as described in columns B and C. The right panel of
Figure 5.16 indicates that either column B or C can be used to locate a z
score in column A. It is crucial, however, to search for the single value
(.3000) that is valid for column B or the single value (.2000) that is valid
for column C. Note that we look in column B for .3000, not for .8000.
Normal Table is not designed for sectors, such as the lower .8000, that
span the mean of the normal curve.
4. Convert z to the target score. Finally, convert the z score of 0.84 into an
exam score, given a distribution with a mean of 230 and a standard
deviation of 50. A z score indicates how many standard deviations the
original score is above or below its mean. In the present case, the target
score must be located .84 of a standard deviation above its mean. The
distance of the target score above its mean equals 42 (from .84 × 50),
which, when added to the mean of 230, yields a value of 272. Therefore,
272 is the lowest score on the exam that receives an A.
where,
X is the target score, expressed in original units of measurement;
μ and σ are the mean and the standard deviation, respectively, for the
original normal curve; and
z is the standard score read from column A or A′ of Normal Table.
When appropriate numerical substitutions are made, as shown in the
bottom of Figure 2.16, 272 is found to be the answer.
1. Sketch a normal curve. On either side of the mean, draw two lines
representing the two target scores, as in Figure 2.17. The smaller (driest) target
score splits the total area into .0250 to the left and .9750 to the right, and the
larger (wettest) target score does the exact opposite.
30 SXCCE
IT22601-DS-UNIT-II III CSE
B
3. Plan your solution according to the normal table. Because the smaller
target score is located on the lower or left side of the mean, we will
concentrate on the area in the lower half of the normal curve, as described
in columns B′ and C′. The target z score can be found by scanning either
column B′ for .4750 or column C′ for .0250. After finding the smaller
target score, we will capitalize on the symmetrical properties of normal
curves to find the value of the larger target score.
4. Find z. Referring to Normal Table, we can scan column B′ for .4750, or
the entry nearest to .4750. In this case, .4750 appears in column B′, and
the corresponding z score in column A′ equals –1.96. The same z score
of –
1.96 would have been obtained if column C′ had been searched for a value of
.0250.
5. Convert z to the target score. When the appropriate numbers are
substituted in Formula , the smaller target score equals
14.16 inches, the amount of annual rainfall that separates the driest 2.5
percent of all years from all of the other years.
31 SXCCE
IT22601-DS-UNIT-II III CSE
B
Standard Score
Any unit-free scores expressed relative to a known mean and a known
standard deviation.
32 SXCCE
IT22601-DS-UNIT-II III CSE
B
Example
Find the mode of 4, 4, 4, 9, 15, 15, 15, 27, 37, 48 data set.
Solution:
Given: 4, 4, 4, 9, 15, 15, 15, 27, 37, 48 is the data set.
As we know, a data set or set of values can have more than one mode if
more than one value occurs with equal frequency and number of time
compared to the other values in the set.
Hence, here both the number 4 and 15 are modes of the set.
MEDIAN
The median reflects the middle value when observations are ordered from
least to most.
To find the median:
1. Put the data in an array. (arrange in ascending or descending order)
2A. If the data set has an ODD number of numbers, the median is the middle
value.
2B. If the data set has an EVEN number of numbers, the median is the
AVERAGE of the middle two values.
33 SXCCE
IT22601-DS-UNIT-II III CSE
B
Example
The number of rooms in the seven five stars hotel in Chennai city is 71,
30, 61, 59, 31, 40 and 29. Find the median number of rooms.
Solution:
Arrange the data in ascending order 29, 30, 31, 40, 59, 61, 71
n = 7 (odd)
Median = 7+1 / 2 = 4th positional value
Median = 40 rooms
MEAN
The mean is found by adding all scores and then dividing by the number
of scores.
Population
A complete set of scores.
Sample
A subset of scores.
Sample Mean (x̅ )
The balance point for a sample is found by dividing the sum of the values
of all scores in the sample by the number of scores in the sample.
Sample Size (n)
The total number of scores in the sample.
Population Mean (μ)
The balance point for a population, found by dividing the sum for all
scores in the population by the number of scores in the population.
Population Size (N)
The total number of scores in the population.
34 SXCCE
IT22601-DS-UNIT-II III CSE
B
Example
A data set with 10 data points is given. Calculate Population Mean for that. Data
set : {14,61,83,92,2,8,48,25,71,12}.
Solution
Example
Find the sample mean of 60, 57, 109, 50.
Solution:
To find: Sample mean
Sum of terms = 60 + 57 + 109 + 50 = 276
Number of terms = 4
Using sample mean formula,
mean = (sum of terms)/(number of terms) mean
= 276/4 = 69
35 SXCCE
IT22601-DS-UNIT-II III CSE
B
36 SXCCE
IT22601-DS-UNIT-II III CSE
B
37 SXCCE
IT22601-DS-UNIT-II III CSE
B
38 SXCCE
IT22601-DS-UNIT-II III CSE
B
DESCRIBING VARIABILITY
Importance of Variability
Variability assumes a key role in the analysis of research results.
To illustrate the importance of variability, Figure 2.21 shows the
outcomes for two fictitious experiments, each with the same mean
difference of 2, but with the two groups in experiment B having less
variability than the two groups in experiment C.
In Figure 2.21, the new group B* retains exactly the same (intermediate)
variability as group B, each of its seven scores and its mean have been
shifted 2 units to the right. Likewise, although the new group C* retains
exactly the same (most) variability as group C, each of its seven scores
and its mean have been shifted 2 units to the right.
Consequently, the mean difference of 2 (from 12 − 10 = 2) is the same for
both experiments.
The mean difference for experiment B should seem more apparent
because of the smaller variabilities within both groups B and B*. It’s
easier to see a difference between group means when variabilities within
groups are reduced.
Fig.2.21 Two experiments with the same mean difference but dissimilar
variabilities.
Range
The difference between the largest and smallest scores.
Example
Following are the marks of students in Mathematics: 50, 53, 50, 51, 48, 93,
90, 92, 91, 90. Find the range of the marks.
Solution:
Arrange the following marks in ascending order, we get; 48,
39 SXCCE
IT22601-DS-UNIT-II III CSE
B
Range = 93 – 48 = 45
VARIANCE
The mean of all squared deviation scores.
Example
There are 45 students in a class. 5 students were randomly selected from
this class and their heights (in cm) were recorded as follows:
Solution
40 SXCCE
IT22601-DS-UNIT-II III CSE
B
Standard Deviation
A rough measure of the average (or standard) amount by which scores
deviate on either side of their mean.
Example
You grow 20 crystals from a solution and measure the length of each
crystal in millimeters. Here is your data:
Solution
1. Calculate the mean of the data. Add up all the numbers and divide by
the total number of data points.
(9+2+5+4+12+7+8+11+9+3+7+4+12+5+4+10+9+6+9+4)/20 = 140/20
=7
2. Subtract the mean from each data point (or the other way around, if
you prefer... you will be squaring this number, so it does not matter if
it is positive or negative).
(9 - 7)2 = (2)2 = 4
(2 - 7)2 = (-5)2 = 25
(5 - 7)2 = (-2)2 = 4
41 SXCCE
IT22601-DS-UNIT-II III CSE
B
(4 - 7)2 = (-3)2 = 9
(12 - 7)2 = (5)2 = 25
(7 - 7)2 = (0)2 = 0
(8 - 7)2 = (1)2 = 1
(11 - 7)2 = (4)2 = 16
(9 - 7)2 = (2)2 = 4
(3 - 7)2 = (-4)2 = 16
(7 - 7)2 = (0)2 = 0
(4 - 7)2 = (-3)2 = 9
(12 - 7)2 = (5)2 = 25
(5 - 7)2 = (-2)2 = 4
(4 - 7)2 = (-3)2 = 9
(10 - 7)2 = (3)2 = 9
(9 - 7)2 = (2)2 = 4
(6 - 7)2 = (-1)2 = 1
(9 - 7)2 = (2)2 = 4
(4 - 7)2 = (-3)2 = 9
42 SXCCE
IT22601-DS-UNIT-II III CSE
B
43 SXCCE
IT22601-DS-UNIT-II III CSE
B
44 SXCCE