Root Node For Given Decision Tree

Entropy ([3+,7-])

= (-3/10) log2(3/10) - (7/10) log2 (7/10)

Entropy(S) = 0.881

Entropy for Refund Attribute:

YES = 3/10 NO = 7/10

YES= 0 NO = 3

=3/10(- 0/3 log2 (0/3))- ((3/3) log2 (3/3))

=0

=7/10(- 3/7 log2 (3/7))- ((4/7) log2 (4/7))

= 7/10(0.985)

0.689

Gain = 0.881 – 0.846

Gain= 0.192

Entropy for Martial Status Attribute:

Single= 4/10 Married = 4/10 Divorced = 2/10

=4/10(-2/4 log2(2/4) – (2/4)log2 (2/4))

=4/10(1)

=0.4

4/10(-0/4 log2(0/4) – (4/4)log2 (4/4))

=0

2/10(-1/2 log2(1/2) – (1/2)log2 (1/2))

2/10(1)

0.2

Entropy Gain= 0.881-(0.4 + 0 + 0.2)

Gain= 0.881- 0.6

Gain = 0.281

Entropy for Taxable Income Attribute:

125k= 1/10 100k= 1/10 70k= 1/10

120k= 1/10 95k= 1/10 60k= 1/10

220k= 1/10 85k= 1/10 75k= 1/10

90k= 1/10

=1/10(- 0/1 log2 (0/1)) - (1/1) log2 (1/1)

=0

1/10(- 0/1 log2 (0/1)) - (1/1) log2 (1/1)

=0

1/10(- 0/1 log2 (0/1)) - (1/1) log2 (1/1)

=0

1/10(- 0/1 log2 (0/1)) - (1/1) log2 (1/1)

=0

1/10(- 1/1 log2 (1/1)) - (0/1) log2 (0/1)

=0

1/10(- 0/1 log2 (0/1)) - (1/1) log2 (1/1)

=0

1/10(- 0/1 log2 (0/1)) - (1/1) log2 (1/1)

=0

1/10(- 1/1 log2 (1/1)) - (0/1) log2 (0/1)

=0

1/10(- 0/1 log2 (0/1)) - (1/1) log2 (1/1)

=0

1/10(- 1/1 log2 (1/1)) - (0/1) log2 (0/1)

=0

Entropy Gain = 0.881- (0+0+0+0+0+0+0+0+0+0)

Gain = 0.881