Professional Documents
Culture Documents
Multinomial Logistic Regression Model
Multinomial Logistic Regression Model
3Q
0.6826
Max
2.1667
Coefficients:
(Intercept)
OBS.
CHK_ACCT1
CHK_ACCT2
CHK_ACCT3
DURATION
HISTORY1
HISTORY2
HISTORY3
HISTORY4
NEW_CAR1
USED_CAR1
FURNITURE1
RADIO.TV1
EDUCATION1
RETRAINING1
AMOUNT
SAV_ACCT1
SAV_ACCT2
SAV_ACCT3
SAV_ACCT4
EMPLOYMENT1
EMPLOYMENT2
EMPLOYMENT3
EMPLOYMENT4
INSTALL_RATE
MALE_DIV1
MALE_SINGLE1
MALE_MAR_or_WID1
CO.APPLICANT1
GUARANTOR1
PRESENT_RESIDENT2
PRESENT_RESIDENT3
PRESENT_RESIDENT4
REAL_ESTATE1
PROP_UNKN_NONE1
AGE
OTHER_INSTALL1
RENT1
OWN_RES1
NUM_CREDITS
JOB1
JOB2
JOB3
NUM_DEPENDENTS
TELEPHONE1
FOREIGN1
--Signif. codes: 0
Estimate
3.845e+00
-1.876e-04
2.332e-01
1.289e+00
1.919e+00
-3.838e-02
3.489e-01
2.814e-01
9.736e-01
1.359e+00
-8.630e-01
7.467e-01
-1.056e-01
1.391e-01
-9.581e-01
-1.674e-01
-4.979e-05
1.117e-01
1.622e-01
1.377e+00
6.389e-01
-2.908e-01
6.881e-02
6.602e-01
3.417e-01
-2.501e-01
-8.216e-03
7.119e-01
4.051e-01
-4.719e-01
1.088e+00
-9.478e-01
-6.630e-01
-5.868e-01
1.165e-01
-7.700e-01
6.289e-03
-8.779e-01
-4.826e-01
-2.454e-01
-5.254e-01
-1.325e+00
-1.331e+00
-1.164e+00
-2.086e-01
3.512e-01
2.316e+00
***
Std. Error
1.513e+00
3.579e-04
2.591e-01
4.500e-01
2.910e-01
1.159e-02
7.044e-01
5.543e-01
6.035e-01
5.605e-01
4.858e-01
6.146e-01
4.989e-01
4.872e-01
6.233e-01
5.659e-01
5.345e-05
3.398e-01
4.792e-01
6.390e-01
3.161e-01
5.584e-01
5.247e-01
5.782e-01
5.297e-01
1.083e-01
4.430e-01
2.534e-01
4.008e-01
5.181e-01
5.222e-01
3.751e-01
4.123e-01
3.741e-01
2.655e-01
4.484e-01
1.122e-02
2.691e-01
5.596e-01
5.331e-01
2.405e-01
9.760e-01
9.562e-01
9.584e-01
3.104e-01
2.394e-01
1.077e+00
0.001
** 0.01
z value
2.541
-0.524
0.900
2.864
6.596
-3.311
0.495
0.508
1.613
2.424
-1.777
1.215
-0.212
0.286
-1.537
-0.296
-0.932
0.329
0.338
2.156
2.021
-0.521
0.131
1.142
0.645
-2.309
-0.019
2.809
1.011
-0.911
2.083
-2.527
-1.608
-1.568
0.439
-1.717
0.561
-3.263
-0.862
-0.460
-2.185
-1.357
-1.392
-1.214
-0.672
1.467
2.150
*
Pr(>|z|)
0.011063
0.600145
0.368052
0.004178
4.24e-11
0.000928
0.620328
0.611723
0.106666
0.015339
0.075613
0.224365
0.832362
0.775217
0.124250
0.767376
0.351560
0.742349
0.735024
0.031118
0.043273
0.602564
0.895663
0.253549
0.518784
0.020916
0.985202
0.004963
0.312121
0.362367
0.037222
0.011502
0.107852
0.116783
0.660838
0.085923
0.575095
0.001104
0.388469
0.645295
0.028914
0.174667
0.163873
0.224595
0.501558
0.142272
0.031557
0.05 .
0.1
*
**
***
***
*
.
*
*
*
**
*
*
.
**
*
*
1
Variable importance
CHK_ACCT
DURATION
OBS.
27
12
7
SAV_ACCT
USED_CAR
TATE
7
4
2
EMPLOYMENT
MALE_SINGLE
NTOR
2
2
1
AGE
INSTALL_RATE
1
1
AMOUNT
HISTORY
12
10
JOB PRESENT_RESIDENT
3
RADIO.TV
PROP_UNKN_NONE
TELEPHONE
1
MALE_DIV
1
REAL_ES
GUARA
DURATION
PROP_UNKN_NONE
REAL_ESTATE
HISTORY
GUARANTOR
Surrogate splits:
AMOUNT
PROP_UNKN_NONE
HISTORY
USED_CAR
JOB
< 22.5
splits
splits
splits
splits
as
as
as
as
to the right,
RL,
LR,
LLRRR,
LR,
improve=10.490890,
improve= 7.581000,
improve= 6.046863,
improve= 5.597884,
improve= 5.124977,
< 2805.5
splits as
splits as
splits as
splits as
to the right,
RL,
LLRLR,
RL,
RRRL,
agree=0.767,
agree=0.643,
agree=0.603,
agree=0.603,
agree=0.603,
(0
(0
(0
(0
(0
missing)
missing)
missing)
missing)
missing)
adj=0.453,
adj=0.161,
adj=0.068,
adj=0.068,
adj=0.068,
(0
(0
(0
(0
(0
split)
split)
split)
split)
split)
missing)
missing)
missing)
missing)
missing)
missing)
missing)
missing)
missing)
missing)
class counts:
14
4
probabilities: 0.778 0.222
Node number 11: 199 observations,
complexity param=0.01315789
predicted class=1 expected loss=0.3065327 P(node) =0.2842857
class counts:
61 138
probabilities: 0.307 0.693
left son=22 (168 obs) right son=23 (31 obs)
Primary splits:
OBS.
< 120.5 to the right, improve=4.301556, (0 missing)
AMOUNT
< 1373
to the left, improve=3.755116, (0 missing)
EMPLOYMENT splits as LLLRL,
improve=2.800175, (0 missing)
JOB
splits as LRLL,
improve=2.650923, (0 missing)
AGE
< 25.5
to the left, improve=2.638117, (0 missing)
Surrogate splits:
SAV_ACCT splits as LLRLL, agree=0.854, adj=0.065, (0 split)
Node number 18: 125 observations,
complexity param=0.01594896
predicted class=0 expected loss=0.392 P(node) =0.1785714
class counts:
76
49
probabilities: 0.608 0.392
left son=36 (26 obs) right son=37 (99 obs)
Primary splits:
DURATION
< 43.5
to the right, improve=5.023782, (0 missing)
INSTALL_RATE < 2.5
to the right, improve=2.120279, (0 missing)
USED_CAR
splits as LR,
improve=2.019099, (0 missing)
AGE
< 27.5
to the left, improve=1.768127, (0 missing)
MALE_SINGLE splits as LR,
improve=1.741538, (0 missing)
Surrogate splits:
AMOUNT < 14369.5 to the right, agree=0.8, adj=0.038, (0 split)
Node number 19: 24 observations
predicted class=1 expected loss=0.2916667 P(node) =0.03428571
class counts:
7
17
probabilities: 0.292 0.708
Node number 22: 168 observations,
complexity param=0.01315789
predicted class=1 expected loss=0.3511905 P(node) =0.24
class counts:
59 109
probabilities: 0.351 0.649
left son=44 (127 obs) right son=45 (41 obs)
Primary splits:
JOB
splits as LRLL,
improve=3.532445, (0 missing)
OBS.
< 200
to the left, improve=2.723968, (0 missing)
AMOUNT
< 1513
to the left, improve=2.720443, (0 missing)
EMPLOYMENT splits as LLLRL,
improve=2.597305, (0 missing)
GUARANTOR splits as LR,
improve=2.591315, (0 missing)
Surrogate splits:
AMOUNT < 736
to the right, agree=0.786, adj=0.122, (0 split)
SAV_ACCT splits as LLRLL,
agree=0.762, adj=0.024, (0 split)
Node number 23: 31 observations
predicted class=1 expected loss=0.06451613 P(node) =0.04428571
class counts:
2
29
probabilities: 0.065 0.935
Node number 36: 26 observations
predicted class=0 expected loss=0.1153846 P(node) =0.03714286
class counts:
23
3
probabilities: 0.885 0.115
split)
split)
split)
split)
split)
Primary splits:
REAL_ESTATE splits as LR,
improve=3.250112, (0 missing)
GUARANTOR splits as LR,
improve=2.346767, (0 missing)
DURATION
< 8.5
to the right, improve=2.321053, (0 missing)
OBS.
< 676.5 to the left, improve=2.033858, (0 missing)
AGE
< 47.5
to the left, improve=1.753068, (0 missing)
Surrogate splits:
GUARANTOR splits as LR,
agree=0.807, adj=0.389, (0 split)
RADIO.TV splits as LR,
agree=0.754, adj=0.222, (0 split)
OBS.
< 949
to the left, agree=0.719, adj=0.111, (0 split)
AMOUNT
< 1513
to the left, agree=0.719, adj=0.111, (0 split)
FOREIGN splits as LR,
agree=0.719, adj=0.111, (0 split)
Node number 89: 70 observations,
complexity param=0.01315789
predicted class=1 expected loss=0.3142857 P(node) =0.1
class counts:
22
48
probabilities: 0.314 0.686
left son=178 (9 obs) right son=179 (61 obs)
Primary splits:
OBS.
< 246
to the left, improve=4.437367, (0
EMPLOYMENT
splits as RRLRL,
improve=2.944455, (0
PRESENT_RESIDENT splits as RLRL,
improve=2.878912, (0
AMOUNT
< 6970
to the right, improve=2.488889, (0
AGE
< 26.5
to the left, improve=2.344803, (0
Surrogate splits:
CO.APPLICANT splits as RL, agree=0.886, adj=0.111, (0 split)
missing)
missing)
missing)
missing)
missing)
"OBS."
"PRESENT_RESIDENT"
1 71 420
Min. 1st Qu. Median
Mean 3rd Qu.
Max.
0.2889 0.2889 0.2889 0.2889 0.2889 0.2889
0 1
209 491
0
1
FALSE TRUE
41 50
30 179
Classification tree:
tree(formula = RESPONSE ~ ., data = GermanTest)
Variables actually used in tree construction:
[1] "CHK_ACCT"
"SAV_ACCT"
"HISTORY"
[6] "DURATION"
"MALE_DIV"
"AGE"
"
[11] "INSTALL_RATE"
Number of terminal nodes: 23
Residual mean deviance: 0.6191 = 171.5 / 277
Misclassification error rate: 0.1233 = 37 / 300
"OTHER_INSTALL" "OBS."
"AMOUNT"
"EMPLOYMENT