Professional Documents
Culture Documents
Key words: Supplier selection, fuzzy analytic network process (FANP), artificial neural network (ANN).
INTRODUCTION
In todays highly competitive markets, supplier selection and consequently the rise of cost and the customer
for success of organizations is crucial for competitiveness dissatisfaction. The purpose of supplier selection is to
(Weber et al., 2000). Furthermore, the ever increasing select these suppliers, who will supply the needed
complexity of the production process increases the services and products at the right time and quality. The
importance of supplier selection. In many organizations, aim of supplier selection is to identify supplier with the
the cost of supplied raw material and semi product rises highest potential for meeting a companys needs
as far as 70% of total cost (Ghodsypour and OBrien, consistently.
1998). Therefore, mistakes in the selection of supplier Supplier selection is difficult in decision making
cause the following: production of sub-standard product, problem for organizations. The difficulties are stated
cancelation or delaying of orders, production problems below (Weber et al., 2000, Muralidharan et al., 2001;
Benyoucef et al., 2003; Talluri and Sarkis, 2002):
multi criteria decision making techniques select supermatrix. As a result, limit supermatrix shows the importance of
environment friendly supplier selection. Wu (2009) alternatives.
One of the weakness of the ANP is that when the number of
integrated decision tree and ANN approaches and used criteria and sub criteria are increased, number of pair wise
in supplier selection. Carrera (2007) developed a comparison are dramatically become larger. Thus, it takes more
decision making method through ANN-ANP and used in time. Nevertheless, ANP provides more flexibility in constructing a
supplier selection. decision model for real situations.
X x1 , x2 ,, xn be
problem. Interdependence and feedback were not considered for
criteria and alternatives in the AHP. Saaty (1996) developed an Let an object set and
G g1 , g2 ,, gm be
analytical network process (ANP) to eliminate such weaknesses.
Decision makers (DMs) identify criteria and sub criteria for a goal set. Each object is taken and
evaluation alternatives. Criteria and their sub criteria can be
separately formed as a cluster. In addition, alternatives can also be extent analysis for each goal is performed, according to this
considered as an alternative cluster. Relationships among clusters method. Thus, m extent analysis values for each object can be
and elements inside clusters are defined as follows: Unidirect obtained with the following signs:
relationship means there is a relationship from one cluster to
another. Indirect relationship means that there is no direct relation
between two clusters but one cluster can be affected by third M (1gi ) , M (2gi ) ....., M (mgi ) , i 1, 2,...., n where all the
cluster. Another relationship is a self-interaction that there is a
relationship among sub criteria in the same cluster. The last one is M gji ( j 1, 2,, m) are triangular fuzzy numbers (TFNs). The
called interrelationship which represents a relationship among extent analysis method steps are presented below:
criteria. After completing network, pair wise comparisons are carried
out among criteria, sub criteria and alternatives.
Priority values are obtained from pair wise comparison matrix. Step 1
These values are located into a unweighted supermatrix. Weighted
supermatrix is formed with multiplication of local weights of criteria
and priorities of sub criteria from unweighted supermatrix. Limit The value of fuzzy synthetic extent with respect to the i th object is
supermatrix is obtained by taking adequate power of the weighted defined as:
Goztepe and Boran 3705
M% 1
1
n m 1 1
M n .
j
, n , n (5)
i 1
gi
ui mi li
1.0
j 1
i 1 i 1 i 1
Step 2
1, if m2 m1 ,
V ( M 2 M1 ) hgt ( M1 M 2 ) M 2 (d ) 0 if l1 u2 ,
l1 u2
otherwise,
(m2 u2 ) (m1 u1 )
(7)
Step 3
Figure 2. Intersection between M1 and M2.
The degree possibility for a convex fuzzy number to be greater than
k convex fuzzy numbers, M i (i 1, 2,..., k ) can be defined by
1
m n m V (M M1 , M 2 ,...., M k ) V (M M1 ) and (M M 2 ) and .....and (M M k
Si M j
gi M j
gi (2)
min V (M M i ), i 1, 2,...., k (8)
j 1 i 1 j 1
Assume that
m
To obtain
j 1
M gji , perform the fuzzy addition operation of m
extent analysis values for a particular matrix such that d ' ( Ai ) min V (Si Sk ) (9)
Step 4
n m
j n n n
M gi i i ui
l , m , (4) Via normalization, the normalized weight vectors are
i 1 j 1 i 1 i 1 i 1
w (d ( A1 ), d ( A2 ),...., d ( An ))T (11)
and then compute the inverse of the vector in Equation (11) such
that where W is a non fuzzy number.
3706 Sci. Res. Essays
Step 3
Step 9
Generate ANP model: Each main criteria, criteria and sub criteria
forms a cluster. The relationship among criteria of clusters or the Verify results: The values of local weights found by fuzzy ANP are
relationship among sub criteria of other clusters forms a network compared by weights of ANN model that learns these values.
Goztepe and Boran 3707
In determining criteria and sub criteria, the opinions of Step 4: Determine fuzzy pair wise matrices
team members were taken and data derived from
literature (Carrera, 2007; Jharkhariaa and Shankar, 2005; Pair wise forms were filled by members of the expert
Langey et al., 2003; Sarkis, 2003; Meade and Sarkis team in order to find importance of weight of criteria. One
1998; Ravi et al., 2005; Yang and Chen, 2006; Kannan experts fuzzy pair wise comparison matrix was formed in
and Tan, 2002; Langley et al., 2002). The criteria were Table 3.
gathered hierarchically in three phases. The three main
criteria were on overall performance, supplier features
and management ability. Total of thirteen criteria and Step 5: Calculate weights based on fuzzy set
forty-two sub criteria were determined (Table 2). Three
suppliers were determined as alternatives and named as Changs algorithm was applied in order to find criteria
3708 Sci. Res. Essays
weights that take place in fuzzy pair wise comparison 0.283582 0.323887
matrice. An excel software developed and later used in V S1 S3 0.203354
similar calculations for the solution due comparison 0.263158 0.323887 0.421053 0.238806
matrix with dimensions 2 2, 3 3, 4 4 and 5 5 in the
model. Every calculation procedure was repeated twelve V S2 S1 1.0
times (for twelve experts). For logistic criteria example 0.283582 0.425101
(Table 3), calculation of weights according to Chang V S2 S3 0.573457
algorithm, was stated as follows: 0.315789 0.425101 0.421053 0.283582
1 1 1 V S3 S1 1.0
S1 1,1,1 1,1,1 2 / 5,1/ 2,2 / 3 , , ,
11.16667 9.5 8.2333 V S3 S2 1.0
1 1 1
2.4, 2.5, 2.6667 , ,
11.16667 9.5 8.2333 d ' QU min V S1 S2 , S3 min 0.617815, 0.203354 0.203354
0.214925, 0.263158, 0.323887 d ' LO min V S2 S1, S3 min 1.0, 0.573457 0.573457
Similarly, consequent values of (0.238886, 0.315789, d ' CO min V S3 S1 , S2 min 1.0,1.0 1.0
0.425101) and (0.283582, 0.421053, 0.607287) were
Finally, w 0.203354, 0.573457,1.0 was calculated.
T
found for and . Calculation results are given below:
0.238806 0.323887 When the weight vector was normalized the consequent
V S1 S2 0.617815 weight values of 0.114, 0.323 and 0.563 were found for
0.263158 0.323887 0.315789 0.238806 QU, LO and CO criteria.
Goztepe and Boran 3709
Step 6: Calculate weights based on artificial neural Levenberg-Marquardt (TRAINLM) algorithm. Input matrix
networks T T
of (36 x9) , output matrix of (36 x1) , and three different
test data (9 3) were used in the model. Training curve
Learning of artificial neural network was completed by of the model is given Figure 5.
fuzzy pair wise comparison values obtained from pair When fuzzy pair wise comparison values belonging to
wise comparison matrix. The comparison matrix based on new expert were input into trained ANN model, QU, LO
logistic criteria was a pair wise comparison matrix with and CO values were obtained (Figure 6). Data relating to
dimensions 3 3, and the purpose was to obtain three matrix dimension oncerning all ANN models that used in
weight values. The developed ANN model was comprised this study are given in Table 4.
of three layers. In an input layer, there were nine input
cells, and an output layer there were three cells, and in a
hidden layer, there were nine cells. Fuzzy ANP pair wise Step 7: Form limit supermatrix
comparison matrix was used in order to obtain ANN input
data. In this way, weight values of thirtysix (12 3) were The obtained values from ANN model were placed in the
obtained from twelve pair wise comparison matrix appropriate column of unweighted supermatrix. The
belonging to criteria in the model. These values used as cluster weights were multiplied with the elements in that
output in the model. The model was trained by using cluster and from this weighted matrix was obtained. The
3710 Sci. Res. Essays
Figure 7. Steps of the proposed supplier selection model using fuzzy ANP based on ANN.
Linguistic scale of importance Triangular fuzzy scale Triangular fuzzy reciprocal scale
Equally important (1, 1, 1) (1, 1, 1)
Weakly important (2/3, 1, 3/2) (2/3, 1, 3/2)
Strongly important (3/2, 2, 5/2) (2/5, 1/2, 2/3)
Very strongly important (5/2, 3, 7/2) (2/7, 1/3, 2/5)
Absolutely important (7/2, 4, 9/2) (2/9, 1/4, 2/7)
Table 2. Contd.
Expertise (EP)
Certifications (CE)
Culture (CU)
Six sigma (SS)
Lean manufacturing (LM)
Revenue (RE))
Profitability (PR)
Financial status (FS)
Market share (MS)
Investment (IN)
Feeling of Trust (FT)
Relations (RL) References (RE)
Communication (CM)
Process improvement (PI)
Machine capabilities (MC)
Manufacturing (MA)
Maintenance (MT)
Production time (PT)
Design and test capability (DT
Quality planning (QP) Performance measurement (PM)
Usage (US)
Firm reputation (FR)
Risk management (RM) Worker satisfaction (WS)
Risk planning (RP)
Management Just in time management (JT)
Flexible manufacturing (FM)
Stock management (SM)
Flexible distribution (FD)
Material handling (MH)
Project completing time (PT)
Timing (TI) First delivery time (FI)
Equipment (EQ)
Table 3. Fuzzy comparison matrix based on logistic criteria of general performance cluster.
GP QU LO CO
QU (1,1,1) (1,1,1) (2/5,1/2,2/3)
LO (1,1,1) (1,1,1) (2/3,1,3/2)
CO (3/2,2,5/2) (2/3,1,3/2) (1,1,1)
weighted matrix was taken power to reach limit values. Therefore, the priorities of alternatives were seen in the
The new matrix which is called limit supermatrix displays column of alternatives in the limit super matrix. This
the effects of elements on each other in the long run. The matrix showed that A,B, and C suppliers have
limit supermatrix represents the same structure as the consequently 0.0341, 0.0187 and 0.0214 values. The
weighted supermatrix. All columns of limit supermatrix are results showed that alternative A has the highest value
alike (Appendix). (Table 5).
The nal priorities of the all elements in the matrix were The weight values of QU, LO and CO belonging to twelve
determined by normalizing each column in the supermatrix. experts calculated by fuzzy ANP and ANN, and difference
3712 Sci. Res. Essays
Table 5. Results.
values of them (error) were given in Table 6. The p-value was 0.932 for is 0.05. Since this value
Hypothesis test was applied in order to get the was quite large, we cannot reject the null hypothesis and
information as to whether there was a meaningful thus conclude that the two weight means do not differ
difference between weights obtained FANP and ANN. significantly. Similar calculations were done for LO and
was mean of the weight values found by fuzzy ANP. CO criteria. The p-values for LO and CO criteria were 1.0
Similarly was mean weight values found by ANN. The and 0.964 respectively. They are large and we conclude
hypotheses in the model were: that difference scores between the weights found by ANP
and ANN show do not differ significantly.
Therefore, it can be concluded that there is no
or meaningful difference between fuzzy ANP and ANN
or models scores.
Table 6. Data of model (3x3 matrix). judgments. The advantages of adapting artificial neural
network to fuzzy ANP model can be summarized as
FANP ANN follows:
Expert Criteria Error
weights weights
QU 0.11445 0.11445 2.39E-08 1. In case expert judgments change according to supplier
1 LO 0.32275 0.32804 0.0052941 qualifications, it wont be necessary to reform the pair
CO 0.56281 0.50675 0.056055 wise comparisons matrix in fuzzy ANP model.
2. The cost of forming expert (or decision) group will
decrease.
QU 0.22559 0.18584 0.039747
3. The difficulty of reducing the group decision to one
2 LO 0.32372 0.31758 0.0061377 single decision will be eliminated.
CO 0.4507 0.50675 -0.056055 4. It is possible to reduce calculations for the solution of
fuzzy pair wise comparisons.
QU 0.4507 0.4507 5.25E-08 5. The weights can be directly calculated without using
3 LO 0.32372 0.31758 0.0061377 any method.
CO 0.22559 0.18584 0.039746
It will be attractive for researchers to apply other neural
QU 0.70781 0.70781 -9.64E-09 network learning methods as Hebbian learning,
Boltzmann learning and memory based learning. Multi-
4 LO 0.14609 0.14609 2.88E-09
layer perceptions have been used in this study.
CO 0.14609 0.18584 -0.039747
Researchers should use radial-basis function networks
and support vector machines instead of multilayer
QU 0.43374 0.43374 -5.79E-08 perceptions. Researchers should also use different fuzzy
5 LO 0.36276 0.36276 -4.04E-08 logic methods as intuitionistic fuzzy sets with neural
CO 0.20351 0.1748 0.028707 networks. Thus, it will be possible to see which fuzzy set-
neural network integration has an advantage in dealing
QU 0.047879 0.047879 9.55E-08 with the supplier selection problem.
6 LO 0.66257 0.66257 1.61E-08
CO 0.28955 0.31144 -0.02189
REFERENCES
QU 0.33333 0.33333 -4.64E-08 Aissaoui N, Haouori M, Hassini E (2006). Supplier selection and order
7 LO 0.33333 0.32804 0.005294 lot sizing modeling: A Review. Comput.Oper. Res. 34(12):3516-
CO 0.33333 0.32804 0.0052939 3540.
Barbarasolu G, Yazga T (1997). An application of the analytic
hierarchy process to the supplier selection problem. Prod. Invent.
QU 0.66257 0.66257 -2.04E-07 Manage. J. 38(1):14-21.
Benyoucef L, Ding H, Xie X (2003). Supplier selection problem:
8 LO 0.28955 0.31758 -0.028028 Selection criteria and method. Institute National de Recherche en
CO 0.047879 0.047879 -7.28E-08 Informatique et en Automatique- INRIA, Rapport de recherche
4726:38.
Bhutta K, Huq F (2002). Supplier selection problem: A comparison of
QU 0.32275 0.32804 0.0052941 the total cost of ownership and analytic hierarchy process
9 LO 0.56281 0.56281 7.96E-08 approaches. Supply Chain Manage: Int. J. 7(3):126-135.
Carrera, DA (2007). Qualitative inference system for the decision
CO 0.11445 0.11445 1.04E-07 making process: A Neuro-fuzzy analytical network approach, Master
Thesis, University of Regina, 118 pp.
Chamodrakas I, Batis D, Martakos D. (2010). Supplier selection
QU 0.14609 0.14609 9.96E-08 electronic marketplace using satisficing and fuzzy AHP. Expert Syst.
10 LO 0.70781 0.70781 1.13E-07 Appl. 37:490-498.
CO 0.14609 0.1748 -0.028706 Chan FTS, Kumar N, Tiwari MK, Lau HCW, Choy KL (2008). Global
supplier selection: A fuzzy-AHP approach. Int. J. Prod Res.
46(14):3825-3857.
QU 0.14609 0.18584 -0.039746 Chang DY (1996). Applications of the extent analysis method on fuzzy
AHP. Eur. J. Oper. Res. 95:649-655.
11 LO 0.14609 0.14609 2.82E-08 elebi D, Bayraktar D (2008). An integrated neural network and data
CO 0.70781 0.70782 -3.58E-07 envelopment analysis for supplier evaluation under incomplete
information. Expert Syst. Appl. 35:1698-1710.
Davood G, Mellat-Parast M (2012). Developing a grey-based decision
QU 0.33333 0.33333 -5.65E-08 making model for supplier selection. Int. J. Prod. Econ. 137(2):191-
12 LO 0.33333 0.31758 0.015752 200.
De Boer L, Wegen L, Tlgen J (1998). Outranking methods in support of
CO 0.33333 0.31144 0.02189 supplier selection. Eur. J. Purch. Supply Manage. 4:109-118.
3714 Sci. Res. Essays
Degraeve Z, Roodhooft F, Van Doveren B (2005). The use of total cost Meade LM, Sarkis J (1998). Strategic Analysis of Logistics and Supply
of ownership for strategic procurement: A company-wide Chain Management Systems Using The Analytical Network
management information system. J. Oper. Res. Soc. 56(1):51-59. Process. Transp. Res.-E (Logistics and Transpn Rev.). 34(3):201-
Fasanghari M, Roudsari FH (2008). The fuzzy evaluation of e- 215.
commerce customer satisfaction. World Appl. Sci. J. 4(2):164-168. Muralidharan C, Anantharaman N, Deshmukh SG (2001). Vendor rating
Ghodsypour SH, OBren CO (1998). A decision support system for in purchasing scenario: A confidence interval approach. Int. J. Oper.
supplier selection using an integrated analytic hierarcy process and Prod. Manage. 21:1305-1325.
linear programming. Int. J. Prod. Econ. 56:199-212. Narasimhan R (1983). An analytical approach to supplier selection. J.
Guosheng H, Guohong Z (2008). Comparison on neural networks and Purch. Mater. Manage. 19(4):27-32.
support vector machines in suppliers selection. J. Syst. Eng. Electr. nt S, Kara SS, Ik E (2009). Long term supplier selection using a
19(2):316320. combined fuzzy MCDM approach: A case study for a
Gupta SM, Nukala S (2006). Supplier selection in a closed-loop supply telecommunication company. Ind. Eng: Expert Syst. Appl. 36:3887-
chain network: An ANP-goal programming based methodology. 3895.
Proceedings of the SPIE, International Conference on Ravi V, Shankar R, Tiwari MK (2005). Analyzing alternatives in reverse
Environmentally Conscious Manufacturing VI, Boston, logistics for end-of-life computers: ANP and balanced score card
Massachusetts, October 1-3, pp. 130-138. approach. Comput. Ind. Eng. 48:327-356.
Gneri AF, Ycel A, Ayyldz G (2009). An integrated fuzzy-lp approach Rumelhart DE, McClelland JL (1986). Parallel distributed processing:
for a supplier selection problem in supply chain management. Explorations in the microstructure cognition: Foundations (Vol. 1),
Expert Syst. Appl. 36:9223-9228. MIT Press. Chapter 1, pp. 4-43.
Handfield R, Walton SV, Sroufe R, Melnyk SA (2002). Applying Saaty TL (1980). The analytic hierarchy process. New York: McGraw-
environmental criteria to supplier assessment: A study in the Hill. Chapter 1, pp. 3-36.
application of the analytical hierarchy process. Eur. J. Oper. Res. Saaty TL (1996). Decision making with dependence and feedback: The
141:7087. analytic network process, RWS Publications, Pittsburgh, PA.
Haykin S (1994). Neural networks: A comprehensive foundation. New Chapter 3, pp. 91-97.
York, USA, Macmillan College Publishing Company. Chapter 1, pp. Sanayie A, Mousavi FS, Abdi MR, Mohaghar A (2008). An integrated
1-11. froup decision-making process for supplier selection and order
Hill RP, Nydick RJ (1992). Using the analytic hierarchy process to allocation using multi-attribute utility theory and linear programming.
structure the supplier selection procedure. J. Purch. Mater. Manage. J. Franklin Inst. 345:731-747.
28(2):31-36. Sarkis J (2003). Quantitative models for performance measurement
Jharkhariaa S, Shankar R (2005). Selection of logistics service provider: systems alternate considerations. Int. J. Prod. Econ. 86:81-90.
An analytic network process (ANP) approach. Omega. Int. J. Su CT, Hsieh K-L (1998). Applying neural network approach to achieve
Manage. Sci. 35: 274-289. robust design for dynamic quality characteristics. Int. J. Qual. Rel.
Kannan VR, Tan KC (2002). Supplier selection and assessment, their Manage. 15(5):509-519.
impact on business performance. J. Supply Chain Manage. Talluri S, Sarkis J (2002). A model for performance monitoring of
Manage. 38(4):11-21. suppliers. Int. J. Prod. Res. 40(16):4257-4269.
Khaleiea S, Fasangharia M, Tavassolib (2012). Supplier selection using Tam MCY, Tummala VMR (2001). An application of the AHP in vendor
a novel intuitionist fuzzy clustering approach. Appl. Soft Comput. selection of a telecommunications system. OMEGA 29(2):171-182.
12:17411754. stn , Demirta EA (2008). An integrated multi-objective decision-
Kuo RJ, Wang YC, Tien, FC (2010). Integration of articial neural making process for multi-period lot-sizing with supplier selection. Int.
network and MADA methods for green supplier selection. J. Cleaner J. Manage. Sci. 36(4):509-521.
Prod. 18(12):1161-1170. Wang J-W, Cheng C-H, Kun-Cheng H (2009). Fuzzy hierarchical
Langley CJ, Allen GR, Tyndall GR (2002). Third-party logistics study TOPSIS for supplier selection. Appl. Soft Comput. 9:377-386.
2002: Results and ndings of the seventh annual study. Illinois, Weber CA, Current J, Desai A (2000). An optimization approach to
USA: Council of Logistics Management. determining the number of vendors to employ. Supply Chain
Langey CJ, Allen GR, Tyndall GR (2003). Third-party logistics study Manage: Int. J. 5(2):90-98.
2003: Results and ndings of the eighth annual study. Wu D (2009). Supplier selection: A hybrid model using DEA, decision
Lee CC, Ou-Yang C (2009). A neural networks approach for forecasting tree and neural network. Expert Syst. Appl. 36:9105-9112.
the suppliers bid prices in supplier selection negotiation process. Yang CC, Chen BS (2006). Supplier selection using combined analytical
Expert Syst. Appl. 36:2961-2970. hierarchy process and grey relational analysis. J. Manuf. Technol.
Lin RH (2012). An integrated model for supplier selection under a fuzzy Manage. 17(7): 926-941.
situation. Int. J. Prod. Econ. 138(1):55-61. Zadeh LA (1965). Fuzzy sets. Inf. Control 8:338-353.
Liu J, Ding FY, Lall V (2000). Using data envelopment analysis to Zaim S, Sevkli M, Tarim M (2003). Fuzzy analytic hierarchy based
compare suppliers for supplier selection and performance approach for supplier selection euromarketing and the future. J. Eur.
improvement. Supply Chain Manage. Int. J. 5(3):143-150. Market. 12(3/4):147-176.
Goztepe and Boran 3715
APPENDIX
IT CR SC CS RI PC CI LQ PY PQ PA TU MC TC EP
IT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CR 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
SC 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
CS 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
RI 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
PC 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CT 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
LQ 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PY 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
PQ 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PA 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
TU 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MC 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
TC 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
EP 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CE 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
SS 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
LM 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
RE 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
PR 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
MS 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
IN 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
FT 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
RE 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
CM 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PI 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
MC 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PT 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
DT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PM 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
US 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06
FR 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
WS 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
RP 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
JT 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FM 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FD 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MH 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PT 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FI 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
EQ 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
A 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
B 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
C 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
3716 Sci. Res. Essays
APPENDIX Contd.
CE SS LM RE PR MS IN FT RE CM PI MC MT PT DT
IT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CR 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
SC 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
CS 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
RI 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
PC 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CT 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
LQ 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PY 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
PQ 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PA 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
TU 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MC 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
TC 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
EP 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CE 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
SS 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
LM 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
RE 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
PR 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
MS 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
IN 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
FT 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
RE 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
CM 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PI 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
MC 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PT 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
DT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PM 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
US 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06
FR 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
WS 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
RP 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
JT 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FM 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FD 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MH 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PT 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FI 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
EQ 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
A 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
B 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
C 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
Goztepe and Boran 3717
APPENDIX Contd.
PM US FR WS RP JT FM FD MH PT FI EQ A B C
IT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CR 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
SC 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
CS 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
RI 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
PC 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CT 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
LQ 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PY 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
PQ 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PA 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
TU 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MC 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
TC 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
EP 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
CE 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
SS 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
LM 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
RE 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
PR 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
MS 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
IN 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
FT 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
RE 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
CM 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PI 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
MC 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PT 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04 0.04
DT 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PM 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
US 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06 0.06
FR 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
WS 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
RP 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
JT 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FM 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FD 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
MH 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
PT 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
FI 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03 0.03
EQ 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
A 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
B 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02
C 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01