Professional Documents
Culture Documents
Figure 1.
Conceptual framework
IJQRM
18,1
38
Figure 2.
Proposed links between
TQM criteria, ISO 9000
and organisational
performance
philosophy (TQM) nor quality standards (ISO 9000) have effectively reached
the core of Australia's commercial base 780,000 small and medium enterprises''
(p. 81).
In light of the above discussion and drawing on the critical finding of the
Foley et al. (1997) report that SMEs have not taken full advantage of either
TQM practices or ISO 9000 standards, the following hypothesis is proposed.
Hypothesis
TQM impact on organisational performance is greater for SMEs with ISO 9000
than for SMEs without ISO 9000.
Methodology
Development of the survey instrument
The criteria specified in the ABE, previously called Australian Quality Award
(AWA) framework served as our conceptualisation of the TQM approach to
management. The framework is structured with seven criteria: leadership,
strategy and planning, information and analysis, people, customer focus,
processes, products and services, and organisational performance (see Figure
2). Under each criterion exists one or more sub-criteria, which describe in more
detail aspects of the criterion. Using these sub-criteria as a guide, a
questionnaire with 36 items was developed to create a self-assessment measure
of TQM practices. Additional questions were included to measure the quality
perception and ISO 9000 certification status of the participating companies. A
five-point Likert scale was used to measure the extent to which certain
Number of employees
Small (1-49) Medium (50-99) Large (+ 100) All enterprises
Industry division ('000) (%) ('000) (%) ('000) (%) ('000) (%)
Sampling procedure
The sample for the study consisted of 250 firms which were randomly selected
from a list of SMEs prepared by the Western Australian Department of Trade
and Commerce. A questionnaire was mailed to the top management of each
firm. A reply-paid envelope was included. A total of 53 firms responded to the
questionnaire, giving a response rate of about 21 per cent. Given the low
response associated with mail surveys, this response rate was considered
reasonably adequate. Four of the responses received were not useable due to
incomplete data. The analyses are based on the remaining 49 companies.
Construction/engineering 42
Chemicals/extractives 9
Financial/insurance services 3
Manufacturing (durable) 11
Manufacturing (non-durable) 11
Non-profit organisation 6
Table II. Utilities 6
Types of companies in Services 6
the sample Others 8
Of the 49 companies that responded, 55 per cent were ISO 9001/9002 certified. A comparative
Among the companies without ISO certification, 62 per cent expressed their study of TQM
intention to get such a certificate within the next five years. practice
Reliability and validity of the survey instrument
The survey instrument with 36 items was developed based on the seven
criteria: leadership (L1-L4), information and analysis (IA1-IA3), strategy and 41
planning (SP1-SP4), people (P1-P8), customer focus (CF1-CF8), processes,
products and services (PPS1-PPS6) and the dependent variable, organisational
performance (OP1-OP3) (see Table V). The instrument was evaluated for
reliability and validity. Reliability refers to the instrument's ability to provide
consistent results in repeated uses (Gatewood and Field, 1990). Validity refers
to the degree to which the instrument measures the concept the researcher
wants to measure (Bagozzi and Phillips, 1983). Three types of validity tests
were considered in this study: content validity, construct validity, and criterion
validity (Hair et al., 1998). A thorough reliability and validity analysis on
measurement instruments in empirical research is essential for several reasons.
First, it provides confidence that the empirical findings accurately reflect the
proposed constructs. Second, empirically-validated scales can be used directly
in other studies in the field for different populations and for longitudinal
studies (Flynn et al., 1994).
The data set of 36 items developed, based on the seven criteria of the ABE
framework, was factor analysed by principal component analysis. Out of the
seven criteria, ten factors were extracted. In factor analysis, a rotation
Associate company 9
Family trust 3
Joint venture 3
Limited liability 23
Partnership 11
Sole proprietorship 9 Table III.
Subsidiary 31 Companies by
Others 11 ownership
analysis
IJQRM
Table V.
reliability and
within-scale factor
Results of construct
Revised factor Reliability of revised
Criteria Factors Items loadings construct
Information Information IA1: Carefully collect data on all facets of business 0.884
and analysis and analysis IA2: Analyse all work processes in the business 0.830
IA3: Key performance figures are always available for analysis and
decision making 0.873 Alpha = 0.820
Strategy and Strategy and SP1: Do regular strategic planning 0.873
planning planning SP2: Business has clear quality goals 0.773
SP3: Strategic plan is linked to quality values 0.807
SP4: Planning process includes continuous quality improvement 0.760 Alpha = 0.814
Customer focus Customer CF1: Collect data to monitor changes in customer needs 0.777
management CF2: Systematically ask customers what they expect in products/services 0.893
CF3: Systematically ask customers if they are satisfied with the
products/services 0.839
CF5: Investigate when we lose a customer 0.800 Alpha = 0.846
(continued)
Revised factor Reliability of revised
Criteria Factors Items loadings construct
Organisational Organisational OP1: Profitability has increased in the past three years due to our
performance performance quality programmes 0.878
OP2: Due to quality improvement effort revenue dollars have increased
in the past 0.898
OP3: The number of customers has increased in the past three years 0.822 Alpha = 0.833
Table V.
A comparative
practice
43
study of TQM
IJQRM procedure is commonly applied which maximises the correlations of each item
18,1 on a factor (Comrey, 1973). The quality management practice construct
comprises many interrelated factors (Dow et al., 1999) and, therefore, oblique
rotation was applied as the rotation procedure. The Kaiser-Mayer-Olkin (KMO)
measure of sampling adequacy was used to measure the adequacy of the
sample for extraction of the ten factors.
44 Reliability. Using SPSS, an internal consistency analysis was performed to
assess the reliability aspect of the survey instrument. Coefficient (Cronbach's)
alpha is the basic measure for reliability. The items in each factor were grouped
into ten scales, and coefficient alpha was calculated for each group. Three out
of 36 items (L2, P2 and P8) were eliminated, which improved the reliability
slightly. The reliability coefficient (Cronbach's alpha) of the factors ranged
between 0.605 (leadership) and 0.846 (customer management) (Table V). Values
of the alpha indicate the relative reliability of each factor as a scale. These
results are similar to the results of Dow et al. (1999) and Samson and Terziovski
(1999). Nunnally (1967) suggested that in exploratory research such as this,
alpha value of 0.6 is sufficient. The alpha values found for each scale indicate,
therefore, that each factor is a sufficiently reliable measure.
Content validity. A measure has content validity if there is general consensus
among researchers that the instrument includes items that cover all aspects of
the variable being measured (Bohrnstedt, 1983). It is not numerically evaluated
but subjectively assessed by the researchers. In this study, the measurement
instrument was developed based on the ABE framework (similar to the
Malcolm Baldrige Award framework) which is widely used by Australian
companies to measure and benchmark performance. The criteria of the ABE
framework are similar to criteria considered by many researchers to define
quality management practices (Saraph et al., 1989; Powell, 1995; Samson and
Terziovski, 1999). The instrument developed based on the ABE framework is
therefore considered to have content validity.
Construct validity. The items assigned to each of the seven TQM criteria
were submitted to principal component factor analysis to determine the
number of factors and factor loadings extracted by the Kaiser criterion (with
eigenvalue greater than one). Out of 36 items, ten factors were extracted. The
results are shown in Table V. Three items (L2, P2, and P8) were eliminated to
improve the reliability of the instrument and the revised loadings were
calculated. The revised loadings ranged between 0.608 and 0.905. These results
are broadly similar to those of Black and Porter (1996) and Samson and
Terziovski (1999).
The KMO measure was used to assess the suitability of the sample for each
unifactorial determination. The KMO values found (see Table VI) are generally
considered acceptable (Kim and Mueller, 1978). All factors in each unifactorial
test accounted for more than 60 per cent of the variance of the respective
variable sets. This suggests that only a small amount of the total variance for
each group of variables is associated with causes other than the factor itself.
Variance explained A comparative
Factors KMO (%) study of TQM
practice
Leadership 0.603 63.80
Information and analysis 0.710 74.50
Strategy and planning 0.768 64.70
Employee empowerment and involvement 0.714 60.10
Employee training and development 0.500 69.29 45
Customer management 0.777 68.65
Customer satisfaction 0.656 60.97
Design quality management 0.643 71.56 Table VI.
Process control 0.623 67.25 Construct validity tests
Organisational performance 0.702 75.11 of the factors
Hypothesis test
Tests for the factor means. The means and standard deviations for the ten
factors for SMEs with and without ISO 9000 are shown in Table VII. The
means ranged between 3.01 and 4.18 for firms with ISO 9000 certification and
between 2.92 and 4.14 for firms without ISO 9000 certification. A score of 4 or
more indicates high agreement with a particular criterion, a score between
3 and 4 (excluding 4) indicates moderate agreement and a score less than
Firms with ISO 9000 Firms without ISO 9000 F-test t-test
Factors Mean Std dev. Mean Std dev. p-value p-value
Organisational performance
Firms with Firms without Firms with Firms without
ISO 9000 ISO 9000 ISO 9000 ISO 9000 t-test
Firm category (%) (%) Mean Std dev. Mean Std dev. p-value
Table VIII.
Mean rating of the High TQM 26 19 3.6 0.92 3.44 0.51 0.800
three categories of Moderate TQM 36 31 2.81 1.07 3.00 0.71 0.736
firms Low TQM 38 50 2.62 0.56 2.83 1.25 0.671
Summary, limitations and conclusions A comparative
In this study, the criteria specified in the ABE framework served as our study of TQM
conceptualisation of TQM approach to management. Using these criteria, a practice
survey instrument with 36 items was developed and applied to create a self-
assessment measure of TQM practices. The items assigned to each of the seven
TQM criteria were submitted to principal component factor analysis and ten
factors were extracted. The instrument was evaluated for reliability and 47
validity. The results showed that the TQM approach based on the ABE
framework is a valid and reliable instrument to assess organisational
performance for SMEs.
This study assessed the impact of quality management factors on
organisational performance for SMEs in Western Australia with and without
ISO 9000 certification. Except for the factor ``Process control'', the results
indicated no significant difference between the impacts of TQM practices on
organisational performance for firms with and without ISO 9000 certification.
Process control had a much higher mean rating for firms with ISO 9000,
compared to firms without ISO 9000. This was expected, since firms generally
spend a substantial amount of resources to document processes as part of the
certification process.
We classified the firms into three categories: high TQM, moderate TQM and
low TQM firms and studied the mediating influence of ISO 9000 certification on
each category. Again, the test showed no significant differences between the
impacts of TQM practices on organisational performance for firms with and
without ISO 9000 certification.
The survey methodologies used in this study had several limitations. The
reliability and validity tests and the analysis were performed based on 49 firms
only. Although comparable with several other studies (Galvin, 1991; Powell,
1995), the sample size used in this study is considered small. The results of the
study must, therefore, be treated with caution.
This survey was conducted during the second half of 1997. The sample data
used in the study is therefore a snapshot at one specific point in time. It does not
account for changes over time. All studies of such nature suffer from this
limitation. A longitudinal study would be necessary to overcome such a
limitation.
Terziovski and Samson (1999) found that the relationship between TQM
practice and organisational performance is strengthened when covaried for
company size. Several studies which used large sample sizes (Dow et al., 1999;
Samson and Terziovski, 1999) considered a set of firms that varied in size from
20 to 3,000 employees. However, in their analysis they have not considered the
impact of company size on organisational performance. This project studied
the relationship between TQM practices and organisational performance for
SMEs where the size of the firms varied between 20 and 99 employees and thus
did not suffer from this limitation. However, this study had a limitation in the
sense that it did not consider the effect of industry type on organisational
IJQRM performance. Further research would be needed to assess the impact of
18,1 industry type on organisational performance.
References
ABS (Australian Bureau of Statistics) (1999), Small Business in Australia ± Update 1997-98,
Catalogue No. 1321.0, February, Canberra.
48 AMC (Australian Manufacturing Council) (1994), Leading the Way: A Study of Best
Manufacturing Practices in Australia and New Zealand, Australian Manufacturing
Council, Melbourne.
Askey, J.M. and Dale, B.G. (1994), ``From ISO series registration to total quality management: an
examination'', Quality Management Journal, July, pp. 67-76.
Avery, S. (1994), ``What's wrong with ISO 9000?'', Purchasing, Vol. 11 No. 3, pp. 49-53.
Bagozzi, R.P. and Phillips, L.W. (1983), ``Requesting and testing organisational theories: a holistic
construct'', Administrative Science Quarterly, Vol. 18, pp. 133-45.
Bemowski, K. (1991), ``The international quality study'', Quality Progress, November, pp. 33-7.
Black, S.A. and Porter, L.J. (1996), ``Identification of critical factors of TQM'', Decision Sciences,
Vol. 27 No. 1, pp. 1-21.
Binney, G. (1992), Making Quality Work: Lessons from Europe's Leading Companies, Special
Report No. P655, The Economist Intelligence Unit, London.
Bohrnstedt, G. (1983), ``Measurement'', in Rossi, P., Wright, J. and Anderson, A. (Eds), A
Handbook of Survey Research, Academy Press, San Diego, CA.
Bradley, M. (1994), ``Starting total quality management from ISO 9000'', The TQM Magazine,
Vol. 6 No. 1, pp. 50-4.
Comrey, A.L. (1973), A First Course in Factor Analysis, Academic Press, New York, NY.
Dow, D., Samson, D. and Ford, S. (1999), ``Exploding the myth: do all quality management
practices contribute to superior quality performance'', Production and Operations
Management, Vol. 8 No. 1, pp. 1-27.
Flynn, B.B., Schroeder, R.G. and Sakakibara, S. (1994), ``A framework for quality management
research and associated instrument'', Journal of Operations Management, Vol. 11,
pp. 339-66.
Flynn, B.B., Schroeder, R.G. and Sakakibara, S. (1995), ``The impact of quality management
practices on performance and competitive advantage'', Decision Sciences, Vol. 26 No. 5,
pp. 659-91.
Foley, K., Barton, R., Busteed, K., Hulbert, J. and Sprouster, J. (1997), Quality, Productivity and
Competitiveness ± The Role of Quality in Australia's Social and Economic Development,
The Wider Quality Movement, Standards Australia, Strathfield, NSW.
Garvin, D.A. (1986), ``Quality problems, policies and attitudes in the United States and Japan: an
exploratory study'', Academy of Management Journal, Vol. 29, pp. 653-73.
Garvin, D.A. (1988), Managing Quality: The Strategic and Competitive Edge, The Free Press, New
York, NY.
Garvin, D.A. (1991), ``How the Baldrige Award really works'', Harvard Business Review, Vol. 69
No. 6, pp. 80-95.
Gatewood, R.D. and Field, H.S. (1990), Human Resource Selection, 2nd ed., The Dryden Press,
Chicago, IL.
Ghobandian, A. and Gallear, D.N. (1996), ``Total quality management in SMEs'', Omega, Vol. 24
No. 1, pp. 83-106.
Hair, J.F., Anderson, R.E. and Tatham, R.L. (1998), Multivariate Data Analysis, Macmillan A comparative
Publishing, New York, NY.
Haksever, C. (1996), ``Total quality management in the small business environment'', Business
study of TQM
Horizon, Vol. 39, March-April, pp. 33-40. practice
Idris, M.A., McEwan, W. and Belavendram, N. (1996), ``The adoption of ISO 9000 and TQM in
Malaysia'', The TQM Magazine, Vol. 8 No. 5, pp. 65-8.
Kaldenberg, D.D. and Gobeli, D.H. (1995), ``Total quality management practices and business 49
outcome: evidence from dental practices'', Journal of Small Business Management, Vol. 33
No. 1, pp. 21-33.
Kim, J. and Mueller, C. (1978), Introduction to Factor Analysis, Sage Publications, Beverly Hills,
CA.
Lloyds Register Quality Assurance Ltd (1994), BS 5750/ISO 9000 ± Setting Standards for Better
Business, Lloyds Register Quality Assurance Ltd, Croydon, UK. Taken from Brown, A.
and Van der Wiele, T. (1996), ``A typology of approaches to ISO certification and TQM'',
Australian Journal of Management, Vol. 21 No. 1, pp. 57-73.
Madu, C.N., Kuei, C. and Lin, C. (1995), ``A comparative analysis of quality practice in
manufacturing firms in the US and Taiwan'', Decision Sciences, Vol. 26 No. 5, pp. 621-35.
Nunnally, J.C. (1967), Psychometric Theory, McGraw-Hill, New York, NY.
Powell, T.C. (1995), ``Total quality management as competitive advantage: a review and
empirical study'', Strategic Management Journal, Vol. 16 No. 1, pp. 15-37.
Quazi, H.A. and Padibjo, S.R. (1997), ``A journey towards total quality management through ISO
9000 certification ± a Singapore experience'', The TQM Magazine, Vol. 9 No. 5, pp. 364-71.
Roth, A.V., Demeyer, A. and Amano, A. (1990), ``A manufacturing strategy, manufacturing
strength, managerial success and economic outcomes'', in Ettlie, J.E., Burstein, M.C. and
Fiegenbaum, A. (Eds), Manufacturing Strategy, Kluwer Publishers, Norwell, MA.
Samson, D. and Terziovski, M. (1999), ``The relationship between total quality management
practices and operational performance'', Journal of Operations Management, Vol. 17,
pp. 393-409.
Saraph, J.V., Benson, P.G. and Schroeder, R.G. (1989), ``An instrument for measuring the critical
factors of quality management'', Decision Sciences, Vol. 20 No. 4, pp. 810-29.
Scotto, M.J. (1996), ``Seven ways to make money from ISO 9000'', Quality Progress, Vol. 29 No. 6,
pp. 39-41.
Sluti, D.G. (1992), ``Linking process quality with performance: an empirical study of New Zealand
manufacturing plants'', PhD dissertation, The University of Auckland, New Zealand.
Taylor, A. (1993), ``Outcomes of consultancy interventions for ISO initiatives'', Proceedings of the
EOQ '93 Conference, Helsinki.
Terziovski, M. and Samson, D. (1999), ``The link between total quality management practice and
organisational performance'', International Journal of Quality & Reliability Management,
Vol. 16 No. 3, pp. 226-37.
Terziovski, M., Samson, D. and Dow, D. (1997), ``The business value of quality management
systems certification ± evidence from Australia and New Zealand'', Journal of Operations
Management, Vol. 15 No. 1, pp. 1-18.
Vloeberghs, D. and Bellens, J. (1996), ``Implementing the ISO 9000 Standards in Belgium'', Quality
Progress, Vol. 29 No. 6, pp. 43-8.