Professional Documents
Culture Documents
Access to this document was granted through an Emerald subscription provided by emerald-srm:465595 []
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald for
Authors service information about how to choose which publication to write for and submission guidelines
are available for all. Please visit www.emeraldinsight.com/authors for more information.
About Emerald www.emeraldinsight.com
Emerald is a global publisher linking research and practice to the benefit of society. The company
manages a portfolio of more than 290 journals and over 2,350 books and book series volumes, as well as
providing an extensive range of online products and additional customer resources and services.
Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the Committee
on Publication Ethics (COPE) and also works with Portico and the LOCKSS initiative for digital archive
preservation.
IJQRM
18,1 A study of the relationships
between the Baldrige
categories
14 Gertrude P. Pannirselvam
Received October 1999 Southern Illinois University at Edwardsville, Edwardsville, Illinois, USA,
Revised April 2000 and
Lisa A. Ferguson
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
Introduction
Since its inception in 1987, the Malcolm Baldrige National Quality Award
(MBNQA) criteria have evolved from just a measurement of organizational
quality to a guideline for companies moving toward performance excellence.
The Baldrige Award was established by the US Congress to promote quality
awareness in order to improve the competitiveness of US companies. With its
popularity among US businesses, the MBNQA has become an important
catalyst for improving the competitiveness of US companies and increasing
awareness of quality improvement methods (Main, 1990; Garvin, 1991; Hart,
1993; Moore, 1995; ASQ, 1998). This is not surprising, since the Baldrige
criteria provide a comprehensive framework or tool for self-assessment
(Garvin, 1991; Evans, 1997). The award criteria have helped businesses develop
a common language and philosophy concerning quality (Garvin, 1991; Hart,
1993).
The adoption and imitation of the Baldrige criteria allude to its widespread
acceptance. The award criteria have been adopted or used as a model at both
the state and local levels, as well as internationally (Kochan, 1992; Nadkarni,
International Journal of Quality &
1995; Ettorre, 1996). According to the National Institute of Standards and
Reliability Management,
Vol. 18 No. 1, 2001, pp. 14-34.
Technology (NIST), the agency in charge of managing the award, the number
# MCB University Press, 0265-671X of state and local Baldrige Award programs has increased from six in 1991 to
58 in 1998, while the number of state Baldrige Award applications increased A study of
from 111 in 1991 to 974 in 1997. Manufacturing organizations, service relationships
organizations, government units at the national, state, and local levels,
academic institutions, and other nations are all instituting quality awards and
implementing quality processes patterned after the Baldrige criteria (Kochan,
1992). More than 1.7 million copies of the MBNQA criteria have been
distributed since 1988 (NIST, 1999). In addition, NIST estimates that 15
reproduction of the criteria, in companies and via the NIST Web site, may
increase the actual distribution of the criteria to a significantly higher number.
Bemowski and Stratton (1995) conducted a study to determine how the
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
Baldrige criteria were being used since the number of copies of the Baldrige
criteria distributed far exceeded the number of applications received for the
award. A survey of US businesses conducted by Bemowski and Stratton
determined that the Baldrige criteria are being used by many businesses for
self-assessment. This survey also found that the respondents found the
usefulness of the criteria met or exceeded their expectations.
Even in the midst of its popularity, the merits of the Baldrige Award have
been debated since its creation (Main, 1990; Crosby and Reimann, 1991; Main,
1991; Zemke, 1991; Sims et al., 1992; Gradig and Harris, 1994; Ettorre, 1996).
During the period of 1992 to 1997, several authors (Grossman, 1994; Marsh,
1994; Ettorre, 1996) presented the argument that the decline in applications for
the MBNQA indicated a decline in interest in quality and in the award. NIST
argues that the number of applicants for the MBNQA is not an indicator of
overall interest in quality or the award program (NIST, 1999). This argument is
based, in part, on increased participation in state and local programs.
The criticism that is of interest to this research is the lack of evidence of the
relationship between the MBNQA and financial or product performance. The
bankruptcy filing from the Wallace Company, an MBNQA winner, and the not
too stellar profit numbers posted by some other winners have raised concerns
about the quality-performance link and the criteria's ability to predict
performance (Smith and Oliver, 1992; Hill, 1993). Businesses have also been
critical of the award criteria after Cadillac won the award in 1991 (Hillman,
1991). However, several sources (Maynard, 1991; Fojt, 1995; NIST, 1999)
indicate that quality has a positive affect on the financial performance of
companies. The ``Baldrige Index'', which is a fictitious stock fund made up of
the publicly traded companies that have won the MBNQA, has significantly
outperformed the Standard and Poor's 500 for the fifth year in a row (NIST,
1999; Rajan and Tamimi, 1999). A study, which was conducted in 1991 by the
General Accounting Office of the top 20 scorers in the Baldrige competition,
found a relationship between improved quality and increased market share and
profitability (Maynard, 1991). Questions have also been raised about the lack of
evidence for the causal relationships underlying the quality framework.
This research addresses two questions:
(1) Are the proposed relationships between the categories in the MBNQA
framework valid?
IJQRM (2) What is the strength of the relationships between the different quality
18,1 management constructs prescribed by the MBNQA criteria?
We address these two questions using data from a state quality award that
mirrors the MBNQA award criteria and evaluation process.
16 Literature
Several instruments to measure organizational quality have been presented in
the quality management literature (Saraph et al., 1989; Flynn et al., 1994; Ahire
et al., 1996). A number of common measures exist between the MBNQA criteria
and these other instruments; however, substantial differences between the
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
instruments exist. Primarily, the MBNQA criteria are more comprehensive and
less prescriptive than the other instruments. The MBNQA model places greater
emphasis on continuous improvement, customer focus, and strategic quality
planning.
When the MBNQA criteria are used to address organizational quality, it is
assumed that there is a link between quality management practices and
operational and market performance. The link between quality and
performance has been studied in the literature by several researchers. The
PIMS database has been used to study the link between product quality, cost,
market share, return on investment and profitability (Schoeffler et al., 1974;
Phillips et al., 1983; Gale and Klavans, 1985). Roth and Miller (1989) and Roth
et al. (1990) studied the effect of different quality practices on quality
performance. Their studies clearly showed that quality programs have a
significant influence on manufacturing capabilities. The constructs for quality
in these two studies were limited to a few practices and did not consider
infrastructures, such as information management, that could influence the
success of quality management practices.
More recent studies have taken a more organizational view of quality and
included infrastructural elements such as information management and human
resources management (Anderson et al., 1995; Flynn et al., 1995; Chen et al.,
1997; Poister and Harris, 1997; Lengnick-Hall and Sanders, 1997; Li, 1997;
Rungtusanatham et al., 1998; Dow et al., 1999). Some of these studies are
discussed in the next few paragraphs.
Flynn et al. (1995) conducted a comprehensive study on quality practices,
quality management infrastructures, and performance based on a survey of US
plants in the machinery, electronics and transportation industries. The
performance measures used in this study are perceived quality market
outcomes and percentage of production units that passed final inspection
without rework. Their study indicates that top management support and
supplier relationship had a direct effect on the performance of the product
design process. Top management support and workforce management had a
direct effect on process flow. Product design and process flow management
practices significantly influenced internal measures of quality such as percent
defective and market measures.
Adam et al. (1997) conducted cross-cultural quality management research on A study of
the effect of quality practices on quality and financial performance. Adam et al. relationships
grouped 52 quality practices into nine factors. Their research measured the
relationships between each of these nine factors, and their effect on quality
measures and financial measures. The results of this study indicate that
although all nine factors affected the quality performance measures, the
activities that most influenced the outcome were in the top management 17
domain (organization's knowledge of quality management, its degree of
customer focus, and management involvement). The impact of the nine quality
factors on financial measures, however, was weak.
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
includes the direct effects of leadership on each of the four systems categories,
the direct effects of strategic quality planning on management of process
quality and customer focus and satisfaction, the direct effect of human resource
development and management on quality and operational results, and the
direct effects of management of process quality on customer focus and
satisfaction and quality and operational results. Winn and Cameron conclude
that leadership affects the outcomes by mediating effects through the
organizational systems.
The above review indicates that several quality management constructs
have been empirically tested for relationships between quality management
and business performance. Causal models based on the MBNQA framework
have been proposed and tested. There is only some limited support for some of
the relationships between the Baldrige categories. As a result, alternate
statistically significant models based on the Baldrige criteria have been
suggested. In this research, we use confirmatory analysis on data from a state
quality award process to validate the relationships between the MBNQA
categories as suggested by the Baldrige framework and criteria.
Leadership
Senior executive leadership 0.82
Management for quality 0.84
Public responsibility 0.75
Information and analysis
Management of data 0.82
Benchmarks 0.81
Company level data 0.83
categories
reliability of the model
Factor loadings and
Table I.
relationships
19
A study of
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
20
18,1
Table I.
IJQRM
Business results
Quality results 0.81
Operational results 0.81
Business results 0.76
Supplier quality results 0.70
Customer focus and satisfaction
Customer expectation 0.75
Customer relationship
management 0.81
Commitment to customers 0.76
Satisfaction determination 0.80
Satisfaction results 0.77
Satisfaction comparison 0.77
Test statistic for research constructs
Cronbach's alpha 0.85 0.86 0.77 0.90 0.88 0.85 0.86 0.74
vc 0.65 0.68 0.63 0.64 0.59 0.59 0.61 0.59
satisfaction category. Of these constructs, information management, strategic A study of
quality planning, and human resources management provide the essential relationships
quality management infrastructure. Table I shows the examination items for
each of the system constructs.
Product and process management and customer focus and relationship
management are the core quality management practices. Company results are
used as the measures of progress examined in the category of business results. 21
Finally, the goal of the quality process is improved value to the customer.
Each of these seven categories represents a construct that is measured by
the examination items under it. Each examination item measures either the
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
approach and deployment of quality practices (namely the tools and concepts
that are used to manage the quality) or the results of these quality management
practices. The categories of leadership, information and analysis, strategic
quality planning, human resources development and management, and
management of process quality evaluate the quality management practices.
The category of quality and operational results measures internal business
results. The customer focus and satisfaction category contains four
examination items that measure the practices the organization uses to improve
its commitment to and relationship with its customers and two examination
items that measure the customer satisfaction results. In this research we are
interested in identifying the strength of the relationship between quality
management practices and results from these practices. We, therefore, split this
category into two constructs ± one that evaluates the practices and one that
evaluates the results. Henceforth, the MBNQA framework is presented as an
eight construct model. These eight constructs, as well as the examination items
in each construct, are listed in Table I. The framework connecting and
integrating the constructs is presented in Figure 1.
The MBNQA framework theorizes the role that leadership, the quality
management infrastructure, and the quality management practices have on the
business and marketplace outcomes. These relationships are represented in
Figure 1.
The MBNQA
quality-performance
model
IJQRM Figure 1 by the arrows leading to and from the eight constructs. The
18,1 relationships indicated in Figure 1 are derived from the Baldrige framework
and the links between the categories and examination items as described in the
notes under each examination item (NIST, 1993). Of particular interest to
researchers and practitioners is the strength of the relationships between the
quality management constructs in the MBNQA criteria. Previous research on
22 the validation of the Baldrige criteria points to the fact that the constructs
identified by the categories of leadership, information management, strategic
quality planning, human resources, and product and process management are
correlated with each other (Pannirselvam et al., 1998). These correlations
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
Hypotheses
The objective of this research is to test the quality-performance model as
presented by the Baldrige criteria. Figure 1 presents this model indicating the
relationships between the different quality management and performance
evaluation constructs. The exogenous (independent) factors in the model are
leadership and information management. The endogenous factors are strategic
quality planning, human resources management, product and process
management, customer focus and relationship management, business results,
and customer satisfaction results.
The hypotheses tested in this research can be broken down into three
subsets. These hypotheses are represented by the links provided in Figure 1.
H1: Hypotheses about quality management infrastructure.
H1a: The strength of the strategic quality planning process is directly
related to leadership and information management.
H1b: The effectiveness of an organization's human resources
management is directly related to leadership and information
management.
H2: Hypotheses about the core quality management processes.
H2a: Product and process management is directly related to strategic
quality planning, human resources management, and
information management. It is indirectly related to leadership
through the mediating effects of strategic quality planning and
human resources management.
H2b: Customer focus and relationship management is directly related A study of
to strategic quality planning, human resources management, and relationships
information management. It is indirectly related to leadership
through the mediating effects of strategic quality planning and
human resources management.
H3: Hypotheses about the quality-performance links. 23
H3a: Business results is directly related to product and process
management and customer focus and relationship management.
It is indirectly related to leadership, information management,
strategic quality planning, and human resources management
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
Methodology
Data
The primary objective of this research is to study the relationships between the
Baldrige categories. However, since the data from the MBNQA award process
are confidential, an alternate source for suitable data had to be found. Since
many states have developed quality award programs patterned on the MBNQA
criteria, we decided to validate the criteria from a state quality award as a basis
for generalization of the results to the MBNQA criteria.
We evaluated several state quality awards to use as a surrogate for the
MBNQA criteria. These assessments were based on:
. the similarity of the purpose, structure, and standards for the award;
. the similarity of the evaluation criteria;
. the similarity of the evaluation process;
. the similarity of selection and training of the examiners, senior
examiners, and judges; and
. the similarity of potential applicants for the award.
The Arizona Governor's Quality Award (AGQA) was found to be sufficiently
close to the MBNQA based on the above criteria. The committee that crafted
the AGQA consisted of experienced MBNQA examiners. With permission, the
MBNQA criteria, model, and process were imported to form the guidelines for
the AGQA (Sowards, 1993). The reader is referred to a more detailed
description of the similarities between the MBNQA and AGQA in
Pannirselvam et al. (1998).
IJQRM The data from the 1993 AGQA process were used to test the hypotheses in
18,1 this research. The sample used in this research consisted of the 69
organizations that applied to the AGQA in 1993. The applicants to the AGQA
submitted an application explaining how the organization addresses each of
the 28 examination items. This application was used to evaluate the
organizations on the 28 examination items. The applicants were evaluated by a
24 group of examiners who were trained in the AGQA criteria and evaluation
process.
In the first stage of the evaluation process, individual examiners assess these
applications and score them on a scale of 0 to 100 (in ten-point increments) for
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
each of the 28 examination items listed in Table I. These individual scores that
the applicants received in the first stage of the evaluation process were used in
this research to test the MBNQA model's quality-performance link. There were
51 examiners. Three or four examiners evaluated each of the 69 applicants,
resulting in 272 individual examiner responses. Analysis of the variability in
examiner scoring indicated no significant examiner bias.
The individual examiner responses were used to test the hypotheses listed in
the previous section. The examiners for the AGQA award are trained to apply
the MBNQA criteria to information in the application for the award. As a result
of this training, the examiners provide objective ratings for the organization
along each examination item. As a result, the examiner ratings are good
surrogates for the self-reported ratings that are typically used in this kind of
research. In fact, the objectivity of the examiners may lead to a less biased data
set than self-reported ratings.
Of the 69 applicants, 26 were small businesses (less than 100 employees), 26
were medium-size businesses (between 100 and 500 employees), and 17 were
large businesses (greater than 500 employees). The number of employees
ranged from seven to over 6,000. Some of the applicants were divisions of
national or multinational corporations. The sample used in this research
included 19 manufacturing businesses, 36 service businesses, four healthcare
organizations, four educational institutions, and six government agencies. The
details of the applications from the individual organizations are confidential so
we cannot identify the specific similarities and differences in quality practices
used among the applicants. However, we can state that the different types of
businesses used very similar quality management practices and outcome
measures. Manufacturing organizations are becoming more flexible and
customer responsive, while service firms are becoming more focused on quality
process and output. As a result, the distinctions between the two sectors blur
with respect to quality management issues. Both focus more today on customer
satisfaction with a product, a service, or a combination of the two. Often, the
approaches employed, the specific tools used, and measurement systems for
quality are quite similar in the two sectors. In the government and not-for-profit
sectors, a gradual but discernible shift is moving toward a ``business approach''.
These organizations are beginning to think of their constituents and clients as
``customers'' and are focusing on process improvement strategies to enhance
productivity and quality performance. Comments from AGQA examiners A study of
indicated little or no difficulty in applying the criteria to these types of relationships
organizations. In addition, analysis of this data set showed that there was no
significant difference in ratings between different organization types
(Pannirselvam, 1997). Based on the similarities and the applicability of the
criteria across different types of organizations, we decided to analyze their data
together. 25
Analysis
Path analysis was used to estimate the strength of the relationship between the
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
Results
Confirmatory analysis of the covariance structure, using LISREL 8, provided
estimates for the factor analytic and path analytic models. The overall fit of the
model can be tested by using the ML 2. For a good fit, the 2 value should be
low and non-significant. The 2 value for the model is 738.98, which was
significant (p = 0.0). This would suggest that the model is not confirmed by the
sample data. The significance levels of 2, however, are sensitive to sample size
and multivariate normality. Therefore, other indicators of fit, such as 2/df,
Bentler's (1990) comparative fit index (CFI), JoÈreskoj and SoÈrbom (1993)
goodness of fit index (GFI), Bollen's (1989) incremental fit index (IFI), and the
Tucker and Lewis (1973) fit index (NNFI), that correct for these factors should
also be used to assess the adequacy of the model (JoÈreskoj and SoÈrbom, 1993).
The 2/df is 2.21, which is less than the ratio of five suggested in the literature
(Marsch and Hocevar, 1985). All the measures of goodness of fit for the model
tested are above the desired 0.9 level, except for one. The CFI, IFI, NNFI and
IJQRM GFI are 0.92, 0.92, 0.91, and 0.84, respectively. These fit indices indicate an
18,1 acceptable fit between the model and data (Bollen, 1989).
These factor loadings estimated using LISREL 8 were used to calculate the
reliability of each construct. The factor loadings and reliability estimates are
presented in Table I. The internal consistency method was used to test the
reliability of the research constructs. As suggested by Nunnally (1967), the
26 coefficient alpha developed by Cronbach (1951) was used to test for internal
consistency. A Cronbach alpha value of 0.70 is considered the criterion for
internal consistency for established scales (Nunnally, 1967). As can be seen
from the alpha values in Table I, the internal consistency of the seven
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
categories is between 0.77 and 0.89, well above the minimum recommended
value of 0.70.
Two constructs (strategic quality planning and customer satisfaction) used
in this research have only two examination items. It is generally suggested that
more than two items should be used to ensure the reliability of the construct.
Although the Cronbach alpha values for these constructs were acceptable, we
decided that a more conservative measure for reliability should be calculated to
confirm that these constructs were reliable. Therefore, Fornell and Larcker's
(1981) vc, which measures the amount of variance captured by the category in
relation to the amount of variance due to measurement error, was also
calculated for each construct. The mean average variance explained by each
factor, vc, are all greater than 50 percent indicating that the variance captured
by each construct is greater than the variance due to measurement error
(Fornell and Larcker, 1981). The reliability of the eight constructs was thus
established through the model estimates of the Cronbach's (1951) alpha and
Fornell and Larcker's (1981) vc.
The standardized path coefficients for the set of causal relationships are
presented in Figure 2. As in the case of regression analysis, path analysis uses
the error term to determine the effects of variables not captured in the path
diagram. The t-values associated with each path coefficient facilitate the
determination of the statistical significance of the coefficient. The R2 value for
each dependent variable indicates the percentage of variation in the construct
explained by the variables included in the path. For example, the leadership
construct and the information management construct explained about 37
percent of the variance in the strategic quality planning construct. In addition,
the t-values indicate that while information management has a significant
impact on strategic quality planning, leadership does not. The R2 value for each
equation tested and the significance of the path coefficients are also indicated in
Figure 2.
Figure 2 shows the direct effect of one construct on another by the arrow
joining the two constructs. Indirect effects of constructs can be determined by
following a series of forward-pointing arrows. For example, while the model
does not include a direct effect of leadership on product and process
management, we can determine any indirect effect it might have by examining
the direct effects of leadership on strategic quality planning and human
A study of
relationships
27
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
Figure 2.
The MBNQA
quality-performance
model
resources management and the direct effects of these two constructs on product
and process management.
The indirect effect of leadership on product and process management can be
calculated as:
direct effect of leadership on strategic quality planning * direct effect of
strategic quality planning on product and process management
+ direct effect of leadership on human resources management *direct
effect of human resources management on product and process
management
= 0.182*0.247 + 0.358*0.688
= 0.291.
The indirect effects of the other constructs were calculated using the same
logic. Table II presents the indirect effects thus calculated along with the direct
and total effects. The total effect of a construct is the sum of its direct and
indirect effects.
H1a was partially supported by the results. Information management has a
significant direct effect on strategic quality planning. However, the effect of
leadership on strategic quality planning was not significant at the 0.05 alpha
level. H1b was supported by the significant path coefficients. Both leadership
IJQRM Direct Indirect Total
18,1 Hypothesis Path effect effect effect
quality planning on each performance construct was not significant at the 0.05
level. Product and process management did not have a significant effect on
customer satisfaction. However, its effect on business results was significant at
the 0.05 level. Finally, business results had a significant direct effect on
customer satisfaction.
customers' needs and maintain a good relationship with its existing customer
base. The results from this analysis underscore the value of customer focus and
effective customer relationship management. This construct had the most
significant effect on both business results and customer satisfaction results.
This focus on customers is also emphasized throughout the MBNQA criteria in
its planning and execution of the other quality management constructs.
Winn and Cameron (1998) found that their research did not validate the
Baldrige framework. As a result, they performed modifications of the
framework to derive a model that was statistically significant. It is interesting
that our analysis has provided evidence to confirm the validity of the Baldrige
criteria. The differences in the results can be partially explained by the
differences in the sample studied and the process used to collect the data. Winn
and Cameron used the self-reported rankings from a survey conducted at a
university in the mid-western USA. This research is based on data obtained
from an actual application process to a state quality award. As a result, the
data used in this study is a third-party evaluation of self-reported data and
information. Also, the training that the examiners undergo improves their
objectivity in evaluating the organizations. Therefore, one could argue that
such data might be more objective than self-reported scale item data.
This research used data from a state quality award (AGQA) to test the
strength of the relationships between the MBNQA categories. Since this study
employed a limited sample, replications of this analysis, using samples from
other state award programs or surveys based on the MBNQA criteria, are
needed to confirm our conclusions. One must be cautious in drawing general
conclusions from the results of this research. In making generalizations, one
must consider the extent to which the AGQA criteria and process parallel the
MBNQA criteria and the extent to which the sample data reflect the population
of organizations to which the MBNQA model may be applied. Future research
on the MBNQA criteria should seek more varied data sources, such as other
state and local award data, to confirm the results of this study.
This study was based on the MBNQA criteria and AGQA data for 1993.
Since then, some changes have been made to the criteria, the most significant of
which were in the 1997 MBNQA criteria (Bemowski, 1996). Indeed, the
MBNQA model and criteria are described as a living program, changing and
developing with our advancements in knowledge and improvements in
industry practice. The examination items and some of the categories have been A study of
rearranged and renumbered to provide a stronger customer and organizational relationships
focus and a more clear representation of the relationship between the different
categories. However, as Bemowski (1996) points out, even as the criteria evolve,
the criteria's underlying theme of a systematic approach to quality remains
unchanged. The 1993 criteria still represent a possible model of organizational
quality that is used by organizations in developing their business and quality 31
strategy and practices. Therefore, validating the model provides useful
information to managers in deciding where they should focus their efforts in
their journey toward becoming a quality organization.
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
We do, however, need to address one major change in the MBNQA. Since the
1997 criteria, the MBNQA model assumes that the customer focus of an
organization not only influences the outcome measures, but also influences the
infrastructure constructs of human resources management and product and
process management. This effect has not been tested in this research. The
results from this study indicate that customer focus and relationship
management has a very significant direct effect on business results and
customer satisfaction. Future research on the MBNQA criteria must focus on
validating the important role of customer focus on the quality management
practices of an organization.
In this study, relationships between the quality management constructs and
between quality management and performance were tested at the category
level. More detailed analysis at the item level will provide better insights about
how each of the items is related to specific items in other categories. Evans
suggests that such research is essential for a clear understanding of how the
various quality management factors affect each other and business
performance (Evans, 1997). This study is based on cross-sectional data. It
would be interesting to evaluate the impact of quality management practices in
general, and the MBNQA criteria and award process in particular, on the
aggregate level of quality and performance among businesses in a particular
region or industry. Longitudinal analysis of award data at various local,
regional, and national levels should be used in future research to address this
issue.
The MBNQA criteria take a multifaceted view of quality management and
encourage organizations to broaden their view of quality management from a
product quality focus to an organizational focus. In doing this, the criteria
emphasize the organizational infrastructure that is essential to maintain and
improve core quality improvement processes. This research shows that the
criteria and framework provide a model that reflects the relationships between
the various aspects of management that determine an organization's
performance. An organization that focuses on just its primary quality
management procedures, such as quality control techniques and product
design process, is unlikely to be successful. A strong focus on customers and
employees, in addition to effective leadership and information management are
clearly shown to be essential for organization success.
IJQRM References
18,1 Adam, E.E., Corbett, L.M., Flores, B.E., Harrison, N.J., Lee, T.S., Rho, B., Ribera, J., Sampson, D.
and Westbrook, R. (1997), ``An international study of quality improvement approach and
firm performance'', International Journal of Operations & Production Management,
Vol. 17 No. 9, pp. 842-73.
Ahire, S.L., Golhar D.Y. and Waller M.A. (1996), ``Development and validation of TQM
implementation constructs'', Decision Sciences, Vol. 27 No. 1, pp. 23-56.
32
Anderson, J.C., Rungtusanatham, M.S., Schroeder, R.G. and Devaraj, S. (1995), ``A path analytic
model of a theory of quality management underlying the Deming management method:
preliminary empirical findings'', Decision Sciences, Vol. 26 No. 5, pp. 637-58.
ASQ (1998), ``American Society for Quality urges expansion of Baldrige awards'', PR Newswire,
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
JoÈreskoj, K.G. and SoÈrbom, D. (1993), LISREL 8: Analysis of Linear Structural Relationships by
Maximum Likelihood, Instrument Variables and Least Squares Methods, 8th ed., Scientific
Software, Morresville, IN.
Kochan, A. (1992), ``Baldrige award as a quality model'', Quality, Vol. 31 No. 2, pp. 17-20.
Lengnick-Hall, C.A. and Sanders, M.M. (1997), ``Designing effective learning systems for
management education: student roles, requisite variety, and practicing what we teach'',
Academy of Management Journal, Vol. 40 No. 6, pp. 1334-68.
Li, C.C. (1975), Path Analysis: A Primer, The Boxwood Press, Pacific Grove, CA.
Li, L.X. (1997), ``Relationships between the determinants of hospital quality management and
service quality performance ± a path analytic model'', Omega, Vol. 25 No. 5, pp. 535-45.
Long, J.S. (1983), Covariance Structure Models: An Introduction to LISREL, Sage University
Press, Beverly Hills, CA.
Main, J. (1990), ``How to win the Baldrige award'', Fortune, Vol. 121 No. 9, pp. 101-16.
Main, J. (1991), ``Is the Baldrige overblown?'', Fortune, Vol. 124 No. 1, pp. 62-5.
Marsch, H.W. and Hocevar, D. (1985), ``Application of confirmatory factor analysis of the study of
self-concept: first and higher order factor models and their invariance across groups'',
Psychological Bulletin, Vol. 97 No. 3, pp. 562-82.
Marsh, B. (1994), ``Baldrige award gets fewer applicants from small business ± costing tens of
thousands, the price of pursuing Oscar for quality deters many'', Wall Street Journal,
13 October, p. B2.
Maynard, M. (1991), ``GAO study: high quality pays off'', USA Today, 4 June, p. 02B.
Moore, M.T. (1995), ``Is TQM dead? Even quality leaders see gaps in ranks'', USA Today,
17 October, p. 01B.
Nadkarni, R.A. (1995), ``A not-so-secret recipe for successful TQM'', Quality Progress, Vol. 28
No. 11, pp. 91-6.
National Institute of Standards and Technology (NIST) (1999), http://www.nist.gov
National Institute of Standards and Technology (NIST) (1993), 1993 Award Criteria, Malcolm
Baldrige National Quality Award, NIST, Gaithersburg, MD.
Nunnally, J. (1967), Psychometric Theory, McGraw-Hill, New York, NY.
Pannirselvam, G.P. (1997), ``Quality management and organizational context'', Proceedings of the
Annual Meeting of the Decision Sciences Institute, pp. 1614-16.
Pannirselvam, G.P., Siferd, S.P. and Ruch, W.A. (1998), ``Validation of the Arizona Governor's
Quality Award: a test of the Baldrige criteria'', Journal of Operations Management, Vol. 16
No. 6, pp. 529-50.
Phillips, L.W., Chang, D.R. and Buzzell, R.D. (1983), ``Product quality, cost position and business
performance: a test of some hypotheses'', Journal of Marketing, Vol. 47, pp. 26-43.
IJQRM Poister, T.H. and Harris, R.H. (1997), ``The impact of TQM on highway maintenance: benefit/cost
implications'', Public Administration Review, Vol. 57 No. 4, pp. 294-302.
18,1 Rajan, M. and Tamimi, N. (1999), ``Baldrige award winners: the payoff to quality'', The Journal of
Investing, Vol. 8 No. 4, pp. 39-42.
Roth, A.V. and Miller, J. (1989), ``International manufacturing strategies: a comparative analysis'',
in Ferdows, E. (Ed.), Managing International Manufacturing, Elsevier Science Publishers,
Amsterdam.
34 Roth, A.V., Demeyer, A. and Amano, A. (1990), ``Manufacturing strategy, manufacturing
strength, managerial success, and economic outcomes'', in Ettlie, J.E., Burstein, M.C. and
Feigenbaum, A. (Eds), Manufacturing Strategy, Kluwer Academic Publishers, Norwell,
MA.
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
Rungtusanatham, M.S., Forza, C., Filippini, R. and Anderson, J.C. (1998), ``A replication study of a
theory of quality management underlying the Deming management method: insights from
an Italian context'', Journal of Operations Management, Vol. 17 No. 1, pp. 77-95.
Saraph, J.V., Benson, P.G. and Schroeder, R. (1989), ``An instrument for measuring the critical
factors for quality management'', Decision Sciences, Vol. 20 No. 4, pp. 810-29.
Schoeffler, S., Buzzell, R.D. and Heany, D.F. (1974), ``Impact of strategic planning on profit
performance'', Harvard Business Review, Vol. 52 No. 2, pp. 137-46.
Sims et al. (1992), ``Does the Baldrige award really work?'', Harvard Business Review, Vol. 70
No. 1, pp. 126-47.
Smith, J. and Oliver, M. (1992), ``The Baldrige boondoggle'', Machine Design, Vol. 64 No. 16,
pp. 25-9.
Sowards, D. (1993), interview with the Director of Arizona Quality Alliance (AQA).
Tucker, L.R. and Lewis, C. (1973), ``The reliability coefficient for maximum likelihood factor
analysis'', Psychometrika, Vol. 38 No. 1, pp. 1-10.
Winn, B.A. and Cameron, K.S. (1998), ``Organizational quality: an examination of the Malcolm
Baldrige National Quality Framework'', Research in Higher Education, Vol. 39 No. 5,
pp. 491-512.
Zemke, R. (1991), ``Bashing the Baldrige'', Training, Vol. 28 No. 2, pp. 29-39.
This article has been cited by:
1. Flávia Monize Barbosa, Lillian do Nascimento Gambi, Mateus Cecilio Gerolamo. 2017. Liderança e gestão
da qualidade – um estudo correlacional entre estilos de liderança e princípios da gestão da qualidade. Gestão
& Produção 24:3, 438-449. [Crossref]
2. María de la Cruz Del Río-Rama, José Álvarez-García, Margarida Saraiva, António Ramos-Pires. 2017.
Influence of quality on employee results: the case of rural accommodations in Spain. Total Quality
Management & Business Excellence 1, 1-20. [Crossref]
3. Stanislaus Roque Lobo, Premaratne Samaranayake, Nachiappan Subramanian. 2017. The impact of TQM
and information communication technology (ICT) as an enabler in the quality management assessment
framework (QMAF) on business outcomes. International Journal of Systems Science: Operations & Logistics
3, 1-17. [Crossref]
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
4. OhSeok-young, Seok-young Oh, KuchinkeK. Peter, K. Peter Kuchinke. 2017. Exploring the role
of organizational learning activities in the quality management context. Leadership & Organization
Development Journal 38:3, 380-397. [Abstract] [Full Text] [PDF]
5. Álvarez-GarcíaJosé, José Álvarez-García, del Río-RamaMaría de la Cruz, María de la Cruz del Río-
Rama, SimonettiBiagio, Biagio Simonetti. 2017. Quality management and customer results: the tourist
accommodation sector in Spain. International Journal of Quality & Reliability Management 34:5, 701-719.
[Abstract] [Full Text] [PDF]
6. Iman Mesgari, Ali Kamali Miab, Mohammad Jamal Sadeghi. 2017. Causal structure of the EFQM
excellence model among healthcare sector: a case study in Iran. Total Quality Management & Business
Excellence 28:5-6, 663-677. [Crossref]
7. José Álvarez-García, María del Río-Rama, María Miras-Rodríguez. 2017. How Do Quality Practices Affect
the Results?: The Experience of Thalassotherapy Centres in Spain. Sustainability 9:4, 671. [Crossref]
8. PatyalVishal Singh, Vishal Singh Patyal, KoilakuntlaMaddulety, Maddulety Koilakuntla. 2017. The impact
of quality management practices on performance: an empirical study. Benchmarking: An International
Journal 24:2, 511-535. [Abstract] [Full Text] [PDF]
9. Louis W. Fry, John R. Latham, Sharon K. Clinebell, Keiko Krahnke. 2017. Spiritual leadership as a model
for performance excellence: a study of Baldrige award recipients. Journal of Management, Spirituality &
Religion 14:1, 22-47. [Crossref]
10. Ioannis N. Metaxas, Dimitrios E. Koulouriotis. 2017. Business excellence measurement: a literature analysis
(1990–2016). Total Quality Management & Business Excellence 1. [Crossref]
11. Rana Basu, Prabha Bhola, Indranil Ghosh, Pranab K Dan. 2016. Critical linkages between quality
management practices and performance from Indian IT enabled service SMEs. Total Quality Management
& Business Excellence 1-39. [Crossref]
12. Arturo Calvo-Mora, Antonio Navarro-García, Manuel Rey-Moreno, Rafael Periañez-Cristobal. 2016.
Excellence management practices, knowledge management and key business results in large organisations
and SMEs: A multi-group analysis. European Management Journal 34:6, 661-673. [Crossref]
13. Jordi Perramon, Alfredo Rocafort, Llorenç Bagur-Femenias, Josep Llach. 2016. Learning to create
value through the ‘balanced scorecard' model: an empirical study. Total Quality Management & Business
Excellence 27:9-10, 1121-1139. [Crossref]
14. Marcio Bambirra Santos, Plínio Rafael Reis Monteiro, Márcio Augusto Gonçalves, Ronaldo Darwich
Camilo. 2016. Reference models and competitiveness: an empirical test of the management excellence
model (MEG) in Brazilian companies. Total Quality Management & Business Excellence 1-19. [Crossref]
15. S. Parvadavardini, N. Vivek, S.R. Devadasan. 2016. Impact of quality management practices on quality
performance and financial performance: evidence from Indian manufacturing companies. Total Quality
Management & Business Excellence 27:5-6, 507-530. [Crossref]
16. S. Shanmugapriya, K. Subramanian. 2016. Developing a PLS path model to investigate the factors
influencing safety performance improvement in construction organizations. KSCE Journal of Civil
Engineering 20:4, 1138-1150. [Crossref]
17. Eva Suarez, Arturo Calvo-Mora, José Luis Roldán. 2016. The role of strategic planning in excellence
management systems. European Journal of Operational Research 248:2, 532-542. [Crossref]
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
18. Ana B. Escrig, Lilian M. de Menezes. 2015. What characterizes leading companies within business
excellence models? An analysis of “EFQM Recognized for Excellence” recipients in Spain. International
Journal of Production Economics 169, 362-375. [Crossref]
19. Joaquín Gómez Gómez, Micaela Martínez Costa, Angel R. Martínez Lorente. 2015. An in-depth review of
the internal relationships of the EFQM model. The TQM Journal 27:5, 486-502. [Abstract] [Full Text]
[PDF]
20. Mahour Mellat-Parast. 2015. A longitudinal assessment of the linkages among the Baldrige criteria using
independent reviewers’ scores. International Journal of Production Economics 164, 24-34. [Crossref]
21. Jeeeun Kim, Byungun Yoon, Jeawook Yoon, Sungjoo Lee. 2015. Characteristics of new product
development activities in SMEs: an empirical analysis of the Korean IT sector. Asian Journal of Technology
Innovation 23:2, 230-254. [Crossref]
22. June-Duk Kwon, Chiho Yoon, Hyun-Jong Oh, Beom-Gyu Park, Yang-Kyun Kim. 2015. A Study
on Causality between Total Quality Management and Performance of Secondary-Care Hospital Using
Malcolm Baldrige National Quality Award Model for Healthcare. Journal of the Korean society for quality
management 43:1, 11-30. [Crossref]
23. Hendry Raharjo, Roberta Guglielmetti Mugion, Henrik Eriksson, Ida Gremyr, Laura Di Pietro, Maria
F Renzi. 2015. Excellence models in the public sector. Relationships between enablers and results.
International Journal of Quality and Service Sciences 7:1, 120-135. [Abstract] [Full Text] [PDF]
24. Sang-Hoon Han, Kyu-Suk Chung, Seung-Pyo Hong. 2014. Effect of Quality Management on the
Performance: Focusing Manufacturing Companies Awarding Korean National Quality Awards. Journal of
the Korean society for quality management 42:4, 729-746. [Crossref]
25. Li-Ying Cheng, De-Cheng Wen, Hong-Chang Jiang. 2014. The performance excellence model in
construction enterprises: an application study with modelling and analysis. Construction Management and
Economics 32:11, 1078-1092. [Crossref]
26. Chang-Juck Suh, Kim, Jong Hoon. 2014. Senior Leader’s Effective Communication System: Focused on
Shinhan Life Insurance Case. Journal of Korea Service Management Society 15:4, 85-106. [Crossref]
27. Eva Suárez, José L. Roldán, Arturo Calvo-Mora. 2014. A structural analysis of the EFQM model: an
assessment of the mediating role of process management. Journal of Business Economics and Management
15:5, 862-885. [Crossref]
28. Mahour Mellat-Parast. 2014. Linking quality citizenship to process design: a quality management
perspective. International Journal of Production Research 52:18, 5484-5501. [Crossref]
29. Xuemei Fan, Dawei Lu. 2014. Re-balancing the excellence frameworks with individualistic logic. Total
Quality Management & Business Excellence 25:5-6, 478-493. [Crossref]
30. Amir Karimi, Hossein Safari, Seyed Hamid Hashemi, Payam Kalantar. 2014. A study of the Baldrige
Award framework using the applicant scoring data. Total Quality Management & Business Excellence 25:5-6,
461-477. [Crossref]
31. Vimlan Moonsamy, Shalini Singh. 2014. Using factor analysis to explore principal components for quality
management implementation. Quality & Quantity 48:2, 605-622. [Crossref]
32. Mark R. Jones. 2014. Identifying Critical Factors That Predict Quality Management Program Success:
Data Mining Analysis of Baldrige Award Data. Quality Management Journal 21:3, 49-61. [Crossref]
33. . Bibliography 149-158. [Crossref]
34. Mehran Ebrahimi, Mehran Sadeghi. 2013. Quality management and performance: An annotated review.
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
50. Jae-Young Moon, Sang-Chul Lee, Park Yong-Seung, Yung-Ho Suh. 2011. A study on the causal
relationships in the Korean National Quality Award model. Total Quality Management & Business
Excellence 22:7, 705-726. [Crossref]
51. M. Mar Fuentes-Fuentes, F. Javier Lloréns-Montes, Luis M. Molina-Fernández, Carlos A. Albacete-Sáez.
2011. Environment-quality management coalignment across industrial contexts: An empirical investigation
of performance implications. Industrial Marketing Management 40:5, 730-742. [Crossref]
52. Lawrence M. Corbett, Linda C. Angell. 2011. Business excellence in New Zealand: continuous
improvement, learning, and change. Total Quality Management & Business Excellence 22:7, 755-772.
[Crossref]
53. Lawrence M. Corbett. 2011. Lean Six Sigma: the contribution to business excellence. International Journal
of Lean Six Sigma 2:2, 118-131. [Abstract] [Full Text] [PDF]
54. Sherif Mohamed, Thanwadee Chinda. 2011. System dynamics modelling of construction safety culture.
Engineering, Construction and Architectural Management 18:3, 266-281. [Abstract] [Full Text] [PDF]
55. Mahour Mellat Parast, Stephanie G. Adams, Erick C. Jones. 2011. Improving operational and business
performance in the petroleum industry through quality management. International Journal of Quality &
Reliability Management 28:4, 426-450. [Abstract] [Full Text] [PDF]
56. Nihal Palitha Jayamaha, Nigel Peter Grigg, Robin Stephen Mann. 2011. Empirical analysis of the Baldrige
Criteria as both an organisational performance measure and a theoretical model. Measuring Business
Excellence 15:1, 20-33. [Abstract] [Full Text] [PDF]
57. Zhen He, James Hill, Ping Wang, Gang Yue. 2011. Validation of the theoretical model underlying the
Baldrige criteria: Evidence from China. Total Quality Management & Business Excellence 22:2, 243-263.
[Crossref]
58. Jun Yong Xiang, Zhen He, Yung Ho Suh, Jae Young Moon, Ya Fen Liu. 2010. An empirical investigation of
the China Quality Award causal model. Asian Journal on Quality 11:1, 49-68. [Abstract] [Full Text] [PDF]
59. Tak-Wing Liu, Kwai-Sang Chin. 2010. Development of audit system for intellectual property management
excellence. Expert Systems with Applications 37:6, 4504-4518. [Crossref]
60. . Bibliography 205-213. [Crossref]
61. Wen‐Yi Sit, Keng‐Boon Ooi, Binshan Lin, Alain Yee‐Loong Chong. 2009. TQM and customer
satisfaction in Malaysia's service sector. Industrial Management & Data Systems 109:7, 957-975. [Abstract]
[Full Text] [PDF]
62. Linda C. Angell, Lawrence M. Corbett. 2009. The quest for business excellence: evidence from New
Zealand's award winners. International Journal of Operations & Production Management 29:2, 170-199.
[Abstract] [Full Text] [PDF]
63. V. Arumugam, Hiaw Wei Chang, Keng‐Boon Ooi, Pei‐Lee Teh. 2009. Self‐assessment of TQM practices:
a case analysis. The TQM Journal 21:1, 46-58. [Abstract] [Full Text] [PDF]
64. Steve Baron, Kim Harris, Toni Hilton. Service Profitability 217-241. [Crossref]
65. J. Carlos Bou-Llusar, Ana B. Escrig-Tena, Vicente Roca-Puig, Inmaculada Beltrán-Martín. 2009. An
empirical assessment of the EFQM Excellence Model: Evaluation as a TQM framework relative to the
MBNQA Model. Journal of Operations Management 27:1, 1-22. [Crossref]
66. Nigel Grigg, Robin Mann. 2008. Review of the Australian Business Excellence Framework: A comparison
of national strategies for designing, administering and promoting Business Excellence Frameworks. Total
Downloaded by Universiti Tun Hussein Onn Malaysia At 14:05 11 December 2017 (PT)
82. Max Saunders, Robin Mann. 2005. Self‐assessment in a multi‐organisational network. International
Journal of Quality & Reliability Management 22:6, 554-571. [Abstract] [Full Text] [PDF]
83. Arturo Calvo-mora, Antonio Leal, José L. Roldán. 2005. Relationships between the EFQM model criteria:
a study in Spanish universities. Total Quality Management & Business Excellence 16:6, 741-770. [Crossref]
84. J. Carlos Bou‐Llusar, Ana B. Escrig‐Tena, Vicente Roca‐Puig, Inmaculada Beltrán‐Martín. 2005. To
what extent do enablers explain results in the EFQM excellence model?. International Journal of Quality
& Reliability Management 22:4, 337-353. [Abstract] [Full Text] [PDF]
85. Kent V. Rondeau, Terry H. Wagar. 2004. Implementing CQI While Reducing the Work Force: How Does
it Influence Hospital Performance?. Healthcare Management Forum 17:2, 22-29. [Crossref]
86. V.K. Khanna, Prem Vrat, Ravi Shankar, B.S. Sahay. 2004. Managing the transition phases in the TQM
journey: a system dynamics approach. International Journal of Quality & Reliability Management 21:5,
518-544. [Abstract] [Full Text] [PDF]
87. Chao-Ton Su, Shao-Chang Li, Chin-Ho Su. 2003. An empirical study of the Taiwan National Quality
Award causal model. Total Quality Management & Business Excellence 14:8, 875-893. [Crossref]
88. Hale Kaynak. 2003. The relationship between total quality management practices and their effects on firm
performance. Journal of Operations Management 21:4, 405-435. [Crossref]
89. Y.S. Tsang, Stephen F. Lee. 2002. A study on Sun Pin’s art of business management strategies matching the
MBNQA criteria for business competitiveness. Integrated Manufacturing Systems 13:6, 386-407. [Abstract]
[Full Text] [PDF]
90. Thomas K.Y. Tang. 2002. Powerhouse’s management strategies for excellent business achievement.
Integrated Manufacturing Systems 13:6, 366-374. [Abstract] [Full Text] [PDF]
91. Barbara B. Flynn, Brooke Saladin. 2001. Further evidence on the validity of the theoretical models
underlying the Baldrige criteria. Journal of Operations Management 19:6, 617-652. [Crossref]
92. D.M. Hussey, P.D. Eagan, R.B. Pojasek. A performance model for driving environmental improvement
down the supply chain 107-112. [Crossref]
93. Kijpokin Kasemsap. The Role of Total Quality Management Practices on Quality Performance 1-31.
[Crossref]