Professional Documents
Culture Documents
514 / Vol. 127, JULY 2005 Copyright © 2005 by ASME Transactions of the ASME
important research issues to be addressed before the method can the input A of a demand model could be either quantifiable or
be fully applied and used with confidence. First, more guidelines nonquantifiable 共e.g., level of comfort兲. However, to assist engi-
need to be provided to assist designers when applying the DCA neering decision making, the attributes A need to be converted to
approach to demand modeling that facilitate engineering decision quantifiable engineering design attributes E, represented using en-
making, especially in the design of complex engineering systems. gineering languages 共see more details in Sec. 3.1兲. The engineer-
The mapping of customer desires to engineering design attributes ing design attributes E may also include product selection at-
related to engineering analyses needs to be addressed, and the tributes that are only of interest to design engineers, e.g., the stress
procedure should enable designers to focus the demand survey on level of a structure. The flowchart in Fig. 1 coincides with an
specific features of the product without harming the consistency optimization loop that identifies the best design option X to maxi-
of the demand analysis at the system level of a product. Second, a mize the expected utility. For enterprise-wide product design, de-
method for selecting the form of the customer utility function sign options X may include nonengineering-related design op-
should be provided so that the construction of a demand model is tions, e.g., warranty options, that have no relationship with the
based on sound econometric reasoning instead of simple 共math- engineering design attribute E, but will have a direct impact on
ematical兲 model fitting. A mathematical model may fit the data some customer product selection attributes A 共in this case the
well, however, may not capture the true underlying purchase be- warranty feature兲.
havior and, therefore, its value in predicting demand may be poor.
In this work, we provide detailed guidelines for demand mod- 2.2 Background of Discrete Choice Analysis. DCA identi-
eling that facilitates engineering decision making. To bridge the fies patterns in choices customers make between competing prod-
gap between business and engineering, a hierarchy of product ucts, and generates the probability that an option is chosen. A key
attributes is considered to map product feature-related customer concept of DCA is to estimate the customer’s 共choice兲 utility at
desires down to engineering design attributes that can be repre- the individual level, employing the probabilistic choice theory to
sented using engineering languages. We also present an approach address unobserved taste variations, unobserved attributes, and
for selecting the form of a customer 共choice兲 utility function of model deficiencies. A quantitative process based on multinomial
demand analysis to enhance the predictive accuracy. The proposed analysis is used to generate the demand model. The probabilistic
approaches are demonstrated using a real 共passenger兲 vehicle en- choice theory entails the assumption that the individual’s true util-
gine case study in collaboration with the market research firm J. ity U can be estimated using a deterministic utility W supple-
D. Power & Associates and the Ford Motor Company. Before mented with a random disturbance 共see Eq. 共1兲兲. The determin-
presenting our proposed methods, the necessary background of istic part can be parameterized as a function of observable
DBD, DCA, and the Kano method are introduced first. independent variables 共customer product selection attributes A,
socioeconomic and demographic attributes S, and price P兲 and
2 Technical Background unknown coefficients , which can be estimated by observing the
choices respondents make 共real or stated兲 and thus represent the
2.1 Decision-Based Design Framework. The flowchart of respondent’s taste, see Eq. 共2兲. The  coefficients and utility func-
the DBD framework that we proposed 关2兴 as an enhancement to tions are indicated with the subscript n, representing the nth re-
Hazelrigg’s DBD framework is shown in Fig. 1. The arrows in the spondent, and the index i refers to the ith choice alternative.
flowchart indicate the existence of relationships between the dif-
ferent entities 共parameters兲 in DBD, instead of showing the se-
quence of implementing DBD. One of our major contributions lies
in introducing discrete choice analysis as a systematic approach to Uin = Win + in 共1兲
establish the relationship between the customer product selection
attributes A, the socioeconomic and demographic background S of
the market population, time t, and the demand Q. In this flow-
chart, the engineering design attributes E are any quantifiable Win = f共Ai, Pi,Sn ; n兲 共2兲
product properties that are used in the product design process by a The probability that alternative 1 is chosen from a choice set
design engineer, represented as functions of design options X containing two alternatives 共binary choice兲 is then defined as the
through engineering analysis. The customer product selection at- probability that the utility of alternative 1 exceeds the utility of
tributes A are product features and financial attributes 共such as alternative 2 or, alternatively, on the probability that the difference
service and warranty兲 that a customer typically considers when between the disturbances does not exceed the difference of the
purchasing the product. From the demand modeling perspective, deterministic parts of the utility, i.e.,
erence兲. To facilitate engineering decision making, the customer all be considered as engineering design attributes E, which are
language of the customer desires 共e.g., good engine sound quality兲 modeled as functions of design options such as crankshaft mate-
should be translated into quantifiable engineering language, i.e., to rial, pin diameter, and cheek thickness, through engineering analy-
identify suitable units of measurement for each customer desire. sis.
This task consists of cooperation between market researchers and
engineering specialists, and perhaps consultations with customers 3.2 Phase II: Data Collection.
to verify the correct understanding of the customer desires. It 3.2.1 Stated Choice Versus Revealed Choice. There are two
implies that a design engineer must develop a preliminary under- ways of collecting choice data: stated choice and revealed choice.
standing of the design and how the design can fulfill the customer Revealed choice concerns actual 共purchase兲 behavior that can be
desires. Identification of the customer product selection attributes observed in real choice situations. Stated choice concerns con-
for some customer desires is straightforward, e.g., miles per gal- trolled choice experiments that ask the respondents to state their
lon for fuel economy in vehicle design. For other customer de- intent without needing to commit to the consequence of their de-
sires, this can be quite complicated, e.g., vehicle style or engine cision 共e.g., pay the purchase price兲. Revealed choice can be used
sound quality. It is possible that multiple attributes need to be used when similar products or services exist 共e.g., when redesigning a
to capture the properties of a customer desire, while one attribute power tool兲, while stated choice can be used for innovative de-
can impact multiple customer desires. Figure 3 demonstrates how signs, product features, or services that do not yet exist, which
the top-level customer desires are mapped to specific customer have new attributes or whose levels of the customer product se-
desires 共in customer language兲, and then to customer product se- lection attributes lie outside the attribute level range of existing
lection attributes A, which are further related to engineering de- products. One should be aware that either stated choice or re-
sign attributes E. The quantifiable customer product selection at- vealed choice has advantages and disadvantages 关19,27兴.
tributes A become a subset of the engineering design attributes E;
the latter also include attributes that are of interest only to design- 3.2.2 Survey Respondent Sampling. Several techniques can be
ers, but not customers. Establishing such a mapping relationship is used to sample a population 关15兴; however any sampling design
especially important in the design of complex engineering starts with defining the target market population, i.e., what con-
systems. sumers 共customer background distribution兲 buy what 共competing兲
Demand modeling deals with the functional relationship be- products, the target market population size, etc., and a definition
tween the market demand Q and the customer product selection of the sampling unit, i.e., a customer or a product purchase. Ran-
attributes A, along with the socioeconomic background of custom- dom sampling entails randomly drawing an observation 共customer
ers S, price P, and the time factor t. To integrate the demand or product purchase兲 such that the probability of that observation
model into the decision-based design framework 共see Fig. 1兲, en- to be drawn equals 1/N, where N represents the market popula-
gineering analysis 共modeling兲 needs to be carried further to estab- tion. Random sampling cannot adequately capture the choice be-
lish the relationship between design options X and the attributes havior of a very small population subgroup. This issue can be
A. During the engineering analysis process, additional design at- addressed using stratified random sampling 关15兴, which divides
tributes might be introduced as intermediate variables or variables the market population into mutually exclusive and exhaustive seg-
that impose physical restrictions on the design or impact the prod- ments. Random samples are then drawn from each market seg-
uct cost. As an example of mapping customer desires to specific ment. A demand model for each market segment can be con-
design, we show at the right side of Fig. 3 that 共low兲 engine sound structed to predict each market segment’s demand, which can then
while idling could be considered as a specific customer desire that be properly weighted to arrive at an unbiased estimate for the total
belongs to the group of 共engine兲 performance, which is a product market demand.
benefit. Radiated sound and engine mount vibration can be con-
sidered as customer product selection attributes for measuring the 3.3 Phase III: Modeling. Phase III is a quantitative process
engine sound while idling. At the next level, engineering models to generate the demand model. Based on the collected discrete
will consider other engineering design attributes such as main choice data, whether they are revealed or stated choice, modeling
bearing clearance and crankshaft stiffness. Quantifiable attributes techniques such as logit 关15,20兴 or probit 关21,22兴 can be used to
A like radiated sound, engine mount vibration, and additional de- create a choice model that can predict the choices individual cus-
sign attributes like bearing clearance and crankshaft stiffness will tomers make and forecasts the market demand for a designed
Specific customer
Top-level customer desires desires Customer product selection attributes A
shows a representative mapping of top-level customer desires via on DBD 关2兴 for a universal motor case study. The design options
the specific customer desires to the customer product selection in this vehicle engine design case study are represented by the
attributes. Take engine and transmission performance as an ex- different settings of attribute levels.
ample. The specific customer desires include performance during
rapid acceleration, passing power at highway speeds, and also a 4.2 Vehicle Demand Modeling: Data Collection. The de-
pleasant sound while idling and at full throttle acceleration and mand model is created using revealed choice data at the respon-
low vibration levels. Interaction between engineering experts at dent level provided by J. D. Power. The data consist of 2552
the Ford Motor Company and market research specialists from J. observed individual vehicle purchases 共of the seven vehicles, 12
D. Power helped identify the customer product selection attributes trims considered in this case study兲 in the USA of the year 2000
corresponding to their specific customer desires. Linking these vehicle market, including respondents’ background. The values of
attributes, further down the hierarchy, to design options, is also an customer product selection attributes related to the general vehicle
important activity of designers. However, it is not covered in this descriptions of the 12 discrete choices, such as weight, fuel
case study. An example of this linking can be found in our paper economy, and legroom are obtained from Ward’s Automotive. The
Gender 1
Age −0.192 1
Income −0.074 −0.176 1
USA/Import 0.150 −0.220 0.087 1
MSRPគprice 0.006 −0.041 0.141 0.183
Rebate −0.101 0.256 −0.141 −0.869
apr −0.072 0.173 −0.017 −0.425
Resale index 0.178 −0.215 0.031 0.869
vdi 共dependability兲 −0.117 0.036 0.024 −0.746
iqs 共initial quality兲 −0.162 0.187 −0.059 −0.928
Horsepower/mass −0.011 −0.104 0.180 0.212
Torque/mass −0.051 −0.005 0.148 0.013
Low-end torque/mass −0.087 0.036 0.120 −0.255
Fuel economy 0.127 −0.047 −0.102 0.444
Fuel range 0.138 −0.063 −0.045 0.680
Wheel base −0.106 0.076 0.050 −0.667
Vehicle width −0.119 0.157 −0.066 −0.918
Vehicle length −0.149 0.154 −0.038 −0.907
Front-headroom −0.013 −0.103 0.145 0.290
Front-legroom 0.072 −0.094 0.116 0.762
Rear-headroom −0.162 0.132 0.053 −0.695
Rear-legroom −0.140 0.157 0.013 −0.731
Trunk space −0.132 0.139 0.004 −0.844
values of some other attributes, such as ride, handling, noise, and ity functions with different combinations of linear and interaction
vibration are provided by Ford. A representative part of the choice items. Eventually, a model using 38 explanatory variable items
set input data table for one customer is presented in Table 2. 共including interactions兲 is selected based on the Bayesian infor-
For each respondent, there are 12 rows of data in the database, mation criterion 共BIC兲 score 共see description in Sec. 3.3兲. With the
one for each choice alternative, each row containing the customer selected model, the observed and the estimated market shares for
background, the customer product selection attributes that de- the 12 vehicle models are shown in Table 4. Table 4 shows that
scribe the vehicle, and the respondent’s observed choice 共real pur- the observed choice rate/market shares and the market shares as
chase兲. The customer choice is treated as a binary variable, and in predicted by the model match quite well. The MSគR2, i.e., R2
this particular case the customer selected vehicle 2. In total, the error measure of the observed market shares versus predicted mar-
database contains 30624 observations 共2552 respondents ket shares for this model is 0.996.
⫻ 12 vehicles兲. The correlation of a number of attributes of the As proposed earlier in Sec. 2.3, the Kano method is used to
collected data is presented in Table 3. further improve the predictive accuracy by identifying appropriate
The variables gender and USA/import of Table 3 are binary shapes for the customer utility function of the choice model 共Eq.
variables; that is, female= 1, and import= 1, otherwise 0. Some 共2兲兲. According to Kano study results at Ford, all customer prod-
conclusions can be deducted from Table 3. For instance, the nega- uct selection attributes should be considered as basic, except for
tive sign of the correlations related to gender for wheel base, fuel economy beyond 27.5 mpg which can be classified as exci-
vehicle width, and vehicle length indicate that women apparently tive. The econometric reasoning for this is as follows: fuel
buy smaller cars, and the negative coefficient 共−0.220兲 for USA/ economy is considered basic if the fuel mileage is near what is
import indicates that older consumers tend to prefer American expected for the vehicle’s class, in this case the midsize market
built cars. The negative coefficient for rebate and USA/Import segment. But, when the fuel mileage is significantly higher than
共−0.869兲 reveals that imports are generally sold with smaller re- its competitors, then it becomes a distinguishing feature, e.g., “I
bates. The correlation between customer background 共gender, age, bought this car because of its remarkable fuel economy.” We test
and income兲 and customer product selection attributes appears to
be very weak, which is desirable. Highly correlated variables are
prone to being collinear. Furthermore, high correlation between Table 4 Observed and estimated market shares for vehicle de-
the dependent variable 共in this case the vehicle choice兲 and inde- mand model
pendent explanatory variables 共i.e., attributes A兲 implies that few
variables are sufficient to predict vehicle choice, limiting the use Market shares
Choice
of many variables 共customer product selection attributes兲 desir- rate
able for engineering design decision making. Vehicle Id 共#兲 Observed Estimated
4.3 Vehicle Demand Modeling: Multinomial Logit. In this 1 251 0.098354 0.098814
case study, we use STATA 共www.stata.com兲 to estimate the choice 2 190 0.074451 0.074544
model. STATA employs a substitute for multinomial logit: 3 335 0.131270 0.130938
grouped logit. Grouped logit considers multinomial choice 共i.e., 4 220 0.086207 0.086117
5 231 0.090517 0.090972
one vehicle picked from the choice set兲 as a grouped set of binary 6 192 0.075235 0.075440
choices 共i.e., pick/not-pick; 0 or 1兲. Only one binary choice of a 7 199 0.077978 0.077447
group is allowed positive 共i.e., a pick兲. 8 167 0.065439 0.064866
A linear customer utility function shape is initially considered 9 67 0.026254 0.027256
10 435 0.170455 0.170324
for the utility function used in the logit choice model 共Eq. 共2兲兲. All 11 213 0.083464 0.083507
customers share the same utility function coefficients, i.e., market 12 52 0.020376 0.019776
segmentation is not considered. We tested over 200 customer util-
Table 8 Market share impact „% change…, profit „$ million…, and expected utility for case study
Design alternative
Vehicle
Id 1 2 3 4 5