Professional Documents
Culture Documents
Video Transcripts
Business Analytics P a g e 1 | 12
buying the product a false positive type of error. On the other hand, a customer that was
classified as a no target might have bought the product had she received the campaign a
false negative type of error. So, let's look at the following prediction model. Let's say we
target a 100 customers with our marketing campaign. 27 out of these 100 people
received the campaign and they actually buy the product. So that will be a true positive
because the prediction was actually good. At the same time, we have 14 people that
they received the campaign but did not buy the product. What we call the false
positives which occur at a rate of 20%.
We also have the true negative. Those are customers of the model correctly predicted that
they wouldn't buy the product. So, we didn't send them a marketing campaign. Lastly, we
have the False Negative. Three people that should how received our marketing campaign
because they would have bought the product but did not. We also know from our historical
data that about 30%. So, 30 out of a 100 customers buy our product and 70%. So, 70
customers do not buy our product. All this information we can get it from a predictive
analytic models a classifier either using logistic regression or machine learning as
you discussed with David let's add some cost and benefit numbers in this example. For
example, let's assume that we can sell our product for a $100 a unit. And our production
cost is $50 per unit. Let's also assume that the cost of the marketing campaign to reach a
customer is just a dollar per person. What would be our expected profit if we actually ran
this campaign and sell products. You can see that each true positive kind of customer will
result in a benefit of $49. A $100 from revenues minus $50 from our production cost minus
the $1 altogether $49. At the same time, we have loss because of the false positive those
customers that we put the effort to approach them and target them with our marketing
campaign, but they didn't respond.
This has a negative value of $1 the cost of our marketing campaign. Altogether. For those a
100 customers we can calculate the expected profit as follows. We can say that there's a
30% chance that you will be in essentially in the left-hand side. And in which case there is a
90% chance that you will actually pay the $49 or net value. Or you might be on the right-
hand side with a probability of 70%. And in this case, there is an additional probability
of 20% that we might end up losing a dollar. We will come back on how exactly we
derive this expected value calculation when we discuss about decision trees. But altogether
this example shows that from those 100 customers, we expect to make a net profit of
$13.1. And this is the value associated with this specific model. We can try out different
models. For example, different classifiers might reduce one type of error the false positive,
but they might create another one, the false negative. And we can find the optimal
balance of what is it exactly we are trying to optimize and whether we are happy to take the
risks of approaching more customers, but they may not respond to our campaign. Those are
the kinds of topics we will be discussing in the remaining of this module
Business Analytics P a g e 5 | 12
So, let's assume that we set our capacity the supply of the watches to a number slightly
above 250. Then we see that whenever the demand is above our capacity, we will have lost
sales customer show up to buy a product but unfortunately, we don't have enough to
provide them with. If, however decide to set our capacity at K, let's say 260. But the demand
turned out to be much lower something like just only 50 customers show up. We'll end up
with a lot of unsold items. So, as we increase our supply, we increase the cost due to the
unsold items. And at the same time, we decrease the cost of lost sales because it's much
less likely that we're gonna have lost sales. At the same time every time we reduce our k our
capacity, we decrease the cost due to the unsold items, but we increase the cost of lost
sales. How should we balance those things before we run a simulation that will account for
all the possible scenarios? We need to take a moment and again deep dive into our business
model. We need to understand what kind of constraints we have and how it's building block
of our business model interacts with the rest. So, for example what would determine the
number of actual sales? Again, as in the previous example it will depend both on the
demand the number of people showing up and our capacity. If we have demand that's
higher than our capacity, then the number of sales will be determined by our capacity. If on
the other hand the demand is lower than our capacity, then the number of actual sales will
be determined by our demand. We can model this using an if statement either in Excel or
any kind of other software or by using a command such as the minimum function in Excel. In
this model we have one more complication which is the number of items that they are
leftovers. Note here that we only have leftovers if our capacity exceeds our
demand. Otherwise this number is just 0 and there are no leftovers. This is another if
statement that we need to include in our business model try to set up a simple business
model using Excel or any other spreadsheet software and run a sensitivity analysis try to
see how your profit changes.
As your assumptions about the demand go up and down. Fix your capacity to 250 or 260
and play out with different demands. What do you observe? Once we have specified our
model the next step will be to simulate our profits for the entire range of values rather than
just doing it for one per one as you were doing before your sensitivity analysis. We can try
out different capacities. Each one corresponds to a different decision. For example. We
could decide to invest in a capacity of 240 we could decide to order 260 and so on. In the
following graph I have plotted the distributions five different level of capacity. You can see
here that again the output of a graph looks similar to the graph before precisely because in
this example. Just like in New Service example we have a capacity constraint. In this case
however it's our decision. How to move this capacity constraint and that's why for example
we see that the yellow line corresponds to a much higher order unit. We decide to have a
much higher capacity. And this has the upside of allowing us perhaps higher profit. At the
same time, it might bring more risk. We might end up with unsold items. If we try out
different values, we will figure out that the optimal order quantity in this example would be
close to 233. You can also ask the software to calculate this for you. This is the number
that maximizes your expected profit. This may or may not be the correct answer for your
type of problem. As we will discuss in our next session. The decision will critically lie only on
the level of risk. You're willing to take. For example, what would you do if you had to face
the same problem but with a much higher standard deviation? Do you think that you would
order more or less? In this case. Extreme demand outcomes affect you both ways right you
might end up with once more unsold items. or you might end up with lost sales. However,
having leftovers is relatively more expensive. And therefore, what we would expect to
Business Analytics P a g e 6 | 12
see. And that's something for you to try out. Is that as the uncertainty about our data
increases, we tend reduce fewer and fewer items because we're trying to avoid the specific
type of error which corresponds to having a lot of leftovers
Those are the inputs will provide to the software and together with that investment cause
the $60 million which we have to put down the moment we decide to launch. So, one step
before, it completes the inputs we provide to the software. The rest of the numbers are
calculations that that can be done for us. So, for example under the yellow circle you can
see that we can automatically see that the expected value would be 55.72. And because this
is less that the cost of investment the $60 million. The decision tree will recommend to us to
Business Analytics P a g e 7 | 12
not invest in this product. That's why you can see in the decision node. The "No" branch
is highlighted in bold which recommends the optimal action
Business Analytics P a g e 9 | 12
probabilities and also the associated payoffs with those scenarios. This will give you a much
better understanding about what should be your optimal bidding strategy.
Business Analytics P a g e 10 | 12
important factor. Determining the likelihood of winning the contract. What they found out
with a predictive model was that the type of client for example is if a client was just aiming
for an initiative that would reduce the cost versus a growth initiative was the single most
important factor. The second most important factor was the executive involved with the
specific contract. From their service provider's perspective there were certain people in the
company for which the clients were happy to pay much higher price. Lastly, as you can
imagine the prior relation with the client turn out to be one of the most important
factors. Again, ranking much higher than the price. With this tool the company could
estimate the exact probability of success for a given proposal taking into account not just
the price but also who would be the executives in these contracts. What type of client that
we're talking about and it could build a much more complex sophisticated and precise
decision tree? The next step was to optimize the price. What will be the price the bid price
that will maximize profits? Overall, contracts that were priced based on the software, so
double-digit increase in their win rates. The corresponding net profit lift from winning those
additional context was estimated in the range of tens of millions of dollars. Interestingly the
company was not willing to run a randomized controlled experiment to measure the value
of the software.
As they were too worried about losing the contracts that they wouldn't be using the
software. There are numerous other applications of decision tree. The more mathematical
term of this class of problem is referred to as dynamic programming. And it's called
dynamic for a reason. It basically takes into account all the future action that you might take
into the future that affect the value of an asset today. This is typical in the airline industry
for example if I sell an item today if I sell a specific seat for a flight than this item would not
be available tomorrow. And on the other hand, if I deserve it I might be able to get a
business customer who is willing to pay five times the price for this specific seat. Similarly,
dynamic pricing and revenue management techniques are being used in the hospitality
entertainment, retail industry, and so on. A specific prominent example that illustrates the
concepts we cover in this module comes from Zara. As we know Zara is one of the world's
most successful fashion retail brand. A lot of research has attributed a success of Zara. The
fact that they can dynamically use the latest information and adjust the inventory
decisions. accordingly. Zara keeps a close watch on how fashion is changing and evolving
every day across the world. Based on the latest styles and trends it creates, a new design
and puts them into stores in a week or two and start comparison. Most other fashion brands
would take close to six months to get all new designs and collection into the market. And
you can see here what allows Zara to do this is their flexibility in benefiting from the
information and adjusting their course of action, for example, their order quantity or
capacity decision to what customers really want. Rather than trying to predict. and second
guess what those demands would be.
------------------------------------------------------------End---------------------------------------------------------
Business Analytics P a g e 12 | 12