Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Buy Now $15.99
Standard view
Full view
of .
Save to My Library
Look up keyword or section
Like this
7Activity

Table Of Contents

Two Characters: Exploration and Exploitation
The Scientist and the Businessman
Cynthia the Scientist
Bob the Businessman
Oscar the Operations Researcher
The Explore-Exploit Dilemma
The Business Scientist: Web-Scale A/B Testing
The epsilon-Greedy Algorithm
Introducing the epsilon-Greedy Algorithm
Describing Our Logo-Choosing Problem Abstractly
What’s an Arm?
What’s a Reward?
What’s a Bandit Problem?
Implementing the epsilon-Greedy Algorithm
Thinking Critically about the epsilon-Greedy Algorithm
Debugging Bandit Algorithms
Monte Carlo Simulations Are Like Unit Tests for Bandit Algorithms
Simulating the Arms of a Bandit Problem
Analyzing Results from a Monte Carlo Study
Approach 1: Track the Probability of Choosing the Best Arm
Approach 2: Track the Average Reward at Each Point in Time
Approach 3: Track the Cumulative Reward at Each Point in Time
Exercises
The Softmax Algorithm
Introducing the Softmax Algorithm
Implementing the Softmax Algorithm
Measuring the Performance of the Softmax Algorithm
The Annealing Softmax Algorithm
UCB – The Upper Confidence Bound Algorithm
Introducing the UCB Algorithm
Implementing UCB
Comparing Bandit Algorithms Side-by-Side
Bandits in the Real World: Complexity and Complications
A/A Testing
Running Concurrent Experiments
Continuous Experimentation vs. Periodic Testing
Bad Metrics of Success
Scaling Problems with Good Metrics of Success
Intelligent Initialization of Values
Running Better Simulations
Moving Worlds
Correlated Bandits
Contextual Bandits
Implementing Bandit Algorithms at Scale
A Taxonomy of Bandit Algorithms
Learning More and Other Topics
P. 1
Bandit Algorithms for Website Optimization

Bandit Algorithms for Website Optimization

Ratings:

5.0

(1)
|Views: 1,619|Likes:

When looking for ways to improve your website, how do you decide which changes to make? And which changes to keep? This concise book shows you how to use Multiarmed Bandit algorithms to measure the real-world value of any modifications you make to your site. Author John Myles White shows you how this powerful class of algorithms can help you boost website traffic, convert visitors to customers, and increase many other measures of success.

This is the first developer-focused book on bandit algorithms, which were previously described only in research papers. You’ll quickly learn the benefits of several simple algorithms—including the epsilon-Greedy, Softmax, and Upper Confidence Bound (UCB) algorithms—by working through code examples written in Python, which you can easily adapt for deployment on your own website.

Learn the basics of A/B testing—and recognize when it’s better to use bandit algorithms Develop a unit testing framework for debugging bandit algorithms Get additional code examples written in Julia, Ruby, and JavaScript with supplemental online materials

When looking for ways to improve your website, how do you decide which changes to make? And which changes to keep? This concise book shows you how to use Multiarmed Bandit algorithms to measure the real-world value of any modifications you make to your site. Author John Myles White shows you how this powerful class of algorithms can help you boost website traffic, convert visitors to customers, and increase many other measures of success.

This is the first developer-focused book on bandit algorithms, which were previously described only in research papers. You’ll quickly learn the benefits of several simple algorithms—including the epsilon-Greedy, Softmax, and Upper Confidence Bound (UCB) algorithms—by working through code examples written in Python, which you can easily adapt for deployment on your own website.

Learn the basics of A/B testing—and recognize when it’s better to use bandit algorithms Develop a unit testing framework for debugging bandit algorithms Get additional code examples written in Julia, Ruby, and JavaScript with supplemental online materials

More info:

Categories:Books, Computers
Publish date: Dec 10, 2012
Added to Scribd: Dec 11, 2012
Copyright:Traditional Copyright: All rights reservedISBN:9781449341596
List Price: $15.99 Buy Now

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
See more
See less

06/12/2014

87

9781449341596

$15.99

USD

pdf

You're Reading a Free Preview
Pages 4 to 9 are not shown in this preview.
You're Reading a Free Preview
Pages 13 to 18 are not shown in this preview.
You're Reading a Free Preview
Pages 22 to 62 are not shown in this preview.
You're Reading a Free Preview
Pages 66 to 80 are not shown in this preview.
You're Reading a Free Preview
Pages 84 to 87 are not shown in this preview.

Activity (7)

You've already reviewed this. Edit your review.
1 thousand reads
1 hundred reads
kaosad liked this
Valentina Ionela liked this
newtonapple liked this
Robben Mu liked this
foliox liked this

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->