Professional Documents
Culture Documents
Section 4 New Product Development
Section 4 New Product Development
management 101
Section 4: New product
development
© Todd Birzer
We will talk about…
• Importance of prioritization
• 4 prioritization techniques
spanning the long-term (big
picture) to the near term (fine
details)
• Roadmapping
• OKRs
• Development buckets
• Prioritized backlog
© Todd Birzer Photo by airfocus on Unsplash
Your development team
will never, ever, ever be
big enough
Epics
User stories
Near-term
The fine details
© Todd Birzer
Guided by our product vision,
objectives, and strategy
The big picture
Long-term Roadmaps
Objectives and key
results (OKRs)
Development
buckets
Prioritized
backlog
Near-term
The fine details
© Todd Birzer
Vision
Every birdwatcher has unique knowledge and
experience. At eBird, our goal is to…
Long-term Roadmaps
Objectives and key
results (OKRs)
Development
buckets
Prioritized
backlog
Near-term
The fine details
© Todd Birzer
What are roadmaps?
• Time-based charts showing the planned
evolution of a product or service
Why do roadmaps?
• Visual tool to share with full development
team, managers, executive leadership
• Helps prioritize technology investments,
highlight schedule tradeoffs, and focus
development teams
© Todd Birzer
Some dangers with roadmaps
• Can be too detailed and prescriptive
– No room for discovery
– Can focus on “output” rather than
“outcome”
• Timelines are usually too optimistic
• Executives latch on to roadmaps as
commitments
• Sales teams may share early roadmaps with
clients
© Todd Birzer
Product area 3
Product area 2
Product area 1
Time
1-3 years
Linked to your
© Todd Birzer strategy horizon
1H 2022 2H 2022 2023
Data tools
Data
CSV data exports visualization
tools
Birdsong
Mobile apps
Products
recording tools
Computer vision /
Field ID tools AI-driven photo ID
(prototype)
Butterflies
(prototype)
Web
Rare bird alerts
Profile
enhancements
© Todd Birzer
Market &
application
Products &
services
Technology &
platform
Time
© Todd Birzer
1H 2022 2H 2022 2023
Markets
1st time
birdwatchers
Products/services
Field ID tool Photo ID tool
Technology platform
Field Computer vision /
identification AI-driven photo ID
engine (prototype)
© Todd Birzer
Enhancement 1 Enhancement 4 Enhancement 6
Enhancement 2 Enhancement 5 Enhancement 7
Enhancement 3 Enhancement 8
Enhancement 9
Product enhancements
tools
Profile enhancements Butterflies
(prototype)
Birdsong recording
tools
© Todd Birzer
Using Aha!
© Todd Birzer
Using
ProductPlan
© Todd Birzer
Using Roadmunk
© Todd Birzer
Using ProdPad
© Todd Birzer
Using Jira
© Todd Birzer
Roadmap process
5. Update quarterly
© Todd Birzer
Next on the
Guided by our product vision,
playlist
objectives, and strategy
The big picture
Long-term Roadmaps
Objectives and key
results (OKRs)
Development
buckets
Prioritized
backlog
Near-term
The fine details
© Todd Birzer
OKRs • Product vision, objectives, and strategy set a
1-3 year product path
– With roadmaps illustrating your product
evolution
© Todd Birzer
OKRs
OKRs
• Objectives: our business goals
• Key results: measurable outcomes
(used later to grade achievement)
© Todd Birzer
OKRs for Q3 Score
Objective 1: Increase the number of new active users
>80% of first-time users submit a second bird
Key results
checklist
5 users successfully use an AI-driven photo
identification prototype
Objective 2: Increase the usage of eBird’s data by university
researchers
results
>1000 CSV data downloads
Key
>30 academic articles published
Objective 3: Expand user base in countries with high bird
diversity but low eBird usage (target: Peru, Ecuador, Brazil)
Launch Spanish and Portuguese versions of
Key results
Android/iOS apps
>100 “friend” referrals in target countries
© Todd Birzer
OKRs for Q3 Score
Objective 1: Increase the number of new active users
>80% of first-time users submit a second 1.0
Key results
bird checklist
5 users successfully use an AI-driven photo 0.4
identification prototype
© Todd Birzer
OKR tools
Workboard (workboard.com)
Jira (atlassian.com)
Gtmhub (gtmhub.com)
Perdoo (perdoo.com)
Weekdone (weekdone.com)
Koan (koan.co)
Plai (plai.team)
Others…
© Todd Birzer
OKR process
Development
buckets
We’re Prioritized
here backlog
Near-term
The fine details
© Todd Birzer
Development
buckets
© Todd Birzer
Development Big Near- Support Tech-
Development categories>> impact term & bug nical
buckets items client fixes debt
1 enhance-
ment
requests
© Todd Birzer
Development Big Near- Support Tech-
Development categories>> impact term & bug nical
buckets items client fixes debt
1 enhance-
ment Row 2: prioritize
requests between
columns
Percent of 60% 15% 10% 15%
development
2 time >>
© Todd Birzer
Develop- Big Client Support & Technical
1 ment impact enhance- bug fixes debt
categories> items ment
requests
Percent of 60% 15% 10% 15%
2 dev time >>
Items AI-driven Add data Map color Restructure
photo ID category error photo
prototype for Stanford (profile database
page)
3 Data Country Reduce
visualization population Hotspot time for
tools tracking for location video
EU bug upload
Rare bird
alerts Graphic Regional
issue with cloud
Profile page Chinese hosting
upgrade fonts
© Todd Birzer
Guided by our product vision,
objectives, and strategy
The big picture
Long-term Roadmaps
Objectives and key
results (OKRs)
Development
buckets
We’re Prioritized
here backlog
Near-term
The fine details
© Todd Birzer
One end-result of our prioritization work is
a prioritized backlog
© Todd Birzer
Develop- Big Client Support & Technical
1 ment impact enhance- bug fixes debt
categories> items ment
requests
Percent of 60% 15% 10% 15%
2 dev time >>
Items AI-driven Add data Map color Restructure
photo ID category error photo
prototype for Stanford (profile database
page)
3 Data Country Reduce
visualization population How Hotspot
do we time for
tools tracking for location video
EU prioritize
bug this upload
Rare bird list?
alerts Graphic Regional
issue with cloud
Profile page Chinese hosting
upgrade fonts
© Todd Birzer
To get to a prioritized backlog, a value
effort matrix helps
• Product enhancements
• Sprint priorities (epics, user stories)
© Todd Birzer
☺
High
Value
Low
High Effort Low ☺
© Todd Birzer
Value in helping you meet your
longer-term product
objectives and quarterly OKRs
☺
High
Customer and business value
• Net promoter score
• Revenue/profit growth
• New customer acquisition
Value and renewal rates
• Competitive differentiation
and market share
• Strategic fit
Low
High Effort Low ☺
© Todd Birzer
☺
High Effort means cost to the business
• Development time
• Monetary costs/investment
• Ongoing operational costs
Value
• Level of risk
Low
High Effort Low ☺
© Todd Birzer
☺ Opportunity
G Priority 1
High
Opportunity
Priority 2 R Opportunity
C
Opportunity
Value Priority 3 P
(or don’t do) Opportunity
X
Opportunity
E
Low Opportunity
W
High Effort Low ☺
© Todd Birzer
AI driven
☺ photo ID Priority 1
High
Data
visualization
tools Refer a
Priority 2 friend
Butterflies Spanish/Port
Value Priority 3 prototype localization
(or don’t do)
Birdsong Profile page
recording update
Rare bird
tools alerts
Low
High Effort Low ☺
© Todd Birzer
Value effort matrix can also be quantitative
• ProductPlan example above
© Todd Birzer
Value effort matrix is a lean
technique to help us get to a
prioritized backlog
© Todd Birzer
We talked about…
✓ Importance of prioritization
✓ 4 prioritization techniques
spanning the long-term (big
picture) to the near-term (fine
details)
✓ Roadmapping
✓ OKRs
✓ Development buckets
✓ Prioritized backlog
© Todd Birzer Photo by airfocus on Unsplash
Product management 101
Discovery & delivery
© Todd Birzer
The work of product
management
© Todd Birzer
We will talk about…
• Discovery and delivery
• Stage-gates
• Product concept testing
• Product analytics
• New flavors of product
management
© Todd Birzer Photo by airfocus on Unsplash
If we want innovation…
Foundation of a
“discovery & delivery”
process
© Todd Birzer
Deep customer
High
Optimization
understanding Continuous
What is? refinement
Delivery
Market fit
Incremental
market
releases
Discovery
Experimentation
& prototyping
Uncertain
Ideas What works?
What if? What wows?
Rough Refined
Product readiness
© Todd Birzer
• Who leads discovery & delivery?
– Magic in a three-person team
• Engineering lead
• User experience (UX) lead
• Product manager
– Collaboration and teamwork
© Todd Birzer
Ideas
What if?
© Todd Birzer
Discovery
What works? What wows?
• Goal:
– Quickly and inexpensively vet ideas
with customers
– Evolve these ideas to find product-
market fit
© Todd Birzer
During discovery, we trying to validate…
© Todd Birzer
Delivery
© Todd Birzer
Optimization
© Todd Birzer
Deep customer
High
Optimization
understanding Continuous
What is? refinement
Delivery
Market fit
Incremental
market
releases
Discovery
Experimentation
& prototyping
Uncertain
Ideas What works?
What if? What wows?
Rough Refined
Product readiness
© Todd Birzer
Deep customer
High
Optimi-
understanding zation
What is?
Market fit
Delivery
Uncertain
Discovery
Ideas
Rough Refined
Product readiness
© Todd Birzer
Deep customer
High
Non-linear, Optimi-
understanding zation
iterative process
What is?
Market fit
Delivery
Uncertain
Discovery
Ideas
Rough Refined
Product readiness
© Todd Birzer
Stage-gates
Business Develop-
Scoping 1 2 3 Testing 4 Launch
case ment
© Todd Birzer
Not every product team can move
from stage-gates to discovery &
delivery
© Todd Birzer
• A key part of an effective discovery & delivery
process is testing product concepts
– Constraints:
• We have limited engineering resources
• We want to move fast
High
Discovery & delivery Final
product
Alpha/beta
Quality of feedback
software &
prototype
samples
Clickable
prototypes &
3D models
Video
Moderate
Printouts Be creative with your
product! This is not
an exhaustive list
© Todd Birzer
Deep customer
High
Optimization
understanding Continuous
What is? refinement
Delivery
Market fit
Incremental
market
releases
Discovery
Experimentation
& prototyping
Uncertain
Ideas What works?
What if? What wows?
Rough Refined
Product readiness
© Todd Birzer
Final
product
Deep customer
High
Optimization
understanding Alpha/beta Continuous
What is? software & refinement
prototype
samples Delivery
Market fit
Incremental
Clickable market
prototypes & releases
3D models
Video
Discovery
Printouts Experimentation
& prototyping
Uncertain
Ideas What works?
What if? What wows?
Rough Refined
Product readiness
© Todd Birzer
Printout: good sample Simple
Software / services graphics to
illustrate the
concept
Language
is easy to
understand Concept P
• On your mobile phone, an option to set
playback at….
Objectively • Slower than normal
true • Faster than normal
details with
no selling • Sound will be automatically adjusted to
reflect normal human voice pitch
© Todd Birzer
1 2
Refine Refine
concept concept
3 4 5
Incremental
Refine Refine release
concept
Refine Refine
concept concept
3 4 5
Refine Refine
concept Incremental
release
© Todd Birzer
Test your product concepts!
• Grounds your product development in
reality
– What works? What wows?
– Attitude of humility
• Reduces the risk of failed launches
• Uncovers innovation
High
Optimization
understanding
powerful tools to optimize Continuous
What is? refinement
our products
Delivery
Market fit
Incremental
market
releases
Discovery
Experimentation
& prototyping
Uncertain
Ideas What works?
What if? What wows?
Rough Refined
Product readiness
© Todd Birzer
Product analytics give us data on
how customers engage with our
products or services
• Software
• Hardware with IOT
© Todd Birzer
Let’s assume you are a product manager at Envoy
– a San Francisco-based startup that helps
workplaces run smoothly and safely. Envoy has
products for visitor management, meeting rooms,
deliveries, etc.
© Todd Birzer
How many users on my platform?
– Daily active users
– Monthly active users
– Focus on a “value moment”
© Todd Birzer
How many users by geography?
© Todd Birzer
Do users stay with us or drop off over
time?
• Stickiness
© Todd Birzer
What features are being used the
most?
© Todd Birzer
What path are people
taking to key actions? Not real data
© Todd Birzer
What is our conversion funnel?
• To completion of onboarding
• To product value
• To money
© Todd Birzer
5 recommendations for product analytics…
© Todd Birzer
Product
analytics
tools
Others…
© Todd Birzer
Product analytics with hardware…
• Not as easy as software, but extremely helpful if
you have IOT modules
For you…
• Product usage hours per day,
location, on/off cycles,
maintenance issues, spare parts
alerts, replacement timing
© Todd Birzer
Product experimentation
© Todd Birzer
© Todd Birzer
Product experimentation
From customer
interviews and Not real data
usability tests…
Some office
managersBased
get on observation
stuck on setting
We expect that adding a 3-step guidance
desk
for “setting desk configuration” will
configuration
increase conversion after sign-up +2%
© Todd Birzer(from 40% to 42%) Not real data
Product experimentation
Could we
Not real dataincrease
these numbers?
Run experiment
© Todd Birzer
Product experimentation
Tougher to do Easier to do
© Todd Birzer
Product
analytics
tools
Experimentation
tools
Others…
© Todd Birzer
Product management has become leaner,
faster, and more experimental
Powered by…
• Deep customer insight (what is)
• “What if” innovation ideas
• Discovery and concept testing (what
works, what wows)
• Incremental delivery
• Product analytics
© Todd Birzer
We talked about…
✓ Discovery and delivery
✓ Stage-gates
✓ Product concept testing
✓ Product analytics
✓ New flavors of product
management
© Todd Birzer Photo by airfocus on Unsplash
Product management 101
Launch
© Todd Birzer
Sales
Time
2 Supporting launch
New features, product enhancements, line extensions
3 Maintenance launch
Bug fixes, quality improvements, cost-reductions
© Todd Birzer
Launch deliverables 1
By launch priority Item 3 2
Launch plan u
Planning
Budget management u
social media
Marketing
Advanced marcom: launch videos, whitepapers, u
launch events
Press & key opinion leader outreach / press release u
teams
management
Communication to clients (existing + trial) u u
© Todd Birzer
With a study of 2000 people in 11
countries, Steelcase used their
deep understanding of the new
ways people are sitting to design
the Gesture chair
© Todd Birzer
New product launch
© Todd Birzer
New product launch
Example: Steelcase Gesture chairs
© Todd Birzer
Impactful launches drive earlier
and higher sales