Problem Solving PME

15/11/2022, 14:21 New signup flow to encourage new users to add more profile information — Problem Solving Question
d more profile information — Problem Solving Question | PM Exercises
You launched a new signup flow to encourage new users to add more profile information. A/B test
results indicate that the % of people that added more information increased by 8%. However, 7 day
retention decreased by 2%. What do you do?
18.9k
Problem Solving
Asked at
Google
Facebook
views
Interview Guide
How to answer Problem Solving questions
Answers (20) Popular To answer this question, Log in.
moppy
Silver PM
S
M
Oct 24, 2018
Asking clarifying questions is critical to properly
answering this Google problem solving question:
1. What was the new sign up the flow and how is it
different than the old sign up flow. My assumption
is the new sign up flow asks for more user
information, thus the increase in the % of profile

Top Google interview
information.
questions
2. What was our goal? Was it to increase profile
information? What was the acceptable counter What is your favorite product?
Why? 69 answers | 190k views
metric decrease? Is the result within range?
How would you design a

List pros + cons of both metric
bicycle renting app for
1. Increase in profile information - the more data we tourists? 43 answers | 50.8k
have, the better our recommendation and views
personalization system and the network becomes

How would you improve
more valuable to the users. Cons, depending on the Google Maps? 38 answers |
types of information we ask and require of the user, 144k views
the user may have a different level of comfort and Show all questions
privacy concerns
2. Decrease in 7 day retention - if a user does not Top Problem Solving

come back in 7 days, this is not great for the interview questions
platform, however, I want to also consider whether

You are the PM for a streaming
14 day or monthly retention has decreased, perhaps
video service. You come into
the new user no longer needs to come back on 7th the office and see that one key
day and add a profile pic or other information. metric has dropped by 80%.
What will you do? 28 answers |
What would I do to validate my hypothesis 74.7k views
1. One hypothesis is 7th-day retention may decrease due

Drivers are dropping out of a
to the new user no longer come back to fill out city on Lyft. How do you figure
additional information, I would then compare 14 day and out what's going on? 15
answers | 10k views
30 day retention to see if it decreased.
Show all questions
L 23
V votes
S | 4 feedback
https://www.productmanagementexercises.com/696/encourage-information-information-increased-retention-decreased 1/20
15/11/2022, 14:21 New signup flow to encourage new users to add more profile information — Problem Solving Question | PM Exercises
Vote Give feedback
4 Feedbacks
Lui
PM
PM
L
Oct 26, 2018
I agree with the clarifying questions here, it is a
must before making assumptions. I also like the
structure and approach of the answer.
Merging both answers above would be ideal in a
way tho.
3 Vote Reply
viaro29
Silver PM
S
V
Mar 30, 2019
1. So far this the most logical answer here. I
would clarify that if there was a CRM campaign
in place to "bring back" users to add more profile
info earlier, is so, then the current drop in
retention is well justified. E.g. of profile pic above
is a good one...so it would have materialized like
me getting an *email* saying..."hey buddy good
job getting started on the profile and btw we
noticed you didn't upload a pic so when you get a
chance, do stop by and let us see your smiling
face"
Seeing such an email within first 7 days, is
definitely going to drive up 7 day retention
2. Another possibility could be having asked
additional information in the sign up flow which
"turns off" users from coming back. So for e.g. if I
get asked a question which goes like "hey you do
know that we can bring in all your contacts if you
want from facebook with the email address you
provided, should we? Y/N" Likely the result of this
question would be getting "additional
information" N as an answer which would turn off
folks who'd likely think this social network is
creepy as heck too.
2 Vote Reply
Show more feedback 2 of 4
rahul_g
P
Platinum PM
R
Nov 11, 2018
You launched a new signup flow to encourage new users
to add more profile information. A/B test results indicate
that % of people that add addtl. profile information
increased by 8%. However, 7 day retention decreased by
2%. What do you do?
Let's start from the WHY behind the change- likely that
you were implementing this change to improve
retention ; let's proceed with the assumption that this is
a social app where profiles play a critical role.
An increase of 8% for sign up flows is a significant
increase in number of people completing profile
information - I would ask how was this implemented
because from experience I know that every time we
add a step it introduces a 3-4% drop off.
My assumption here is that this is an added pop up
screen during sign up which is causing a drop off in total
number of users completing sign up successfully since
they drop off on the profile info screen.
*Interviewers nods yes*
Also I would recommend changing the way we measure
success of the A/B test , let me tell you why - consider
the following scenarios
In case A for every 100 people signing up 50 people
ended up signing up of which 20 completed profile
information
In case B ( winning variant ) for 100 people signing up 48
people ended up signing up of which 22 complete their
profile
So the blocking screen is causing an overall drop off
which reduces D7 while increase number of people
completing their profile
I would re-configure the experiment hypothesis to "
users with better profile information have higher
retention than users who don't - how can i increase in
the number of users filling their profile information on
D0 ( primary metric) while increasing/not affecting the
successful sign up rate ( secondary metric that doubles
up as a kill metric) "
if my goal is to increase profile information of new sign
up I would focus on passive methods ( push notif, in app
pop ups, incentives) POST users successfully signing up
so as to negate this drop off
if my larger business goal is to increase retention I would
reduce the steps of sign to increase successful signup
and focus on passive methods ( push notif, in app pop
ups, incentives) POST users successfully signing up so as
to increase total user successfully signing up and help
improve D7
19 votes | 1 feedback
Vote Give feedback
1 Feedback
Abhineet Rastogi
PM
PM
Jul 10, 2021
if the we are to say that the 7 day retention went
down by 2%m then in that case it is not because
the overall customers dropped from signing up.
The way to go about this would be to clarify what
are other information asked. If we are to assume
that the above numbers 8% and 2%, are related
to each other then the disconnect would be in
the content (content/ recommendations gets
powered by customer consumption and profiles).
plausible reason would be that the whole page is
confusing and the customers are randomly
putting values which is essentially not enriching
the profile of the customers but making them
even worse. Example to this can be that the page
is word heavy but requires customers to mark
only 2-3 fields (something like T&C which nobody
reads but everybody accepts)
or it can be because UI i confusing so the
customers are not able to provude right
details. example in an MCQ - a check button in
place of radio button.
4 Vote Reply
You might also be interested in these 151 questions
You're a PM at Amazon. You released a new feature in the

items search functionality recently and found out that
searches increased by 10% but the results page load time
is 2 seconds longer. What would you do? 12 answers |
27.2k views
There is a 15% drop in the open rate of Instagram App.

You are the PM. Tell us what could have happened. 8
answers | 5.4k views
There is a data point that indicates that there are more

Uber drop-offs at the airport than pick-ups from the
airport. Why is this the case and what would you do
within the product to change that? 6 answers | 15.1k
views

Check out questions Ask question
PM Team
P
Platinum PM
P
Mar 2, 2019
Hi,
First of all, I make to make certain assumptions or
inferences here:
1. The % users who filled addl information increased by
8% which means that providing additional information
was optional.
2. The overall decrease in retention includes people with
both the variations (control as well as variation version)
Now, I want to analyze further which user segment
retention rate is affected and would suggest strategy to
address the problem -
1. People who did not provide additional information
and bounced off Landing Page or in subsequent
usage -
I would verify these users retention rate between control
version and variation version. Ideally it should be
same. If it is not, then we should look at user profiles at
each variation to seek the differences.
2. People who provided additional information and then
bounced off Landing Page or in subsequent usage -
If retention number is lower here, then we need to focus
on providing relevant customized offerings basis
additional information and check retention rate in
subsequent 7-day period.
3. People who signed up but bounced off additional
information page and never made it to the landing page
-
If % of users is higher enough to reduce the
overall retention rate, then we should look at alternative
placement of additional information or content of
additional information (this can be gathered by
analyzing which page and field had the maximum
bounce-off rate). May be we can ask user to provide
information on 2nd or 3rd usage etc., as we must give a
chance to user to use our application before exiting it.
P 13
S votes | 2 feedback
Vote Give feedback
2 Feedbacks
PM Team
Platinum PM
P
P
Mar 2, 2019
I love how you broke it down to three user groups.
Nice work.
0 Vote Reply
Smak
PM
PM
S
Feb 27, 2022
I think your assumption that the overall decrease
in 7-day retention impacts both the control and
the test cohort is wrong. If that were the case, it
would be an unremarkable result. Would
0 Vote Reply
sushant-sikka
PM
PM
S
Oct 14, 2018
Assuming no other change was implemented that could
have affected these metrics, lets start by breaking down
the question. First piece of information is that additional
profile information increased by 8%, which is desirable.
We do not have information about what exactly we are
asking the user to provide, so lets assume that the
additional profile information consists of user's interests
and experiences. And second info we have is that 7 day
retention decreased by 2% because of this change.
The objective of getting more profile information from
the user is to find better content and connections
related to the user's interests and experiences. If we are
not able to use the additional user info to find more
relevant and engaging content for the user, then this
effort is a waste. So, our primary focus should be to
make the best use of this info to improve the experience
for the user. This would have an effect on the churn rate
too and generate positive word-of-mouth marketing for
the product.
Now lets try to understand the possible reasons for the
decrease in user retention. A thought that would come to
our mind is that probably we have made the process so
elaborate and complicated that user did not even
complete the process and chose to leave the app. But
since retention period metric tracks the user after they
have completed the signup process, we can rule out this
reason. We ought to be more specific about what kind of
information we are asking from the user. For privacy
reasons, many users will not be comfortable in sharing
more personal info. Make sure that users are satisfied
with your product's security and privacy policies and
convinced that they have full control over how your
product uses their data.
In summary, we need to do the following to improve
retention -
1. Create a more engaging experience for the user by
finding and displaying relevant content based on
user's interests.
2. Communicate your product's compliance and
privacy standards and make sure they trust you
with their data.
Vote Give feedback
pankajpm
Bronze PM
B
P
Feb 11, 2020
I would begin first with some clarifying questions for
understanding more of the 1. core business KPIs 2. the
A/B test goal and 3. the current phase of the Company
i.e. is user retention more valuable or revenue (from the
increased user info) at cost of lesser long term users
1. Question1 : What is the main business model of the
App? At a broad level is this a subscription based App or
Ad funded business?
2. Q2: Is there a LTV model built for the App which takes
into account 1. the value of increased user information 2.
7 day Retention
3. Q3 : What was the original goal /hypotheses of the
A/B test: Was it to increase the info per user and how
was that quantified in terms of business impact?
If an Ad funded business, increased user information
could result in increased CPC/CPMs and that needs to
be quantified and compared to reduction in engaged
users
Also if 7 day retention loss of 2% should be segmented
to see whether the users being lost are from valuable
segments? In the early phase of a Product that would be
a more important factor than any short term gains from
increased Ad revenue.
On the other hand if this is a mature Product and past
Product Market fit i.e. the users being retained are the
valuable ones, then the increased info for those users
would actually be more beneficial
Vote Give feedback
Eidan Apelbaum
Bronze PM
B
May 6, 2020
Statement
You launched a new web application signup flow to
encourage new users to add more profile information.
A/B test results indicate that the number of people that
added additional profile information increased by 8%.
However, 7-day retention decreased by 20%. What do
you do?
Clarify the problem
This is an existing product? Yes
The only change that was made to the app was the
registration form? Yes
The form is now longer? Lates more time to
complete ? Not Sure
Did you the overall % of users that completed to
form change ? You decide
Using A/B test increase in # users with more
information in profile
Drop in retention WoW
Objective indicators
1. This is not something that has accorded over time -
sudden
2. This is not limited to a specific region - country /
language / culture
3. Not limited to a specific platform - desktop, mobile
, tablet (IOS etc…)
4. This drop is not something that we have seen from
other cohorts (“older” registers are still churning
like before)
List of reasons
1. Seasonality
2. Alternative product
1. Competition
2. Other features in the same property
(cannibalism)
3. Other changes happened in the product
4. The registration form is encouraging some users to
add more information and thereby disencouraging
other users that do not want to supply this
additional information. The outcome is that you are
getting a different “mix” of users that are
registering and not necessarily the same types of
users that provide more information.
This would not have been a problem, unless the
outcome of higher churn. Which means that you
quality users were discouraged by the registration
process …..
Sort through the reasons
Reasons 1-3 are not very likely (or better said I do not
assume them to be applicable)
Reason 4 is what I think is the probable cause.
How would we test that?
A careful analysis of the data should answer the
question if the overall % of completes has increased or
decreased. If not then we need to rethink this list of
potential causes.
launch a form with with less mandatory fields and see if
you mix changes
Vote Give feedback
productmanager1644
Platinum PM
P
P
Feb 1, 2021
1. CLARIFY:
1. Are the users who are dropping off the same
users completing the additional information?
You choose.
2. Is there anything unique about the users
dropping off (ex. they're all on mobile devices,
same age range, etc.)? You choose.
3. Are there any other changes to the product
aside from the application flow? No.
4. Are there any changes to the way the metrics
were originally measured v. now? No.
5. Are all of these users - i.e. the people adding
more information and dropping off - fully
completing the application? You choose. In
this case, I assume that the people
abandoning the product have not completed
the application (i.e. creating an account and
then deleting it). (Interviewer could confirm if
such assumption is OK or if it should be a
factor to explore.)
2. AB TEST BACKGROUND: A product ran an AB test
that gave a Control group the application flow as
normal and the Experimental group an increased
number of questions that allowed the users to
provide more information. In the experimental
group, 8% of people added additional information,
but overall retention is down. (Interviewer confirms
description is correct.)
3. USERS : There are 4 main user groups to consider. I
am most interested in the Experimental Group that
leaves the product after 7 days.
1. Control :
1. Stays on Product after 7 days
2. Leaves Product after 7 days
2. Experimental :
1. Stays on Product after 7 days
2. Leaves Product after 7 days
4. HYPOTHESIS : Given that the Experimental group
experienced a longer application, my hypothesis is
that the longer application caused a drop in
retention rate. Users are abandoning the longer
applications / not finishing them because of its
extended length, although they are initially filling in
more information on the application than the
Control.
5. POSSIBLE REASONS FOR DROP IN RETENTION
RATE:
1. User Fatigue : User got tired of all the
applications and abandoned the application
after 7 dies (i.e. never logged back in to finish
it)
2. Data / Privacy Concerns : User became weary
of Product / wondered why they had to provide
so much information and abandoned
application to due privacy concerns.
3. Time : User felt they did not have enough time
to complete the application.
6. ACTION ITEMS : There are three action items we
could explore.
1. Trends Over Time : I'd like to continue
measuring the Control v. Experimental groups
over a longer time period to see if we see a
continued higher drop in retention rate in the
Experimental Group. I'd measure every 7 days
(7 days, 14 days, 21 days and 28 days).
2. Prospect Survey : I'd survey prospects of the
Product and ask them how willing would they
be to fill out a complete application with the
Control application # of questions v.
Experimental application # of questions and
ask them why they answered the way they did.
3. Drops Survey : I'd survey prospects who
dropped from the application and ask them
why they dropped. I'd be sure to classify them
as in the Control Group v. Experimental Group.
7. PRIORITIZING ACTION ITEMS:
Action Impact to
Cost
Item Hypothesis
1.
Low:
High: Allows for us
Analytics
Trends to measure
already
Over continued
seem to
Time behavior of people
be in
in experiment.
place.
Medium: Users
Low: Not
may not respond
costly but
as they would
may take
Prospect actually behave.
time to
Survey Does not directly
gather
target the people
sufficient
using the
responses.
application.
Low: Not
High: Would costly but
provide direct may take

Drops
insight into why time to
Survey
someone is gather
leaving. sufficient
responses.
8. SUMMARY: Given prioritization, I'd start by
measuring the Trends Over Time, as it is the easiest
to implement and will allow us direct insight into
the group behaviors. If possible, I'd also survey the
users who have dropped to confirm my hypothesis.
Vote Give feedback
Bobate
Gold PM
G
B
Feb 2, 2021
Assumptions:
1. A/B test was conducted on new signup
flow vs control (Existing flow)
2. new flow has additional steps where profile
information is collected
3. No specific target user groups - eg. Pages or
Businesses. The new flow is for regular users
4. Assume this signup flow is on FB/a social media
app
5. Assume there is nothing internal/external effecting
the metrics.
Clarifying questions
1. Were other metrics effected? Answer - sign ups
also went down .
Situation is - % of users that add more profile
information is up 8% = addntl #of users with more
info/total number of users. This number can go up as a
consequence of both factors - more people add info and
total people signing up went down .
As first step I would analyze which of these 2 factors has
caused the increase and identify the actual # of people
who added additional information.
7 day retention = % of new users who come back at or
after 7days has decreased by 2%. I'd then relate this to
drop in total sign ups to see if there is a correlation. I.e.,
if total sign ups also went down by 2% it means that
there is no difference in retention rate for users
onboarded in the new flow.
In this case, it looks like total sign ups have decreased
with no change in retention but a significant increase in
profile data collection.
Since this is FB, we can safely assume that there is a
large user base. At this stage, FB's key goal is
monetization. There are a lot of strong organic, network
effects that push people to sign up for FB. And given
that FB's revenue is generated by personalized ads,
richer profile data will definitely help FB personalize ads
with greater revenue potential. I'd imagine that the new
cohort of users have a higher LTV as their ads are better
personalized. While the drop is signups is concerning, I
dont believe it is an urgent problem to solve.
As a next step, I'd continue experimentation with this
hypothesis to esimate the potential revenue gain for
users with the new flow. Once have this calculated, I'd
offset this against the revenue loss of lower signups.
I'd explore other ways to get the churned users back to
sign up.
Vote Give feedback
vivek agarwal
PM
PM
May 10, 2022
First of all, I'll check if there's a correlation in the 7-day
retention drop and the new sign-up flow. To do that, I'll
check the 7-day retention for the new sign-up flow.
Assuming the drop is due to new sign-up flow,
Case 1:
I'll check if there is a drop in New Sign-up user due to
added steps in the journey. If that is the case, I'll review
if the drop justifies the objective of collecting additional
information.
If the drop is not justified, I'd explore to optimize the new
journey with a change in UX such that the information
can be collected post successful sign-up and re-run the
experiment till we find optimal balance in both the
metrics.
Case 2:
Sign-up rate remains same but users are uninstalling at a
later stage. In this case, I'll check if we're using the
additional information to target the users for sale of
product/services which is causing them to leave the
platform. If that is the case, I'll review if the drop
justifies the increase in the transactions. If yes, I'd
gradually roll-out the new sign-up flow to 100% user
base.
Vote Give feedback
Jay-Alice Suah
PM
PM
Oct 16, 2022
FIrst off, I would begin with clarifying questions:
1. What was the new sign up flow, and how does it
differ from the old sign up flow?
2. How is 7-day retention defined?
3. What does the user journey look like after the user
has completed the creation of their account? Are
there critical actions that the user has to take
within the 7-day period before the changes to the
sign up flow has been implemented?
4. What was the ultimate business goal we were trying
to move when we had implemented this A/B test?
Following which, I will proceed to list down
assumptions:
1. This is for a social app where profile information is
critical to building the right experience for the user
- be it, marketplace, social dating platforms
2. 7-day retention is defined from the moment that
the user has complete profile creation.
Approach:
My assumption for this question is that the user
activities that we prompt the user to engage in when
they have just created their user account are activities
that they do and has an impact on the 7-day retention
rate e.g. adding of profile pictures, adding of interests
However, with the new sign-up flow, users have the
option to add these information in the sign-up flow and
this inevitably led to the impact of the decrease in 7-day
retention rate.
To ensure that we are not over focused on one metric, I'd
recommend to look at 14-day and 30-day retention to
see if there is an impact on these numbers as well.
I would also a longer-term view and look at how long
does it take for the user to experience the product's
value proposition typically and understand if this group
of users are able to experience the product value prop
quicker (due to the streamlined sign up flow) and have a
better retention rate and affect the business bottomline
in a positive manner
Vote Give feedback
Anshuman Panwar
Bronze PM
B
Aug 29, 2022
Clarify:
Assume additional info required for FB sign up
Goal for new sign up: To increase richness of profile
which helps increasing engagement (# of
interactions with other users) and increase
personalization of content
As extra info was asked explicitly the % of people
adding more info went up
Goals:
The mission of FB is building stronger communities and
the reason we added a new flow was to collect more
information so as to facilitate meaningful interactions
and engagement with content.
The goals of the new feature align with the overall
mission
Metrics:
Lets think of some metric we might be trying to measure
during the experiment:
Goal Metric : % of new user adding extra information (It
increased which is a good thing)
Guardrail metrics:
Retention (weekly/monthly)
Daily time spent on FB for new users
# of content they interacted with
(like/comment/share)
# of posts they created weekly
# of friends added
Hypothesis:
Hypothesis 1: We are asking for information that users
perceive as private and hence they are conscious about
using the app after signing up.
To validate this hypothesis I will look at weekly and
monthly retention, if both are lower it signifies a drop in
users coming back to use the platform.
I will also look for other guardrail metrics like Daily time
spent, # of content interacted with, # of post created or
# of friends added. If these metrics also show a drop, it
confirms our hypothesis that users are perceiving the
new info as private and the platform as overall not safe.
In this case we need to dig deeper to see what extra info
we are asking for and if the benefits of having it
outweighs the cost. Can we also add a short note for the
users as to why we ask for this information or make it
optional?
Hypothesis 2: Users were previously notified to add
additional info so they were logging back within 7 days.
They aren’t notified in the new flow
To validate this I will check for monthly retention to see
if there is a drop in the long term. If our hypothesis is
true there should be no drop in monthly retention
Additionally I would check for other guardrail metrics, if
they remain the same then that confirms our hypothesis
The drop in retention is temporary in this case so we
don’t need to do anything
Vote Give feedback
Joe_riley
Platinum PM
P
J
Jul 29, 2022
Clarification
I think we need a better understanding of just what is
going on before we can answer this properly.
What were the changes we made to the sign up
flow? Are certain fields now required, or are the
input boxes placed more prominently?
What are we trying to accomplish by capturing
more information during the sign up flow?
Increased activation and retention as users have
more complete profiles to start with?
How are we measuring retention exactly? Is there
some usage threshold involved or is it simply
anyone with a single session?
Assuming the decrease in retention was only
observable in the group with the new sign up flow
changes.
Zoning in on the difference
Now that we understand the question properly, let's
continue to investigate further by looking at what we're
seeing by a few different angles:
How long have we been observing this increase in
information and decrease in engagement? Was this
a sudden observation or something we noticed
after looking at this over a long time span. While 2%
is pretty small, I'm going to assume it is statistically
signficant.
Are these observations uniform across geographies
or are there certain countries / cities where it is
more or less noticeable?
Is this uniform across all user segments and use
cases? Maybe a particular demographic is impacted
more or less?
Does this vary by platform, mobile vs desktop?
Impact
When we have a better understanding of what is
happening we can better measure the impact on our
product and it's goals.
One would assume that more engagement would
lead to more retention. Does a more complete user
profile actually lead to more engaged users? We
could look at the average time spent in the product
per week or average number of sessions or examine
specific actions.
If our assumption was that more complete
profiles leads to more engaged users we
should've confirmed that assumption with the
existing users before going down this route.
Is there anything characteristically different in the
users we are retaining that have added the
additional information? Maybe they are from a
particular high value user segment or engage with
the product more as discussed above. Quality over
quantity.
I don't know what the additional information we are
capturing is but we should examine how valuable
that information is to us. Could we use the new
profile pictures to aid our facial recognition
research? Could the demographic information
improve our ad targeting and corresponding CPM
rates?
Is weekly retention the appropriate time period for
us to be looking at? What does the increase or
decrease look like for monthly retention?
Next Steps
When we better understand the impact we can decide
next steps. We don't necessarily need to take a binary
approach of either keep this change or leave it, but
perhaps some happy more optimized medium is in order.
Can we use this additional information to increase
the level of personalization in the bridgebacks to
our product? "Hey Joe, check out these other users
also from the Bay Area!"
Did we have some sort of email campaign or
notification scheme that encouraged users to come
back and add more profile information? This may
have gotten turned off if users already filled out
their profile despite them still benefiting from a
CTA to come back to the product.
Vote Give feedback
MC0427
Bronze PM
B
M
May 15, 2022
Clarify scope:
What type of product are we referring to? Is it gmail? Or
youtube? Or google account?
Things to figure out..
1. Internally
1. Among the customers who are not coming
back in 7 days, how many were from the test
population?(we need to figure out if the
decrease in 7 day retention is related to the
A/B test or not)
2. Were all the onboarding emails working
properly? If we historically send users a
Welcome email after they sign up but that
email was not working properly, that could be
a factor in deceased 7 day retention
3. Did we remove any features recently? Were
any features that were part of the reason users
signed up got removed?
4. Has there been any outages during this
decrease period? Did anything happen to
result in poor customer experience and low
confidence in our product?
2. Externally
1. Time of the year? What time range was the 2%
decrease? Does historical data show similar
fluctuations? How does that compare to last
year’s data? Example, if we’re talking about a
product such as gmail, and 7 day retention is
decreasing for users who sign up right before
christmas break, the fluctuation could be
normal since users might be on holidays and
no one is checking their email.
2. Any new competitor releases that may have
impacted our retention rates?
3. Was there a specific segment of customers
that contributed more to the 2% decrease?Ex,
if we saw a 50% decrease among mobile users,
we should look into issues specific to Mobile.
Were the app stores working? Were customers
just unable to log into the app and therefore
retention decreased?
3. I will also work with stakeholder teams such as
customer support ,marketing, and CRM to identify
potential reasons. Were there increased customer
complaints about something? Did we pause any
marketing campaigns or CRM efforts?Among the
users who signed up, which campaigns did they
come from? Were customers coming in due to
incentives that we gave us and therefore we
attracting less quality customers who were never
going “stick” with us?
Vote Give feedback
Show more answers (7)
PREVIOUS
Welcome to PM Exercises...
NEXT
Improve Google Maps...
More product manager interview questions Show all questions
Calculate the number of queries answered by Google per

second.
Asked at Google
Estimation 33 answers / 46k views K
Build a product to buy and sell antiques.
Asked at Google , Facebook
Product Design 34 answers / A

33.7k views
How would you improve YouTube?
Asked at Google , Flipkart & 4 other companies
Product Improvement 16 answers / S K S

47k views
Companies
Google Product Manager Interview Questions Facebook Product Manager Interview Questions
Amazon Product Manager Interview Questions Microsoft Product Manager Interview Questions
Uber Product Manager Interview Questions Lyft Product Manager Interview Questions
Show More
Interview Questions
Product Management Product Design Interview Questions Product Management Product Strategy Interview
Questions
Product Management Product Improvement Interview Product Management Estimation Interview Questions
Questions
Product Management Behavioral Interview Questions Product Management Metrics Interview Questions
Show More
hello@productmanagementexercises.com
Terms & Conditions
Privacy Policy
Cookies
Copyright © 2021 PM Exercises

Problem Solving PME

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Problem Solving PME

Uploaded by

Copyright:

Available Formats

15/11/2022, 14:21 New signup flow to encourage new users to add more profile information — Problem Solving Question

d more profile information — Problem Solving Question | PM Exercises

How to answer Problem Solving questions

Answers (20) Popular To answer this question, Log in.

Asking clarifying questions is critical to properly

answering this Google problem solving question:

1. What was the new sign up the flow and how is it

different than the old sign up flow. My assumption

is the new sign up flow asks for more user

information, thus the increase in the % of profile

How would you design a

personalization system and the network becomes

types of information we ask and require of the user, 144k views

2. Decrease in 7 day retention - if a user does not Top Problem Solving

platform, however, I want to also consider whether

What would I do to validate my hypothesis 74.7k views

1. One hypothesis is 7th-day retention may decrease due

Show all questions

Vote Give feedback

I agree with the clarifying questions here, it is a

must before making assumptions. I also like the

structure and approach of the answer.

Merging both answers above would be ideal in a

1. So far this the most logical answer here. I

would clarify that if there was a CRM campaign

in place to "bring back" users to add more profile

info earlier, is so, then the current drop in

retention is well justified. E.g. of profile pic above

is a good one...so it would have materialized like

me getting an *email* saying..."hey buddy good

job getting started on the profile and btw we

noticed you didn't upload a pic so when you get a

chance, do stop by and let us see your smiling

Seeing such an email within first 7 days, is

definitely going to drive up 7 day retention

2. Another possibility could be having asked

additional information in the sign up flow which

"turns off" users from coming back. So for e.g. if I

get asked a question which goes like "hey you do

know that we can bring in all your contacts if you

want from facebook with the email address you

provided, should we? Y/N" Likely the result of this

question would be getting "additional

information" N as an answer which would turn off

folks who'd likely think this social network is

creepy as heck too.

Show more feedback 2 of 4

You launched a new signup flow to encourage new users

to add more profile information. A/B test results indicate

that % of people that add addtl. profile information

increased by 8%. However, 7 day retention decreased by

2%. What do you do?

you were implementing this change to improve

retention ; let's proceed with the assumption that this is

a social app where profiles play a critical role.

An increase of 8% for sign up flows is a significant

increase in number of people completing profile

information - I would ask how was this implemented

because from experience I know that every time we

add a step it introduces a 3-4% drop off.

My assumption here is that this is an added pop up

screen during sign up which is causing a drop off in total

number of users completing sign up successfully since

me getting an email saying..."hey buddy good

Interviewers nods yes