You are a Growth Marketing Analyst at FB and  you have been tasked to identify reasons as to why users signing up from a country are not returning to FB after 30 days.

What will be your hypothesis? 

What data/metrics will you look at prove or disapprove each of the hypothesis

How will you prioritize your problem to solve?

How will you measure success of your change?

asked in Problem Solving by (14 points) | 1.3k views

2 Answers

+1 like

Clarifying questions

  1. is this a new country for FB?
  2. if not, has this started happening recently? how long has it been happening?

Assumption: FB has been in this country for a long time. This started happening recently 3-4 months

[repeat question now] Ok, so the change is recent and the new users who are signing up are not returning after 30 days

Let me think about what a new user needs on FB
- New user is looking to socialize with their friends and engage with meaningful content on the platform

>> Hypothesis #1: they may not be finding enough friends to connect and thus the platform may not be engaging to them

>> Hypothesis #2: New user is looking for content to engage with and there not finding enough engaging content

Data that I will look for: 

  1. # of connections made per new user per month in that country: 
    1. I will compare it within the country before this drop started occuring and also to other similar countries 
    2. I will also look at % of times People You may know (PYMK) feature was shown to the user in their newsfeed and % of connections user made from the feature. This will help me verify if FB showed enough friends and whther the firends were relevant or not. Based on % times this feature was shown, I can devise an A/B test to show this feature more and validate further if it helps improve 
  2. % of non-friend content shown to new user in the newsfeed:
    1. I will again compare it within the country before this drop started occuring and also to other similar countries 
    2. I will like to conduct an A/B test by showing relevant pages or groups to them in the newsfeed (based on their demographic, FB can gues their interest; since they are new users FB may not have enough info about their interests) and by showing the pages, we can guide them to find new content. We see if the test group stays with FB compared to control to validate the hypothesis. 

I will measure the success of the tests in terms of improvement in 30 day retention. Since this is metric we were concerend about, we will measure the improvement in the metric

answered by (15 points)

Understand the bell curve for product growth.

Whether the product is in initial, growth, saturation, stagnation(decline) phase in that country.

Assumption #1: Assuming the product is in growth phase.

Analyse whether the user is signing up for facebook or for using some other applicatons (using sign up with facebook).

Assumption #2: Assuming the user is using facebook app.

Analyse which of the user engagement metrics is declining : fb chat, fb groups, fb pages, user posts or quiz/fb apps based posts.

 Analyse the last activity that the user spends time upon before leaving the page.

Solving the problem:

  1. If the fb posts feature is getting less engaging: Engage the users more by showing the posts by dividing into several groups and applying A/B tests: Posts by direct friends, posts by mutual friends, trending posts etc.
  2. If fb pages or fb groups are getting less engaging: Encourage more group posts in the main feed of the users who're the top commentors/ medium commentors/ less commentors.
  3. If quiz/ fb-app posts are less engaging : Suggest(Incentivise) the app developers to create more new /innovative/ trending apps.

Measuring the Success:

Analyse the results of the hypothesis over a month and apply the appropriate changes over the next months and observe the user engagement/ the rate of users coming back within 30 days. 

answered by (36 points)

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
Anti-spam verification:
To avoid this verification in future, please log in or register.

Post a question

About this site

Product Management Exercises is the best place to get help preparing for product manager interview questions. Any member of Product Management Exercises can post product manager interview questions, submit answers to the questions, and give feedback to other members' answers.

Follow PM Exercises

Report bug

Privacy - Cookies - Terms - Contact - Twitter - Facebook - Slack - RSS