Exercise 74 – If you were the PM for the Save Feature at Facebook, what metrics would you use to define the success of this feature?

Post and review answers and feedback to answers in the comments section of this post.

See also:

How to answer a metrics question in a product manager job interview

List of metrics questions for product manager job interviews.

Leave a Reply

avatar
  Subscribe  
newest oldest most voted
Notify of
RE
Guest

To my understanding, the way the Save feature works is – It let’s me save posts I want so I can view them later under my “Saved” label to the left of the Facebook News Feed.

I would track the following metrics to define success:
– Total saved posts per day
– Average/Median saved posts per user
– Number of saved posts revisited per day/week/month
– Number of webpage views for the “Saved” feature (and number of DAUs who also visited the saved webpage)
– Number of unsaved posts (the act of going to the saved webpage and clicking “unsave” to remove from the post from the list)
– I would also look at different posts to understand what users save overtime, do they save posts with/without videos? just regular posts? recommendation posts? posts with picture?
– amount of time spent on the saved webpage
– lastly, we can track the retention of the feature. The only tricky part here is to define what’s good retention. Unlike retention for the FB app (D1, D7, D14 etc…) as users who save posts might return to them even after a few weeks and that’s not necessarily a bad thing. Once we have a good benchmark of how retention for this feature would look like, we can align it to all players to help define its success

NabsPM
Guest

You might want to look at the scroll length. Do people scroll more per session because they are saving links that are hard to consume right away? Has time spent overall increased or decreased? What is the impact to videos watched? Because people are now saving – has the time spent watching videos and # of videos watched gone down? Are people saving and not coming back to view these videos?
Save also lets Facebook get more signals about what a user is interested in. So is the feed relevancy improving overall for users with more saves vs less saves? Has overall engagement with newsfeed gone up – more posts viewed, more active time spent, longer scroll length?

roy
Guest

Think there r about 5 categories of metrics to look at for most feature rollouts:
1) who is using it – persona / segment / type (novice, proficient, expert)
2) when – what do they do immediately before / after, etc.
3) usage – number of times in a session / week, duration between 1st-2nd, 2nd-3rd usages, etc.
4) impact – aarrr (short-term & long-term), funnel, etc.
5) cannibalization – did usage of some other feature decrease

Bijan
Guest

Hi Roy
Thank you for submitting your answer. I Th ibk your answer is too short and needs to be more detailed. Have a look at the article I wrote about answering Metrics questions. https://productmanagementexercises.com/how-to-answer-a-metrics-question-in-a-product-manager-job-interview/
Good luck!

anonymous
Guest

primary:
– # unique users that clicked ‘Save’ on post
– # unique users that clicked the “Saved” section
– # unique users that re-opened at least one saved post
– # items “saved”
– # times “Saved” section got clicked
– # times saved item re-opened

secondary:
– Overall DAU, WAU, MAU
– Stickiness (DAU/MAU)
– Average Mins per user spent on facebook before and after (platform, watching videos..)
– Monthly revenue from ads

Bijan
Guest

Hi there
Thank you for submitting your answer. I Th ibk your answer is too short and needs to be more detailed. Have a look at the article I wrote about answering Metrics questions. https://productmanagementexercises.com/how-to-answer-a-metrics-question-in-a-product-manager-job-interview/
Good luck!