Exercise 42 – How would you measure the success of Google Hangout?

Post and review answers and feedback to answers in the comments section of this post.

See also:

How to answer a metrics question in a product manager job interview

List of metrics questions for product manager job interviews

Leave a Reply

avatar
  Subscribe  
newest oldest most voted
Notify of
Brian
Guest

First, I would confirm if my understanding of the goal of the product is correct. Google Hangout aims to make it easy for people to have video calls with each other. I would also ask clarifying questions regarding what ‘success’ means in the eyes of the interviewer. For the purpose of this interview, I’m going to assume that we are going to define success around engagement. If the engagement is high (we will define metrics to measure engagement), Google Hangout is successful. If it’s low, it’s not successful.

Here is how I think Google Hangout works:

– User visits a chat page (group or with just another person)
– User clicks on “join call” to start the conversation
– Once call is finished, user hangs up by either leaving the room or hanging up

Note that Google Hangout has other functionalities such as ability to chat but given that the most popular and well known feature of Google Hangout is video call, I’m going to focus on measuring engagement of Google Hangout by focusing on video calls.

Here are a few metrics that I can think about for measuring Google Hangout:

– Given Hangout’s integration into Google Calendar, many users add Google Hangout to their calendar invite. One metric to look at is % of remote Google Calendar meetings which occur with Google Hangout.
– In addition, I can see what % of video conference based calendar events scheduled via Google Calendar are on Google Hangout. This number helps me determine popularity of Google Hangout.
– I think one indication of success of Google hangout is to determine length of call divided by length of Google Calendar invite. If the number is low, it’s an indication that people are ending the call early for reasons we need to understand.
– It would be important to know what % of Google Calendar meetings which include a Google Hangout actually do occur on Google Hangout. If the number is low, it could be an indication that the call participants run into problems and end up not having the call
– Another metric to look at would be what % of first timers using Google Hangout, come back and use it again within a period of time
– One more metric to look into would be number of minutes it takes for all the call participants to join the call. If the number is low, it’s an indication that it’s easy for the participants to determine how to join the Google Hangout call
– Another metric to consider would be number of times that someone starts and ends a call in one group. In some cases, I’ve seen this in Skype a lot, users struggle with starting a communication that everyone can hear video and audio. If this number is high, it means people are struggling with using the product
– To measure whether video conference is being used, I will look at % of Google hangout calls which include video enabled.