My initial guess is that this is too big of a drop in a short time to be caused by competitors and given that Apple and Google don’t launch their new OS in August, it’s unlikely that it’s caused by an update to an OS or launch of a product by major competitor such as Apple.
First, I’ll take a look at list of updates and changes recently made to the app to get a picture of what things has changed internally. Maybe one of the changes have broken a flow in the app or has impacted the user experience of the product. The app reviews can also help me see if there is a trending complaint about some aspect of the product. Let’s assume that there was’t many complaints and there weren’t any major releases or updates that could have caused this.
Then I’ll check to see if this is related to seasonality of the product usage. I’ll look at historical data to see if I see a similar drop in previous years. Assuming there wasn’t any drop in the previous years, I’ll look at other apps within Google to see if the issue was isolated or across the spectram. If it was across the platform, I would know that it is probably not related to my particular app and I would look for more macro-related issues. Examples would be telecom provider changing data plans or having outages. Now let’s assume the issue is isolated.
I’ll first look at top of the funnel to see if there have been any drops in the number of app daily opens. If there isn’t, I’ll look at the engagement rates to see if I get any hints on the issue. Numbers to look at could be time spent, number of certain tasks completed, etc. For example, if I find out the number of tasks completed is same as before but time spent has come down, it might be an indication that an update has made the app more efficient.
Le’s assume that the drop is in engagement. Then I will look at more metrics related to engagement and particular flows that are contributing the most to the user engagement and see if I see any changes in user behaviour in those flow. Hopefully, this will help me spot the problem.
Would love to get people’s feedback on this.