Execution & RCA · Hard
Engagement is up, but revenue is down over the same period. How would you explain this?
Short answer
These metrics can diverge for legitimate reasons, so investigate rather than assume one is wrong. Check whether the mix of users changed (more free or low-spend users), whether pricing, discounts or ad rates shifted, and whether engagement rose in areas that do not monetise. Segment both metrics by user type and feature to find where they separate.
Detailed answer
Framework
- Confirm definitions: how are engagement and revenue measured, and did either definition change?
- Decompose revenue: users × share paying × revenue per paying user (or, for ads, impressions × fill rate × price).
- Decompose engagement by segment and feature.
- Find the divergence and explain it.
- Decide whether it is a problem.
Worked example
A music-streaming app with free (ad-supported) and paid tiers.
Possible explanations:
- Mix shift: a campaign brought in many new free users. Engagement rises; revenue per user falls.
- Downgrades: some paying users moved to the free tier but kept listening.
- Ad market: advertisers spent less this quarter, so revenue per ad impression fell even as listening rose.
- Non-monetised engagement: a new podcast section attracts listening that carries fewer ads.
- Discounting: a promotional price for the paid tier lifted sign-ups but reduced revenue per subscriber.
Segmentation would show which. For instance, if paid-user revenue is stable but ad revenue per impression dropped, the cause is likely external. If many paying users downgraded, investigate why (price change, competing offer).
Decide: some divergence is acceptable if it reflects a deliberate strategy, such as growing the free base to convert later. It is a problem if it shows paying users are leaving.
Common pitfalls
- Assuming the engagement metric is wrong.
- Ignoring external market factors.
- Recommending actions before locating the cause.