Skip to content

Execution & RCA · Medium

Daily orders on your food-delivery app dropped noticeably yesterday. How would you investigate?

Short answer

Confirm the drop is real and not a tracking issue, then size it and check timing. Separate external causes (holidays, weather, competitor offers, outages) from internal ones (releases, pricing, experiments). Break the metric down by platform, city, user type and funnel stage to locate where the drop sits, form hypotheses, test them with data and agree an action.

Detailed answer

Framework

  1. Validate: is the data correct? Check other sources such as payments or restaurant-side order counts.
  2. Scope: how big, since when, sudden or gradual?
  3. External factors: festivals, weather, sporting events, competitor promotions, payment-network outages.
  4. Internal factors: app releases, backend changes, price or fee changes, running experiments, marketing pauses.
  5. Segment: platform, app version, city, new versus returning users, payment method.
  6. Funnel: app opens → restaurant views → add to cart → checkout → payment success → delivered.
  7. Hypothesise, test, act.

Worked example

Suppose orders fell sharply from yesterday afternoon.

  • Data check: payment-provider settlements also fell, so the drop is real.
  • External: no holiday, normal weather.
  • Internal: a new Android version rolled out yesterday morning.
  • Segmentation: the drop is concentrated on Android, latest version, all cities.
  • Funnel: app opens and cart additions are normal; payment success fell for one payment method.

Hypothesis: the release broke a payment flow on Android for that method. Engineering confirms an error spike after the release.

Action: pause the rollout or roll back, communicate with support, notify affected users if appropriate, and run a blameless review to add a test or alert that would catch this earlier.

Common pitfalls

  • Jumping to a favourite hypothesis before checking data quality.
  • Looking at totals instead of segmenting.
  • Stopping at the cause without a fix and a prevention step.