Yousician · B2C · music learning app
Set calendar reminders to recheck price tests at 3 and 6 months
Catches price 'wins' that flip once renewals come in; no numbers
Unknownexperimentationpricing
What they did
After rolling out a winning experiment, put a recurring 'experiment recheck' in Google Calendar with the data analyst. Prioritize anything touching price or discounts (not layout/copy changes, unless the lift was surprisingly large or top-line growth isn't matching the stacked test wins). Recheck the cohort at three and six months depending on what is sold, or up to a year. Keep the cohort set up so the recheck is just a quick pull.
What happened
Guards against cases like a price increase that looked like a win but whose control group renewed better six months later.
In their words
Sub Club by RevenueCat · Stop Celebrating Conversion Wins Before Checking Renewals – Sara Grana, Yousician“Yeah, my Google Calendar up there has this experiment recheck with my live data analyst.”
“But usually, everything that is with price or discounting or thing like this, I would always recheck after, depending on what we are selling three months, six months.”
Related topics
Get tactics like this every Monday
New tactics from the week's founder interviews, each linked to where it was said.
More from this episode
- Babbel: Chart revenue from new, upgrading, renewing and returning subscribers, then explain each spikeSurfaces which past decisions moved revenue, e.g. a lifetime plan launch; no numbers
- Yousician: Before calling a paywall test, wait two weeks and check refunds and chargebacksRefunds show up fast and can erase a paywall win; no numbers
- Send an offer to people who turn off auto-renewLooked great, but users refunded first and then took the offer; net negative
- Judge a new lifetime plan against what a subscriber pays over timeTests otherwise wrongly crown lifetime, e.g. 250 vs 100 instead of 250 vs 300 euros
- Split renewal rates by plan, discount, and web vs app before reading themWeb buyers renew much better, so blended renewals rise from mix shift alone
- Yousician: Use monthly-plan renewals to set a warning threshold for yearly-plan test winners