Yousician · B2C · music learning app
Set calendar reminders to recheck price tests at 3 and 6 months
Catches price 'wins' that flip once renewals come in; no numbers
What they did
What happened
In their words
Stop Celebrating Conversion Wins Before Checking Renewals – Sara Grana, Yousician
David BarnardAnd this gets back to what we started with was keeping a detailed history. Is that when you do run an experiment, do you set an alarm like three months from now?
Sara GranaYeah, my Google Calendar up there has this experiment recheck with my live data analyst. Yeah.
David BarnardGotcha. So you are looking back at specific intervals, and do you do that for... I guess you wouldn't do that for every test. What's the criteria for the things that you're most care to look back on?
Sara Grana… is price changes, I really care about. Because for example, if it's about, oh, the layout is different or the copy is different, then sure, maybe there's a different in renewal by why would it, right? So there's certain things that are probably not. So I don't know. You shouldn't be spending a lot of time. The thing is also, the more you do it, the easier it gets in a way. It's just like another part of the analysis, so to say. It's already set up that way. So you have already a cohort, it's like, okay, you pull back, okay, here. And sometimes it's even with some tools, it's even there that you can just recheck this test how it performed. So it doesn't need to be really time-consuming. But usually, everything that is with price or discounting or thing like this, I would always recheck after, depending on what we are selling three months, six months. And then if you have to wait a year, it's... Yeah.
David BarnardIt seems like too, maybe the priority would be to make sure you're checking back on the things that made the biggest move. So maybe there was a copy change on the paywall button that did a 25% lift, which sounds crazy, but it happens sometimes where you have these crazy lifts. And so maybe those kind of things would also fall into that bucket of anything that made a surprisingly big lift mark that one to go back on because-
Get tactics like this every Monday
New tactics from the week's founder interviews, each linked to where it was said.
More from this episode
- Chart revenue from new, upgrading, renewing and returning subscribers, then explain each spikeSurfaces which past decisions moved revenue, e.g. a lifetime plan launch; no numbers
- Before calling a paywall test, wait two weeks and check refunds and chargebacksRefunds show up fast and can erase a paywall win; no numbers
- Send an offer to people who turn off auto-renewLooked great, but users refunded first and then took the offer; net negative
- Judge a new lifetime plan against what a subscriber pays over timeTests otherwise wrongly crown lifetime, e.g. 250 vs 100 instead of 250 vs 300 euros
- Split renewal rates by plan, discount, and web vs app before reading themWeb buyers renew much better, so blended renewals rise from mix shift alone
- Use monthly-plan renewals to set a warning threshold for yearly-plan test winners
Tags: cohort-recheck, price-test, renewals, calendar-reminder