Built With Science · B2C · science-based fitness coaching app
List every reason a page fails before brainstorming fixes, and write each test down
~70% of tests fail first time; written notes turn failures into later winners
Workedexperimentation
What they did
1) Use Amplitude to find the biggest drop-offs with the most room to improve across web and app onboarding. 2) For the chosen page (e.g. pricing), list as many problems as possible (lack of trust, unclear value proposition) and agree as a team on the biggest one. 3) Only then list solutions (e.g. testimonials for trust) and run the test. Document everything instead of Slacking an engineer, so failed tests can be diagnosed and iterated. Test bigger swings batching several hypotheses, since traffic is too low for many small tests; strip down if a batch fails. Apply winning messaging from one part of the funnel (quiz) to others (app).
What happened
About 70% of experiments fail on the first go; documented iteration has turned failures into winners (e.g. the no-trial toggle reframe).
In their words
Sub Club by RevenueCat · Scaling Meta Ads from zero to $100K a month — Ethan Ethier, Built With Science“we'll list out as many problems as to why that pricing page isn't converting before anything else”
“if an experiment fails, you can go back to the drawing board and understand what exactly you tested, why it failed, and how you can iterate on it”
“We won't have enough to do a bunch of mini tests, so we'd rather focus on a bigger swing.”
Related topics
Get tactics like this every Monday
New tactics from the week's founder interviews, each linked to where it was said.
More from this episode
- Built With Science: Spend a year fixing trial-to-paid and retention before buying any adsFounder says it lifted the floor for every channel; paid traffic later converted at 25%
- Built With Science: Hype the app launch to your YouTube viewers, course members and email listA launch spike, then a steady trickle; not a growth engine on its own
- Built With Science: Mention the app softly mid-video, and tell user transformation storiesStory videos bring more trials than broad educational ones; old videos give steady monthly trials
- Built With Science: Hire clippers to post long-video clips on Reels and TikTok, then reuse winning hooksSome clips go viral; their hooks now shape new long videos
- Built With Science: Scale Meta ads without the famous founder: B-roll, testimonials and AI image adsScaled from zero to ~$100K/month (host figure); 25% trial-to-paid
- Built With Science: Spend the first month of ads just learning your paid trial-to-paid rateTook about a month to get a baseline to set the allowed cost per customer
- Built With Science: Judge ads by how many trials pay, not by how cheap the trials areClickbait ads brought cheap trials but a huge drop in trial-to-paid
- Built With Science: Build a dashboard that confirms which trials came from Meta, and send Meta your best users
- Built With Science: Send ad clicks to a long personal quiz on your website, not the App StoreQuiz beat direct-to-store; now gets ~90% of traffic; same quiz in the iOS app did worse
- Built With Science: Sell the app as a trainer in your pocket, not a tracker, at $189 a yearKept $189/year since launch; 35-40% organic and ~25% Meta trial-to-paid
- Built With Science: Offer 15% off each if users add a workout buddy to their plan15% of trial starts add a buddy; higher order value and better retention
- Built With Science: Build free calorie and macro calculators that rank in AI search and lead to the quizWorking well, founder says; tools convert slightly better than blog posts
- Built With Science: Release new features quietly, and announce only once usage proves themFounder says it gives cleaner reads than email-hyped launches; no numbers
- Built With Science: Build an AI coach trained on the creator's videos that reads each user's own dataOne of customers' favorite features, founder says; no numbers
- Built With Science: Team up with researchers and run studies with your own app usersFounder says it adds credibility; no numbers
- Built With Science: Show only the yearly plan first, with a day-by-day trial timeline and reminder promiseAnnual picks rose from ~60% to 75-80%, with no price change
- Built With Science: Add more explanation to the pricing page to make the value clearerHurt conversion; extra text overwhelmed buyers who were ready to start
- Built With Science: Offer 20% off to pay now, with a toggle back to the 14-day free trialQuite negative, even with a 30-day money-back guarantee
- Built With Science: Make both the free trial and the pay-now discount sound goodVery strong lift after a few weeks, vs the version that shamed the trial
- Built With Science: Film a months-long science experiment video with real people in a rented studioOne of the year's top videos; decent but not major app conversion