Symmetry · B2C · gym workout tracker
Start each test from a real user problem and A/B test for two weeks
Credited for reaching $160K/month; most tests don't move the needle
Workedexperimentationfeature-development
What they did
Start from a problem, not a solution: What problem am I solving? How do I know it's real? Then list solutions/hypotheses, estimate how much each moves the target metric, define guardrail metrics, and A/B test control vs new version for at least two weeks before analyzing. Maintains 'Evelyn' (Experiment Velocity Engine List) database of experiments sourced from user interviews; product experiments in PostHog, paywall tests in Superwall. Evolved from building what founders wanted (terrible) to building user requests (mediocre) to this.
What happened
Credited as the main reason the app reached $160K/month in a year; most tests don't move the needle
“First, we built what we wanted. Terrible idea. Second, we built what users wanted, like directly from feedback requests. Mediocre.”
“How much will each hypothesis move the metric? Are there any guardrail metrics I should watch out?”
“after at least two weeks of running the experiment, you then analyze the data”
“this is what we call Evelyn, Experiment Velocity Engine List in your numbers”
“Also for A-B testing, the payables, we use SuperRule.”
Related topics
Get tactics like this every Monday
New tactics from the week's founder interviews, each linked to where it was said.
More from this episode
- Symmetry: Post ~80K creator videos a year from 500+ accounts; track which formats win~1B views in a year; main driver of ~3M downloads
- Symmetry: Pay creators nearly half of revenue so they keep posting
- Symmetry: Launch to the founders' own YouTube fitness audienceOnly a tiny download spike
- Symmetry: Try influencer marketing for a gym app
- Symmetry: Build a gym tracker for Spanish speakers instead of the USDescribed as the fastest-growing fitness app in the Spanish market
- Symmetry: End onboarding with a screen where users pledge to work out~3% better retention in an A/B test
- Symmetry: Test two new designs for the first screen after onboardingNeither moved any metric
- Symmetry: Test the screens most users hit, like the paywall, before minor features
- Symmetry: Set big 90-day goals, bigger the newer the app
- Symmetry: Add ranks, streaks and a friends feed to workout trackingRanks are the most-liked feature