Sociaaal · B2C · AI-native app studio
Run about 100 A/B tests a month, starting small and scaling the winners
Portfolio ARPU roughly 3x in 18 months, 2x in 12; about 1 in 10 tests wins
Workedexperimentationpaywallonboarding
What they did
Dozens of A/B tests a month per app (~100/month across the portfolio). Focus early on the top of the funnel (first screens, adding/removing onboarding screens), then test all around the app once an app has ~1M users/month. Each test starts at small scale and is expanded if promising. Of ~20 tests: 10 neutral, 5 bad, 3 promising, 2 winners.
What happened
Average ARPU across apps ~3x over 18 months and 2x over 12 months; portfolio LTV/CAC ~3x.
This shipped together with other changes, so the result can't be credited to this alone.
In their words
The Superwall Podcast · Patrick Stuart-Constant & Pablo Sánchez - $16M AI CEOs: How to Make $1.3M/Month With AI Apps“Pablo translates that into, you know, dozens of A/B tests a month for each app. Continuously lifts the uh average revenue per users.”
“So we have a system of scaling A/B test: we run it at small scale, then bigger, and that way we are always adapting.”
“If you already have a 1 million users per month, we get more sophisticated and we try things all around the app, and we unlock value in every corner.”
Related topics
Get tactics like this every Monday
New tactics from the week's founder interviews, each linked to where it was said.
More from this episode
- Sociaaal: Buy apps that went viral and are now declining, then grow them againBought 6-year-old Celebs mid-decline; now bigger than ever, ~$300K+/month
- Sociaaal: Run the same style of test ads for apps you might build or buyStrong ad results count as a key data point in buy decisions; no numbers
- Celebs: Drop the paywall after onboarding; show the lookalike result fast and ask laterMore revenue per user; later paywalls converted the users who used to drop
- Sociaaal: Rerun old A/B tests that lost once the rest of the app has changedOnboarding paywall removal lost several times, then won big
- Sociaaal: Write down the reason behind every A/B test so AI agents can learn from it
- Sociaaal: Make about 4,000 AI video ads a month, with people coming up with the ideasProfitable at 3x LTV/CAC; creative team tripled in 6 months to keep up
- Sociaaal: Keep testing brand-new ad ideas instead of endless versions of one winnerCredited with staying market leader in their niches; no numbers
- Sociaaal: Use AI to find TikToks from other industries to inspire your ads
- WiseSam: Ask ad visitors many questions, reflect answers back, then offer a $1 first weekFounders say the long quiz works very well; no numbers yet
- WiseSam: Give new users one-tap task buttons so the AI assistant learns about them fastUsers get more engaged once the agent knows them; still needs more guidance