Practitioner pattern · Alper Taner
When an ad wins, change one thing at a time to learn why before making more
Expert says it creates more winners; seen a concept's third variant win after two flopped
Workedpaid-socialexperimentation
What they did
Read relative creative metrics (hook rate, thumbnail, audio, background) to form hypotheses, then change one variable at a time. Example: if a dog ad wins, test the same dog, a puppy, another breed and another animal to learn whether it's the dog, animals, or something else, and only then roll out production. Run both iterative and radical concepts, and always test a few variations per concept (a concept's third variation can win after the first two fail). Feed hypotheses from Meta test results (most weight), in-app analytics on what high-LTV users use and respond to, competitor and category ads, and trending memes/audio.
What happened
Creates winners from winners; avoids killing whole concepts on one variant.
In their words
Sub Club by RevenueCat · Creative Misfires, False Positives, and Meta's Auction Flaws — Alper Taner, Stealth-Mode App Studio“So, let's take the dog example. Okay, let's have the same dog, let's have a puppy, let's have another breed, let's have another animal. So, just to test and see if it's the animal or not.”
“However, I have seen from the same concept, like the third variation worked, but the first and second failed.”
Related topics
Get tactics like this every Monday
New tactics from the week's founder interviews, each linked to where it was said.
More from this episode
- Track cost per new ad that beats your current ads, not how many you testExpert says fewer, better-reasoned tests beat 500-a-month volume; no numbers
- Plot each ad's total spend against its cost per result to see when to stopBad ads are often clear by ~$500; one account burned ~$90K on a $100+ CPI ad
- When one ad eats 90% of an ad set's budget, give the other ads their own ad setOther ads often 'bloom' once the dominant ad is removed
- Keep the US out of campaigns with smaller countries; group countries by cost or value
- When a new ad keeps overspending its budget at the same cost, raise it fast5x campaign budget in two weeks with falling cost per purchase
- Set a $1M daily budget on Meta, but cap total spend and bids to control itMore high-quality traffic at stable cost for some accounts; others got no or runaway delivery
- Bid differently by placement or age group when their results differ by 20%+
- Tell Meta a trial start is a trial, not a purchaseCost per trial down ~35% with the same ads and campaigns
- Use MMP data to compare ads, but switch channels off to see what they really add
- Check which competitor ads have the most versions and longest runs in Meta's ad library