Plot each ad's total spend against its cost per result to see when to stop

Alper Taner… because of the high quantity, which is not necessarily a win or something to be proud of alone if your success rate is low because also then the mindset shifts like, "Hey, look, I have 500 creatives. I can't spend 5K on all of them." Sometimes, this gets into, "Oh, we only spend $100 on these creatives and that's it. " Okay, but how did you decide on that threshold? And I think finding that threshold is such an important thing for every account.

Alper TanerFor example, there's no universal number that I would give. It's very different from business to business, depending on your CPI, depending on your other CPX metrics. But what I would suggest is to look at your cumulative spend and cumulative CPX metrics, whether you're testing on a CPI or a cost per trial or just cost per subscription and such, and see when they stabilize. So, because I see a lot of accounts with high spend, they're sometimes just spending 10K, 20K only to realize, "Oh, this is actually not a good creative." I'm like, "Oh, really? I could tell it after 500 bucks, look at the data. It was already bad. It was already screaming. Why did you spend so much?" So, in order to avoid that inefficiency and scaling it more efficiently, you could easily look at cumulative spend and cumulative performance over time and to see where your data stabilizes because we are not going after the statistical significance.

Alper TanerNo one has money for that, but we also don't want to spend just 20, 30 bucks to see, or we don't want to just let the algorithm decide which one to pick. So, there, the problem is the following, just because algorithm decides to deliver one creative over others doesn't make the other creatives bad creative. I think there's such a misconception or interpreting, I would say in a wrong way. That particular creative that got the 90% of the spend was …