GTM Sauce

Savvy Navvy · navigation app for boats

Skip sign-up entirely and create a hidden anonymous account instead

Looked great in the test, fell apart at full rollout; support grief erased gains

Failedonboardingexperimentation

What they did

To cut drop-off at account creation, ran an experiment that skipped sign-up and created an anonymous account under the hood. Rolled it to 100% after strong early results and ran it for quite some time.

What happened

Early test results were 'through the roof', but success rates dropped at 100% rollout. Users with several devices couldn't sync or log in, causing heavy support load; the uptick was smaller than measured due to metric issues in the test region.
Effort
A/B test then full rollout, run for quite some time
“And initially, the results were through the roof. It was amazing.”
Jelte Liebrand
“And then, we rolled it out to 100%. The success rates started to drop a little.”
Jelte Liebrand
“And it's just no end of grief, and ultimately, the uptick wasn't as good as we thought it was due to some metric issues that we found in this region.”
Jelte Liebrand

Related topics

Get tactics like this every Monday

New tactics from the week's founder interviews, each linked to where it was said.

More from this episode