What percentage of split tests actually beat their control according to DoWhatWorks data?
Answered at 2:00 in How to Stop Guessing and Start Testing with Casey Hill, DoWhatWorks · The Content Cocktail Hour
What percentage of split tests actually beat their control according to DoWhatWorks data?
According to a study DoWhatWorks published, only 11% of split tests beat their controls, meaning people are running a ton of testing and spinning their gears because they are ineffective. The platform helps guide more educated testing across different areas to improve test efficiency.
Full answer and detailsRead the whole answer, key facts and every other question from this episode
In short
According to a study DoWhatWorks published, only 11% of split tests beat their controls, meaning people are running a ton of testing and spinning their gears because they are ineffective.
Casey Hill, Chief Marketing Officer at DoWhatWorks · How to Stop Guessing and Start Testing with Casey Hill, DoWhatWorks · The Content Cocktail Hour · answer at 2:00
Key takeaways
- According to a study DoWhatWorks published, only 11% of split tests beat their controls, meaning people are running a ton of testing and spinning their gears because they are ineffective.
Quote to remember
“Avoid generic AI language and then also try to make sure that you tie in the outcome.”
— Casey Hill
The full answer · about 1 min
According to a study DoWhatWorks published, only 11% of split tests beat their controls, meaning people are running a ton of testing and spinning their gears because they are ineffective. The platform helps guide more educated testing across different areas to improve test efficiency.
Key facts
- Only 11% of split tests beat their controls according to DoWhatWorks study
- Eight out of 10 times customer logos lose when tested head-to-head against alternatives
- Two CTAs consistently win over one CTA in hero section testing
- Approximately 70% of top 100 SaaS companies default to annual pricing displayed monthly
- DoWhatWorks database contains tens of thousands of tests across multiple industries
People, companies and topics mentioned
More answers from this episode
- 7:00Why do customer logos consistently lose in A-B tests on B2B SaaS websites?
- 10:00What is the positioning logic for customer logos on a B2B SaaS website?
- 12:00Should B2B SaaS websites display one or two CTAs in the hero section?
- 17:00Is generic AI messaging effective in converting website visitors?
- 19:00Why do executives sometimes reject winning test variants in favor of AI messaging?