Is there a limit to how many a/b tests?

Question

Is there a limit to how many a/b tests we can have running on our site at one time?

Answer

Each A/B test requires:
1 - Coming with ideas and assumptions
2 - Validating and prioritizing the ideas (Depending on the organization)
3 - Writing / building the new variant
4 - Configuring / launching the A/B Test
5. - Testing the A/B Test
6 - Making sure that they get enough data to reach statistical significance
7 - Analyzing the data to see if initial assumptions ended being true / understand why one variant performs better than another.

The two limiting factors for the number of A/B Tests are typically:

• Resources dedicated to conversion rate optimization
• Traffic on the website

Technically, we're confident that you will be able to run up to 100 A/B Tests at the same time. However, so far, our customers usually run between 2 and 8 tests in parallel.

Regarding the number of variants, technically, we're also confident that you can add up to 20 for one A/B Test. Our experience with customers is often 2 (default + 1 variant), sometimes 3-4 and rarely 5-6.