Hitting a new milestone – 10000+ experiments planned and executed via Effective Experiments

I’m not one for vanity metrics but seeing our stats pick up this number today filled me with a lot of joy.

10000 experiments! 10,000 experiments that our amazing customers – conversion optimization teams & agencies have planned , prioritised, hypothesised, created, qa’d , deployed and completed via Effective Experiments!

This is a big milestone especially when you consider it doesn’t factor in the countless number of research studies, unfinished or undeployed tests that are still sat in the account.

So which companies are deploying these tests or who is launching more than others? Well, that we don’t know and for good reason. Our data privacy setup means we only get anonymised stats to understand our own product usage (to help us improve) and nothing more.

Since starting Effective Experiments way back at the end of 2014, I have seen the industry mature and experimentation becoming more and more important but another trend has also started to take hold – the realisation that to truly make companies optimisation centric means making it everybody’s business in the company. Sharing and democratising the insights and knowledge helps you achieve that and I’m proud to say that Effective Experiments has played some part in facilitating that.

So what’s next for Effective Experiments in 2018?

The Query Engine has been the goto module for our customers to pull out insights on the fly. Now we’re taking it up a notch and introducing AI and Machine Learning into Effective Experiments in the form of the Synthesis Engine.

Meet Synthesis Engine

Synthesis Engine brings a whole new experience to planning experiments in Effective Experiments. It will be able to predict what you should test, it will give you helpful information when your planning tests, warn you of potential dangers such as collision impacts. It will also help you calculate your sample sizes, test duration by seeing what you’re planning and then making calculations from your Google analytics account.

Over time, it will get more clever and will be able to help you get a better understanding of your testing programme. Don’t worry though. He won’t replace you 🙂

See How The Experts Do It – The Workflow Marketplace

Our customer base includes some leading optimization experts and we are helping them share their experience and knowledge through the workflow marketplace.

The workflow marketplace will allow users to voluntarily (if they wish), share their own workflow and make it available to others. A single click of a button will apply the expert workflow to their Effective Experiments accounts or specific projects.

Dashboards aplenty!

Our new updated UI brings in additional dashboards and metrics to the forefront. Segment and Share so relevant stakeholders and teams see what’s important to them.

Our Enterprise customers will also be able to create dashboard using their own metrics from Effective Experiments integration sources as well as their own third party sources.


Ok I’m personally excited about this one! We’re releasing v1 of our own API. This opens up the space for other companies to build solutions using our data. Think reporting, visualisations, post-test analysis tools and much much more!

2018 is looking even more exciting and I want to say a big heartfelt thank you to all our amazing customers – Old and new and those we have yet to meet.

Manuel da Costa

A passionate evangelist of all things experimentation, Manuel da Costa founded Effective Experiments to help organizations to make experimentation a core part of every business. On the blog, he talks about experimentation as a driver of innovation, experimentation program management, change management and building better practices in A/B testing.