Blog

Experimentation Leads / Managers / Capability Leads have an interesting role to play. But not all of them are doing the right tasks. In this article, we highlight the challenges faced by organizations and what experimentation managers should be doing to hold their teams accountable

Towards the end of 2023, Kameleoon, an A/B testing software vendor published an article on their blog with interviews of CROs and experimentation leaders in the industry asking them what trends to expect in 2024. Everyone interviewed made bold predictions but here's why we believe they could be wrong and what experimentation teams must focus on.

Your experiment learnings and insights are the most powerful part of the experimentation process. If not handled correctly or overlooked, it can nullify all the work you have put in to running the experiment. The default state for a lot of experimentation teams is to lead with the actual experiment…

TL;DR of this article : A powerful update is coming to Effective Experiments. We are changing the way of capturing insights to make it more powerful, visible and actionable by the rest of the business. What is an insight? What makes a valuable insight? This is a question that…

If your organization is running an experimentation program, you must track your ideas and experiments. It should be a no brainer. This is company IP. They’ve invested in experimentation and they own the output. It shocks me to hear that even now (at the time of writing this in 2023),…

An experimentation program is more than just running tests and there are lots of different moving parts including the people involved that you need to watch out for. When running your experimentation program properly, you need to keep a close eye on the metrics that can help you determine if your program is healthy or not.

In this final part of a three part series on Vanity Metrics in Experimentation programs, we will look at how the activities centred around Culture of Experimentation is a vanity metric.

There are clear indicators of successful experimentation programs. The biggest of these is how an organization manages the documentation aspect of their experimentation program. Experimentation documentation cannot be an afterthought. There must be a clear strategy and plan behind it to ensure it is valid and useful to the organization. A spreadsheet is not a strategy. Neither is hooking up random project management tools together with APIs in your spare time. What will separate a lot of organizations running mediocre and poor experimentation programs from those that do it well is how they view and structure documentation as part of their experimentation process.

Looking to increase your CRO knowledge and meet likeminded people in the industry? We have compiled a list of all the CRO specific conferences you should attend in 2023.

The challenge with organizations trying to grow their experimentation program across the wider business is it faces an uphill challenge to get a disparate group of people to run experiments at the same level of quality. Often, there is no visibility of the quality of the experiments run. This is why created the Experiment Health Score.

Experimentation program documentation – the process from idea to result – are (or rather should be) a significant part of an organization’s experimentation program. It is something we at Effective Experiments have been talking about since our inception in 2014 when the idea of tracking experiments seemed like an alien…

Experimentation teams could be changing their hypothesis or data after an experiment is run. Here's how to stop this malpractice in your team.