feat: allow make changes in the flag while running experiments
cre8ivejp opened this issue · comments
Currently, Bucketeer doesn't allow changes while an experiment is running because it might bias the results.
But because we have a feature to re-sample the users when necessary, it doesn't make sense not to allow the changes as long the maintainer understands the risks.
Many services are changing this behavior, allowing the maintainer to make changes during experimentation.
Also, it would improve the UX since the maintainer wouldn't need to do the following steps.
1 - Stop the experiment
2- Change the Flag
3- Create a new experiment
4- Start the experiment