> Validation, scrutiny and repeatability over convention and ad verecundiam

Does repeatability mean you can't change your product based on the outcome of an A/B test? Because you probably won't get a chance to repeat those conditions.