multi-armed bandit


A form of split testing where the frequency of showing each variation is dependent on the performance of that variation so far. The multi armed bandit model tends to reduce the cost of running experiments compared to traditional split testing, but it takes longer to identify a winning variation.

Example: I set up a multi-armed bandit test to evaluate variations of our home page.

Previous Term: MRR

Next Term: mutual NDA