Creating an Experiment

Campaign Experiments let you easily set up and launch A/B tests to better understand the impact of audience targeting, creatives, location, and more. By creating an experiment, Quantcast Platform will create two copies of the desired ad set with a 50/50 even-split cookie pool to minimize overlap and achieve clean test results. 

You can use our Campaign Experimentation feature to test variables and campaign changes. Some use cases for creating campaign experiments could be: 

• Test separate sets of creative and/or messaging for the same ad size.

• Test different Lookalike Site Events. For example, using the entire website audience vs. converters. 

• Test the impact of demographic targeting versus non-demographic targeting across your campaign.

Tips: 

• Before creating the experiment, define what you are interested in testing.

• Keep differences between ad sets to just one aspect. (for example, both ad sets are the exact same, except for a difference in creatives)

• Let the test run for at least a week, or until you see statistical significance

• Do not make significant changes after starting the test

Setup a Campaign Experiment

1. Navigate to Campaigns. Hover over the existing ad set you want to clone. Click Create Experiment. 

2. A pop-up will appear. Enter a name for the experiment, then click Next. On the next screen, edit the dates, budget, and names then click Create Experiment.

Note:  The budget will automatically be divided evenly between both ad sets. If you would like to change the ad set budgets, you can edit the ad sets after the experiment has been created. 

This will create a brand new campaign, indicated by a flask. The ad sets will be a duplicate of the one you have chosen.

3. Reconfigure the ad set to change the variables you want to test (e.g. lookalike event, demographic targeting, interest, location, creative) by hovering over the ad set and then clicking Edit. 

4. Once you are ready to test, switch the toggle to the right of the ad set to start serving. The status will change to Active. 

View Campaign Experiment Results

To review test data and results, hover over the experimental campaign and click Insights. In the window that appears on the right-hand side, click Experiment Results. 

You can compare results across the two ad sets between spend, impressions, and conversions. To switch between these metrics, click the field to the right of View. Data is typically available 12 hours after launch.