One of the best ways to increase your profitability? A/B split testing. Google Ads has a feature called the Experiments where you can create custom experiments for your campaigns and compare how your test group performs against your original campaigns (control group) over time.
Only problem is, this is only available for Search and Display campaigns. Not for Shopping. Luckily, I’ve come up with five ways you can test multiple variations of your Shopping campaigns, which is what we’ll be diving into in this post.
A/B testing product information like titles, images, or extensions can be useful for optimizing your product feed
This can be done in the set-up of your feed, either via a feed management tool or manually in Google Merchant Center. Once you’ve decided what you want to test, you’ll need to create equal groups of products. This can be done in several ways, I mainly use the following two methods:
With a cluster analysis you’ll divide based on historical performance (e.g., dividing your products into equal groups based on metrics like clicks, revenue, costs, and conversion value). You can do this via spreadsheet for smaller datasets or in R (or other programming languages) for larger datasets.
A random split can be done based on the ID of your product. For example, if you use numeric values as product IDs, you can assign group A to all even numbers and B to all uneven numbers.
The most important thing while splitting your products is to make sure that all groups of your experiment have an equal number of products and that your key metrics are also very close.
Once you’ve made the split, make the changes to the product IDs in your test group. Make sure you’re able to report on all of your product IDs and corresponding groups. This way you can analyze them and find winners. Below you can find an example of how this would look in your feed.
If you want to split test campaign settings like ROAS, targeting, or different campaign types, you’ll need to make splits based on something other than product IDs. Ideally, you’ll want to offer the same products in both your control and test groups because performance can vary by product. There are three different splits you can make to test your settings. Just like the test set-up on product content, creating equal groups is key. With all methods, you need to do the data cluster analysis yourself. Create two or more equal groups and analyze based on the differences.
With Customer Match, you can target first-party audiences in Google Ads. It works by uploading a list of email addresses from your existing database that you want to target, and Google will match those email addresses to Google accounts.
If you’re using Customer Match, you should be able to create a cookie split in your CRM software. Then you can create two different campaigns using two different Google Customer Match Audiences. Change the setting that you want to test in your test campaign, and keep everything else the same in your control campaign. And that’s it.
Note: If you’re using Customer Match, make sure you have a third campaign running for all potential customers that are not inside of your database. This way you don’t lose any potential conversions.
Geo splits are often used to find incremental uplifts in campaigns. This could answer questions like: Is there incremental value in advertising on branded keywords?
In a geo test, a market is divided into smaller geographical regions called geos. Each geo gets assigned either a control or a test group. Users in the test geos are exposed to the changed campaigns while users in the control geos are served the control campaigns. The split can be done on country or region, as long as both regional groups are highly correlated. You’ll need to use the cluster anaysis to determine your groups.
In a campaign split, you simply divide your campaigns or accounts into two highly correlated groups. Both groups need to have an equal number of key metrics like clicks, conversions, and costs.
In one group of campaigns (test group), you make the changes while in the control group your current best practices will serve. If you label and track the different groups of campaigns, you can tell something about the differences in performance.
Budget and bidding strategy are two settings you could test.
That’s it! Five different ways to run A/B tests for your Google Shopping ads:
The quality of the outcome is dependent on the quality of your preliminary (cluster) analysis and setup. What you get out is what you put in. Hopefully this helps you with the optimization of your Google Shopping campaigns. If you try any of these methods, share the results in the comments! For now, have a wonderful day and keep optimizing!
Jesper has spent the last 8 years optimizing big spend marketing accounts for different e-commerce companies. He is the founder of Peak Express, a performance marketing agency specializing in e-commerce. You can find him on LinkedIn.
See other posts by Jesper Veltman
Please read our Comment Policy before commenting.