Amazon Split Testing

With almost 500 million products on Amazon, how do you stand out from the crowd? Split testing is one of the most effective means to optimize your Amazon product listings and increase engagement and sales on your products.

See Split Testing in Action Start your Amazon Split Test
Subscribe for 15% off

Sign up for our newsletter and immediately get a coupon for 15% off your first poll.


In the past, I’ve used paid advertising on Google AdWords or Facebook to split test these types of variables. However, I’ve found to be faster, cheaper and more valuable then PPC testing...I’ve found to be a an excellent tool for not only digital marketing, but for just about anything worth split testing.
I recommend PickFu to any Amazon FBA seller who wants to instantly increase their sales and CTR by simply creating a poll using PickFu's easy to use platform. PickFu's audience are real Amazon prime customers that will give you valuable, realistic opinions when you are split testing your images or text on your product listing. Get results in as fast as 15 minutes!
I was looking for split testing platform that had a good balance of quality results, ease of use and pricing. I was about to give up and just do a google ads campaign, which was going to take me longer and probably more expensive..but then I found PickFu and gave it shot! I loved how easy was to do my website design tests and get a clear winner, quickly and cost effectively. In addition, I received great customer service with a mistake I made. I highly recommend PickFu!
An awesome service for instant split testing! If you're not split testing your main images etc, you are missing out on a lot of money! is so far the best focus group and the split-testing website I have ever seen. We use it to test different product modification ideas, split-test images for better click-through rates, test what brand logo appeals best to our exact target audience. We can test everything and make sure to have the best conversion possible before spending a dime on Amazon PPC and other paid traffic. The results from the focus group of your choice are available within 1 hour with written detailed reasons why they choose one or the other option. This solution has the potential to save hundreds if not thousands of dollars in PPC costs and lost sales.
As an Amazon seller, PickFu's split testing for Amazon product images are a godsend. To be able to gather feedback with the reasons for why one image is chosen over another from actual Amazon Prime customers in less than 15 minutes literally saved us thousands in lost sales by picking the right image from the get go. The investment pays off quite easily
Pick Fu is a very powerful tool as it allows users to split test different images and designs which can have a massive impact on your business. Leaving you with no guesswork which can save you lots of money and time from testing.
Join us on 10/7 at 2PM EST for a breakdown of the future of split testing with PickFu for eCommerce. 
We love PicKFu because of its unbiased real-time feedback.  
They help our customers make more informed decisions about which images to use on their e-commerce sites.
PickFu allows them to maximize conversion rates instead of losing time whilst split testing images. 
Orange Klik welcomes PickFu to Demo Mondays for a walkthrough of their split testing tool! 

With almost 500 million products on Amazon, how do you stand out from the crowd? Split testing is one of the most effective means to optimize your Amazon product listings and increase engagement and sales on your products.

See Split Testing in Action Start your Amazon Split Test

What is split testing on Amazon?

Split testing on Amazon is an experiment between two or more variations to see which variation in the set performs best. For Amazon split testing, you might test variations of your product name, different Amazon listing photos, or versions of product copy. Split testing is also known as A/B testing because there is a version called A and a version called B. (If you add a third and fourth version, it’s called an A/B/C/D test).

Option A vs. Option B

Amazon split testing tool

Traditional split tests direct a portion of your Amazon traffic to one test variation and another portion to a different variation. After the test, you compare how shoppers behaved with each variation. For instance, on average, did one set of visitors browse for longer? Did one set convert at a higher rate?

Many split testing tools exist to help sellers run split testing on Amazon, including Splitly, Listing Dojo, and Cashcowpro.

However, the traditional Amazon split tests that these tools offer have some limitations:

  • For one, in order to gather enough data to make an informed decision, you have to accrue enough traffic to test.
  • In order to do this, you’ll probably need to pay to promote your products on Amazon, which can become expensive.
  • The tests also may take quite a bit of time, depending on the traffic levels. Splitly, for example, requires a minimum of seven days.
  • Further, because you’re using live traffic for your test, you risk seeing an adverse effect on sales or search ranking if a test variation performs worse than your current listing.

Split testing on Amazon using PickFu

PickFu is a polling software that enables you to quickly test elements of your Amazon listing with audiences that match your customer profile and target demographics. For example, you could be split testing product copy, or try image split testing with variations of your main photo.

Differences between live split testing and PickFu polling

  • Traditional split tests use Amazon shoppers as they are shopping as test subjects.
    • The PickFu Panel is comprised of U.S.-based respondents who are paid a small stipend to answer your poll. A popular audience available to test on PickFu is Amazon Prime members. However, a PickFu split test is conducted outside of the Amazon marketplace, so there may be variances between the PickFu Panel and Amazon shopper demographics.
  • When running a traditional split test, Amazon shoppers are not aware that their behavior is being monitored. They do not know that there are other versions of your listing other than the one they are seeing.
    • On PickFu, the Panel sees all variations in order to compare them and provide their feedback. Not only does each respondent vote on the variation they like best, but they each also provide a written comment explaining why they chose their preferred option. These written comments provide insight into what works with shoppers to help guide your decisions.
  • Traditional split tests often take days or weeks to complete.
    • Using PickFu, most polls complete in less than 15 minutes.
  • The cost of traditional split testing on Amazon is often unpredictable. You need to pay for the testing software you’re using to split test, as well as the cost of the ads you’re running to build traffic. In addition, you risk losing revenue with a live test if one version has an adverse effect on sales.
    • With PickFu, the cost is a flat fee. Polling starts at $50 but changes with different options you can use to customize your poll.
  • Traditional split tests use live Amazon listings.
    • On PickFu, your product does not need to be live on Amazon. You can test product variations such as color options or design before going into production. Get a sense of what shoppers want before committing to inventory. Or try Amazon package testing by perfecting your packaging with PickFu’s audience.
  • Traditional split tests can only compare variations of your own Amazon listings.
    • Using PickFu, you can perform competitive analysis by polling your listing against competing listings. Gain insight into how your product fares against category leaders. Split testing product copy is especially effective with competitors.

What can you split test?

Using PickFu, you can test every element of your Amazon listings, such as

  • product names
  • photography, especially the listing’s featured photo
  • product descriptions
  • packaging design
  • product videos
  • product bonuses or add-ons
  • ad headlines and copy

Our split testing software in action

Split tests of product photos

A split test with 50 general population respondents that took 26 minutes. See full results here
A split test conducted with 50 Amazon Prime members. Results took 30 minutes.
Split test of exercise equipment with 50 females. Can you guess which one won?

Split tests of physical product design

50-respondent poll for product design. Results took 24 minutes.
4-option product design poll with 50 females. Results came back in under an hour.
50-respondent poll for an olive oil dispenser. Results completed in only 13 minutes.

Split tests of product names and brand names

Split test with 50 females asked to rank three potential names for a natural skin care brand
50-respondent poll to rank names of an e-commerce store
50 respondents who live in suburbs voted in thishead-to-head poll for a high-end baby brand

You can also test product descriptions and whole product listings by including links in your polls. Want to see more e-commerce split tests? Explore our gallery of polls, then get started with your own Amazon split test!

Why would you run a split test on Amazon?

The purpose of running a split test on Amazon is to improve your click-through rate and increase sales. By taking a critical look at all aspects of your product listing, FBA sellers and brands work to satisfy the needs of shoppers as well as optimize for the A9 algorithm.

Should I run more than one split test at a time?

Running more than one test at a time is not recommended. However, you can run a multivariate test, which means in a single test you change more than one variable. The difficulty is that when you make multiple changes at once, it is difficult to pinpoint which change improved your KPIs. Usually, limiting your split test to a single change provides the most definitive results.

How many factors can attribute to an increase in conversion rates on Amazon?

Thousands of factors can change your Amazon conversion rate. Most split-testing tools like PickFu look at factors within a seller’s control, including the main image, product title, and product description. However, externalities can also affect your conversion rate, including market competition, price, seller reputation, political climate, external marketing, seasonality, and promotional periods. Each factor in its own way can change the mindset of an online shopper, thereby increasing or decreasing your conversion rate.

Subscribe for 15% off

Sign up for our newsletter and immediately get a coupon for 15% off your first poll.

Start a Poll

or read more about how PickFu works