Useful Tips

Test progressing slowly?

If you are not receiving enough traffic to your product listings, paid advertising campaigns on social media can be an excellent way to drive traffic, which will increase the overall effectiveness of your A/B testing. Shopify also has a very helpful Blog about ways you can increase your site’s traffic below:

https://www.shopify.com/blog/how-to-increase-website-traffic

Modifying product listings during a test, ruins data!

It is best practice to never modify a product listing outside of our app when you have a running test for that same product. This could lead to multiple variable changes during the duration of a test, which would make it impossible to know which variable change helped or hurt the overall test performance.

“In an experiment, scientists only test one variable at a time to ensure the results can be attributed to that variable. If more than one variable is changed, scientists cannot attribute the changes to one cause.”

-Google AI

Price testing strategies

When performing price tests, it’s best to select prices that are somewhat close together:

 

Once a price test ends, if you notice the lowest price point yielded the highest “Average Profit Per View”, you may want to run another test decreasing the price points lower (such as $50, $49 $48 in the next test), after receiving results like this:

However, if you notice the highest price point tested yielded the highest “Average Profit Per View”, you may want to run another test increasing the price points even higher (such as $50, $51, $52 in the next test), after receiving results like this: