In order to serve shoppers better, we need to understand and measure whether customers find changes we make to our products helpful. A platform developed by Leanplum has given us this ability to see how customers respond to small and large changes to our apps. The platform’s ease of use, coupled with some excellent support from the Leanplum team, has helped us to increase our rate of A/B testing and has enhanced our learning of customer behavior on apps.
Lee Mullins,
Optimization Manager at Tesco UK
Challenge
Tesco wanted to improve the number of conversions coming from the product details page within its app.
Tesco is constantly striving to simplify the shopping journey for its customers. Due to the amount of feature details customers want to see, and the legally required information, the product details section became cumbersome. The long page meant the static “add to cart” button was pushed far down the page. As a result, it was not clear to customers how to purchase items.
Test
Tesco ran a series of A/B tests to help shoppers add items to their carts.
Test #1
To keep things simple for its customers, Tesco introduced a persistent “add to cart” button that was always present at the bottom of the screen. Tesco’s hypothesis was that no matter how much users scrolled, the ability to purchase an item would always be within sight.
To validate its hypothesis, Tesco created a mobile A/B test with the following “add to cart” buttons:
— A new locked button (the variant)
Initial Results
From this first test, items added to the cart decreased by a disappointing 19 percent. Analyzing the results, Tesco wondered if the locked button wasn’t obvious enough at the bottom of the screen. As the locked button was shown as the default option upon the initial page load, users possibly reacted with “banner blindness” when they didn’t see the button in its usual location.
Testing
Tesco reinstituted the original static button and set up a second test. The new test contained two “add to cart” buttons, combined into one experience.
A static button (the control)
The static button above, plus a scrolling button that appeared once a user began to move down the page Tesco hoped that displaying a static button upon the initial page load, and locking the button once a user started to scroll, would increase the instances of users adding to cart from the product details page. They theorized this hybrid approach would deliver the best of both worlds.
Why Tesco trusts Leanplum
Tesco saw a 3.3 percent increase from the original data in items added to cart from the product details page. Tesco rolled out this new version to 100 percent of its iPhone app users. Now that Tesco has optimized the placement of the button, it’s testing the CTA verbiage to continue to improve the app’s purchase rate.
About Tesco
Tesco, the second-largest retailer in the world, is a British multinational supermarket that sells groceries and general merchandise. In addition to its brick-and-mortar locations, shoppers can purchase Tesco products on the company’s UK mobile grocery app, from the comfort of their own homes.
