2017-2020 CRO UX and Interaction Testing

Improving the Mytheresa online shopping experience

Using controlled experiments to turn friction points into validated design improvements and measurable business impact.

TL;DR

Before starting the experimentation, I ran a heuristic analysis of the website and fixed measurement gaps in the analytics implementation. The heuristic analysis helped uncover specific points of friction and frame a number of test hypotheses. The proposed changes were A/B tested before the rollout.

Explore the case

Impact

Key outcomes

↑
+220%
Signups
↑
+25%
Search engagement
↑
+13%
Revenue / user
↑
+11%
Checkout CR

Approach

Small interactions. Big outcomes

The work addressed friction across several feature portfolios: acquisition, discovery, cart and checkout. Every design change had a clear behavioral hypothesis and was validated via rigorous testing.

Optimization framework

Identify

Locate a specific point of customer friction.

Hypothesize

Define the expected behavior change.

Experiment

Measure control and variant experiences.

Scale

Roll out improvements supported by evidence.

Evidence

Select experiments across the customer journey

01 · Acquisition

Direct NL signup

Hypothesis

Showing the email field upfront instead of a multipage newsletter signup process will dramatically increase the number of newsletter subscriptions.

A/B Test results

+220% Signups
Control
Multipage signup control
Variant
Direct signup variant
02 · Discovery

Search bar design

Hypothesis

Expanding the search field on mobile will result in a higher number of users engaging with this feature leading to increased product detail views.

A/B Test results

+25% Engagement
+11% PDP views
Control
Collapsed search control
Variant
Expanded search variant
03 · Purchase

Buy now on PDP

Hypothesis

Giving customers allocated to the Express segment an option to buy in one click will simplify the user experience and will result in a higher conversion rate.

A/B Test results

+6.2% E-commerce CR
Control
Standard product page control
Variant
Buy now product page variant
04 · Basket value

Minimum order value notification

Hypothesis

Showing a message informing customers about the free shipping threshold will motivate them to buy more items and complete their purchase.

A/B Test results

+13% Revenue / user
+5.3% E-commerce CR
Control
Bag control
Variant
Free-shipping threshold variant
05 · Checkout

Checkout usability

Hypothesis

Improving the usability of the forms in the checkout will make it easier for the users to complete the process, thus increasing the checkout conversion rate.

A/B Test results

+11% Checkout CR
Control
Checkout form control
Variant
Improved checkout form variant