Overview – CRO
In today’s fiercely competitive digital landscape, with businesses investing significant effort and resources to diligently acquire each click for their websites, it has never been more imperative to deploy a complementary strategy that ensures those hard-earned clicks result in significant conversions.
Conversion Rate Optimization (CRO) is a systematic approach to improving a website or digital platform by harnessing data-driven insights to refine the user experience, remove obstacles to conversion & increase the proportion of website visitors who evolve into valuable customers.
CRO & Hypus
With every hypothesis & iteration requiring extensive development & testing time, traditional CRO can often be an arduous & time consuming task. Poorly constructed testing frameworks and misinterpretation of the results can often lead to unvalidated and misleading conclusions and arguably a position of worse clarity than before.
As a unique digital marketing agency with a revolutionary scientific approach rooted in a deep commercial understanding and aided by best-in class technical skills, Hypus’s approach to CRO is fundamentally different to others in the market.
Hypus’s approach involves – where possible – using data driven insight to spot the leaks and opportunities to arrive at hypotheses that are almost 100% of the time correct before subsequently going on to test them. This cuts out many stages and iterations and saves valuable time and resources. Intuition-led improvement suggestions are also very valuable in any CRO project. For these, Hypus uses data -where possible – to support or counter the suggestion before putting them forward for testing.
By meticulously analysing user behaviour, testing different elements, and making data-backed adjustments, businesses can unlock the full potential of their digital presence. But, as with all data projects, the complexities of running a CRO initiative for reliable and validated results can be daunting. Navigating through the myriad of variables, potential issues, and noise in the data requires a well-structured methodology, a deep understanding of user behaviour, and great technical skill.
The Challenge
Client X is one of the fastest growing businesses in the UK. They offer a comprehensive range of luggage at hugely competitive prices with a fast & efficient shipping service. Hypus partnered with Client X over 5 years ago and have been hugely instrumental in helping them design and implement the optimal digital marketing strategy that has underpinned their rapid growth.
With such a strong offering and optimal digital marketing setup in place, Hypus felt that the time was right to focus on improving website conversion rates. A conversion rate of little over 1% (despite being normal within the online luggage space) felt wholly underwhelming for such a heavyweight in the luggage space.
When thinking about improving conversion rates, Hypus believes that it’s far more empowering and enlightening to think in terms of the 90%+ that are not converting and how this very large percentage can be reduced. Ascertaining what percentage of the 90%+ that didn’t convert is attributable to one of various obstacles to conversion, offers both an indication of the scope for improvement and a clear direction on where to begin searching for improvement.
In Client X’s case, Hypus began by determining that at the very least 10% of total website users were in immediate need of a piece of luggage. With a comprehensive range & highly competitive prices, there was therefore very little reason to believe that anything other than website design was causing many valuable users to bounce.
Hypus were convinced that with a very carefully designed data project, mindful of all the complexities involved, they could substantially & demonstrably improve the CR to add £m’s to topline revenue at no additional cost – every business’s dream.
The solution
Hypus – with a wealth of experience crafting & implementing data projects and solutions for clients – were well aware that a data project of this nature required meticulous strategic planning, perfect technical execution and a great awareness of the potential disruptions that could materialise in the dynamic world of digital marketing.
Forming a Hypothesis
The first stage of the project involved understanding which area of the website was the ideal place to begin focusing our work on. What we were looking for was for a feature/section of the website that:
1. was or could be a heavily-used part of the website – where improvements would be the most impactful
2. we could easily analyse user on-site behaviour allowing our suggested improvements to be predominantly data- driven rather than intuition led. Using a combination of Google Analytics (behaviour reports) and HotJar (digital experience insights and behaviour analytics) heatmaps, we identified the area of the website that best met the above criteria. We began using the associated data to form a hypothesis about which improvements would give the user the best possible experience and lead to improving conversion rates & revenue per user. With a detailed list of suggested improvements to the chosen website section – heavily backed by our team’s in depth analysis of user behaviour – we were ready to run some tests.
Test Design
We scoured the market for the most reliable website A/B testing tools that could host multiple versions of a website, randomly serving each version on a predefined percentage of the occasions that users requested the website. It was important too, that the A/B testing tool had good editing functionality allowing to rapidly draft the suggested improvements. We tested a couple of different options and settled on a tool that easily integrated with Google Analytics, as well as meeting our other requirements.
Initially, we decided to simply duplicate the original version of the website and run two identical versions of the website in an A/B test so that we could ascertain whether or not the A/B tool itself was reliable and whether or not running the tool’s code affected performance. After collecting enough data to confirm that indeed the A/B tool was satisfactory we set up an A/B test pitting our new improved website version against the original and awaited the results.
Troubleshooting
Bots
After an initial period with little disruption our test ran into its first issue. For a 3 day period we detected some very unusual session activity. On further examination it became apparent that it was most likely a bot attack that was skewing the data leading to much higher than usual bounce rate on one of the versions. A decision was made to disqualify the period from the test.
Fruit bugs
With the test back on track a couple of weeks passed until we were faced with our next challenge. There was a sudden discernible drop in performance on one of the versions of the website only, which was difficult to explain. Our data specialists dug deeper into the data and discovered that the drop in performance was isolated to safari browser users only, leading us to believe that a recent swathe of IOS updates was perhaps impacting our A/B testing tool, affecting the validity of the test. We decided to conduct a series of statistical tests, computing p-values for multiple segments of the data, split into smaller data ranges (yet still with significant data) and into different browsers. What we discovered confirmed our suspicions, that there was indeed statistically significant probability that the most recent IOS launch was preventing Safari browser users from being shown a particular version of the website. The call was made to disqualify this data too from the test.
Results & Analysis
With the test back on track and with significant data already accumulated we were now ready to analyse the impact of our suggested improvements to the chosen website section. We began by first isolating the data for each website version to include only where the users had interacted with the part of the website that was being tested. With this done, the results were ready to be quantified. Our new improved version of the website showed an astonishing 17.5% uplift in revenue over the original version. Using the previous 12 months’ revenue as a baseline this would translate into well over £700K of extra revenue over the coming 12 month period alone, with the figure reaching close to £900k based on previous growth projections of almost 25% for Client X over the coming period – see table 1 below.

Conclusions
Data projects, even after hypotheses and theories have been empirically substantiated & identified patterns successfully modelled, more often than not leave questions when it comes to measurement & quantification – leaving some still unconvinced about exactly how to proceed. It’s not often that a piece of data analysis measuring the impact of highly specific changes on a vastly complex and dynamic interface provides such clarity as to be undeniable.
The CRO project Hypus ran for Client X – not without its pitfalls and challenges that could have thrown it off course – provided Client X with exactly this type of clarity – offering an immediate pathway to £700k extra revenue within 1 year, at no extra cost.
And with the scope of how impactful to topline revenue a well constructed CRO project could be now in clear view, Hypus’s attention quickly turned to other parts of the website for the next phase of CRO.
