Conversion

A huge thank you to everyone who joined us! Over the past month, we hosted two incredible roundtable dinners in London and Leeds, exploring the future of experimentation, AI, and optimisation. These events were a fantastic opportunity to share ideas, tackle big questions like securing senior buy-in or scaling experimentation teams, and enjoy great conversations over amazing food. It's been great to return to in-person events this year; nothing compares to the energy of real, face-to-face discussions. We’re already planning next year’s events—stay tuned if you’d like to join the conversation in 2024! #experimentation #CRO #networking #innovation

𝗗𝗶𝘀𝗰𝗼𝘃𝗲𝗿 𝘁𝗵𝗲 𝗘𝘅𝗽𝗲𝗿𝘁𝗶𝘀𝗲 𝗼𝗳 𝗢𝘂𝗿 𝗧𝗲𝗮𝗺 𝗼𝗻 𝗟𝗶𝗻𝗸𝗲𝗱𝗜𝗻! Recently, some of our team have been sharing their knowledge and insights, so we've rounded them up for you! Here’s a sneak peek: Steph Le Prevost You can and should be using experimentation to optimise and change your business. https://lnkd.in/eVAVjC93 Sim Lenz Experimentation prioritisation is broken. Here’s How to Fix It. https://lnkd.in/e-GCxcja Frazer Mawson: Does an optimization program's win rate diminish over time? https://lnkd.in/eK5UWP_B Jamie Lewis 5 Tips for Designing Small Experiments That Deliver Big Results 🌟 https://lnkd.in/eaPfHVtf Shruti D. It’s that time of the year…Black Friday season is here! 🛍️ https://lnkd.in/esM-uj4D #cro #experimentation #personalization #weboptimization

Ready for your next opportunity? We're hiring! 👇

Keeping Up with Us: Your Go-To Guide! 🌟 We've got you covered with the latest scoop on how to stay connected with all our updates, innovations, and exciting news. 1 - Right here on LinkedIn (make sure you’re following to stay up to date with Conversion) 2 - Levers Framework Whitepaper (the secrets behind our competitive edge at Conversion) 3 - Conversion Newsletter (the best way to keep up to date with our latest blog posts, events and industry news) 4 - Conversion Blog (the most reliable source for our interesting insights and brand-new protocols) 5 - A/B Tests Statistical Calculator (before and after you run a test, it will help you define the sample size, length of test and MDE) #exprimentation #CRO #Conversion

Research, strategy, ideation, build. We’d followed the playbook to the letter. With comprehensive research, detailed strategy, innovative ideation, and a carefully executed build, everything seemed primed for success. But when the test results came in? Flat. It was a humbling moment but also an opportunity. Because in experimentation, a flat result isn’t the end of the story; it’s just the beginning of deeper learning. We transformed that initial flat outcome into a series of meaningful, measurable wins through iteration, optimisation, and a relentless focus on understanding the “why” behind the numbers. These wins exceeded expectations and created significant value for our client in the long term. Check out the slides below to see how we turned a potential setback into a breakthrough. #experimentation #conversionrateoptimization

Michael St Laurent looked into the question 🧠 "How often should I expect large lifts?" or any kind of Lift, for that matter. Leveraging our test repository at Conversion. A/B testing is a game of placing bets. Each time we run an experiment, we get a chance at a certain payoff. But how often can you expect different payouts to hit? We took a random sampling of 2,000 experiments from our database. These tests are run across a variety of industries, business models and traffic volumes. Some interesting findings and benchmarks... 1) More than 1/2 of tests you run will likely have an effect <5% either direction. A simple reality of testing and sobering evidence that half of the ideas that people apply to their business are unlikely to move the needle substantially. 2) The distribution is pretty close to a bell curve, implying the most important lever is to place more bets (run more tests). This doesn't mean you can't influence your win rate, though. The shape of your curve will be a reflection of the quality of output from your testing program and the sample sizes you are testing with. Ex. Larger companies will be more skewed towards the middle. This data is a cross-section from all sorts of sizes. Interestingly, the data is skewed positive on everything more than 5% - Implying people designing the tests are more likely to win big than miss big (my hypothesis at least). 3) You can see how challenging it is to have large lift in the positive direction. If these happen often in your program you should treat them with extra scrutiny and consider re-runs to validate. If your boss is asking you where the 30% lifts are you can let them know they only happen about 1/50 experiments (according to this particular data set) - so you have to run some more 😅 ... If they are happening more often in your program you are very likely under-powering your experiments which is exaggerating your effect size (you need more traffic/sample). #product #digitalmarketing #experimentation

Celebrating Excellence: Our Quarterly Award Winners! 🎉 It’s time to say “Thank You!” and recognize some of the outstanding contributions of our team members ❤️ Raising the Bar 🙌  Dasha Pogrebinsky Dasha has been absolutely crushing it lately. She is committed to hard work and self improvement for the company. She has driven opportunities and conversations for us with other brands, is proactive and not afraid to try new things, and shows a ton of grit while doing so. She also advocated for us hosting our first Vancouver event, organizing what turned out to be an incredibly successful night! Dasha truly raises the bar, outside of the day-to-day work too. Awesome @ Being Awesome 😎 Bre Mirynech Bre has noticeably stepped up in the last quarter, taking on tasks and responsibilities outside of her direct role. She was an initial driver of our social media push this past quarter, and has really embraced vulnerability in conversations. Her outstanding recruitment efforts led to successfully hiring two of our hardest roles to fill, along with filling other roles well below the industry standard time. She is super reliable when it comes to getting things done and is a key contributor to our culture! Super Squad 💥 Sylvia Chan & Austin Soboleski This past quarter our Design time was operating extremely short handed, but every day both Sylvia and Austin tackled their work with a huge smile, awesome attitude, and demonstrated excitement to help with additional tasks for sales and marketing. Huge shoutout to these two, a truly dynamic duo! Shruti D., Jaleesa Chagan, Alex Mason & Matt Wright This team has shown that we can go beyond the defined product scope by helping smaller clients, who may not have sufficient traffic for testing, to create high performance websites. We have a client who is back for another project because of their efforts and hard work, and we are looking forward to watching this team continue to establish strong relationships!

🪒 Gillette is one of the world’s leading providers of shaving products… …but is its website UX as sharp as its razors? We wanted to find out, so we used our Levers™ Framework to perform a heuristic analysis on Gillette’s product pages. Click through the slides below to see the results! #experimentation #UX #digitalmarketing

For many online brands, Black Friday and Cyber Monday are defining moments that set the tone for a successful holiday season. The most successful brands approach this critical period with a rigorous, data-driven strategy. By testing and fine-tuning every component of their promotional approach, these teams ensure that each element is purposefully aligned with business goals—from audience targeting and messaging to pricing, discount strategies, and ad placements. In the carousel below, we introduce a high-impact experiment idea that can help you start building a finely tuned, results-focused promotional strategy. This framework is designed to give your team insights into what resonates most with your audience, helping you maximize conversions and drive sustained growth during your peak season. Have you been experimenting in the run-up to Black Friday and Cyber Monday? #experimentation #conversionrateoptimization #cro

Wish you could read your customers' minds? Painted door tests might be the next best thing! We’re all about helping brands make data-backed decisions, and our latest blog dives deep into this experimentation tool. Painted door tests allow companies to gauge customer interest before fully investing in new features or ideas—saving time, resources, and ensuring a more impactful rollout. Used in the right way and as part of a full experimentation programme painted door tests can be a great tool. Our latest blog (just a 5/8 minute read) explores how painted door tests can guide smarter,customer-driven decisions! (Including real examples from Dominos!) https://lnkd.in/eAKaesVt #painteddoortest #userresearch #productdevelopment #cro