Since 2016, NS International has used A/B testing to improve conversions. After many results failed to replicate, the team—together with Professor Kobe Millet (VU Amsterdam)—revised its approach. By distinguishing between exploratory and confirmatory tests, applying stricter statistical standards, and testing more selectively, NS International shifted from volume to validity. This led to more reliable insights, stronger decisions, and a more transparent experimentation culture.
Category
Experimentation Culture
A successful experiment on its own is great, but it becomes even more significant when it is part of a sustainable bigger picture.
Examples of previous Experimentation Culture Winners
NS International
Debunking A/B testing illusions: the path to reliable results
TomTom
Navigate and Drive an Effective Experimentation Program
To boost experimentation culture, TomTom focused on three things:
-
Structured Process
Each sprint starts with clear growth topics. TomTom uses Miro framework to turn data into insights, themes, and new test ideas. Every topic leads to 3–4 concepts, pre-validated during the sprint. -
Decentralized Ownership
Teams manage their own Airtable experiment base, all linked to a central master file for full visibility. -
Continuous Navigation
Weekly D2C check-ins keep everyone aligned on progress, priorities, and outcomes.
Jury Conclusion
TomTom came out as the winner due to its structured, data-driven approach, strategic focus on growth areas, and effective quality control and tracking. The jury also valued the strong emphasis on motivating and involving employees in the experimentation process.
Submit case 2025
Questions?
If you have any questions about submitting a case, please contact DDMA:
Email: merelbracht@ddma.nl
Phone: +31 20 452 84 13