Experimentation Masters
Experimentation Masters is a podcast focused on product experimentation. It shares practical tips, methods, and techniques from leading experts in the field. Listeners learn how to design better experiments, lead with more confidence, and create greater impact in their organizations. The show helps teams learn faster and make better decisions through experimentation.
Episodes
EP025 - Bjarn Brunenberg - TomTom - A Strategic Experimentation Framework
Send us FeedbackBjarn Brunenberg, Experimentation Lead, TomTom shares his strategic framework for experimentation. Bjarn discusses what a strategic experimentation framework is, why it's important to use a strategic approach for experimentation to maximise impact, and, from a practical sense, how a strategic experimentation framework can be used in your organisation.---Bjarn Brunenberg is the
EP024 - Melanie Kyrklund - Specsavers - Establishing a Global Experimentation Centre of Excellence
Send us FeedbackMelanie Kyrklund, Global Head of Experimentation, Specsavers shares her personal journey of establishing a global Centre of Excellence experimentation operating model at Specsavers. Melanie discusses the business triggers for the change, the planning and preparation involved, and the key measures of success for the transition.---Melanie Kyrklund is the Global Head of Experimentatio
EP023 - Tracey Reed - Air New Zealand - Creating The Airline Of The Future With Experimentation
Send us FeedbackTracey Reed, Senior Conversion Optimisation Specialist, Air New Zealand discusses how the airline uses experimentation to create elite customer experiences. Tracey shares how to solve the right customer problems, influencing for impact at multiple levels of your organisation and why experimentation needs to be less confronting for the uninitiated.---Tracey Reed is a Senior CRO Spec
EP022 - Adam Furness - Designing Growth Experiments: Experiences Your Customers Will Love & Pay For
Send us FeedbackIn this episode of the podcast, Adam Furness, Design Manager - Growth, Atlassian discusses Designing Growth Experiments: Experiences Your Customers Will Love & Pay For. Adam shares why Good and Fast can co-exist, Atlassian's Good, Better, Best Framework and how designers build confidence around a new opportunity.--- Adam Furness has spent 10+ years leading world-class prod
EP021 - Sunita Verma - H&M - Mindset Over Metrics: Using Experimentation To Develop A Data-Driven Culture
Send us FeedbackIn this episode of the podcast, Sunita Verma, Test & Learn Specialist, H&M discusses why mindsets and relationship building matters the most when developing an experimentation culture. Sunita shares insights on managing a global experimentation program, how to start small and make a fast start and gaining stakeholder confidence to impact bigger strategic decisions.---Sunita
EP020 - Ken Kutyn - Amplitude - Developing High-Velocity Experimentation
Send us FeedbackIn this episode of the podcast, Ken Kutyn, Principal Solutions Engineer, Amplitude discusses how to develop high-velocity experimentation in your organisation. Ken shares what a good experimentation program strategy looks like, laying a solid foundation for experimentation and critical steps for scaled experimentation.---Ken Kutyn is a Principal Solutions Engineer at Amplitude Anal
EP019 - Jonas Alves - ABsmartly - Building & Scaling A World-Class Experimentation Platform
Send us FeedbackIn this episode of the podcast, Jonas Alves, CEO ABsmartly, discusses building and scaling one of the world's leading experimentation platforms. Jonas shares why you need to keep experimentation simple, worrying less about experiment interaction effects and future directions for ABsmartly and the experimentation industry.---Jonas Alves is the CEO and co-founder of ABsmartly, a
EP018 - Aleksander Fabijan - The Experimentation Flywheel - Growing A/B Testing Momentum at Scale
Send us FeedbackIn this episode of the podcast, Aleksander Fabijan, Senior Product Manager Microsoft Experimentation Platform (ExP) team, provides practical strategies and lessons from his paper - It Takes a Flywheel to Fly: Kickstarting & Growing A/B Testing Momentum at Scale. Alex shares how to use the five-step experimentation flywheel to increase experimentation velocity in your organisati
EP017 - Erin Weigel - How To Design Effective Product Experiments
Send us FeedbackIn this episode of the podcast, Erin Weigel, Senior Group Design Product Manager provides an overview of the journey and challenges of writing her new book Design for Impact: Your Guide to Designing Effective Product Experiments. We discuss some of the key points that stood out when reading Erin's book.---Erin Weigel is currently Senior Group Design Product Manager, responsibl
EP016 - Matt Mulvey - Transforming Customer Experience at British Airways
Send us FeedbackIn this episode of the podcast, Matt Mulvey, Senior Experimentation Specialist at British Airways, shares how the UK's flagship airline is undergoing an innovation renaissance with its £7B Transformation Project. Learn how one of the world’s leading airlines plans to transform and improve customer experience.---Matt Mulvey is a Digital Experimentation Specialist at British Air
EP015 - Jason van der Merwe - How Strava Use Negative Experiments To Create More Customer Value
Send us FeedbackIn this episode of the podcast, Jason van der Merwe, Director of Engineering and Growth at Strava, provides some practical tips and lessons on performing negative experiments. Jason shares how Strava use negative experiments to remove elements of the user experience to measure impacts on customer behaviour. Negative experiments are a great way to dispel organisational assumptions,
EP014 Lukas Vermeer - A Global Leader in Online Experimentation
Send us FeedbackLukas Vermeer is widely acknowledged as a global leader in the field of online experimentation. He is best known for his work establishing the world-leading experimentation program at Booking.com. Lukas is an expert at establishing and scaling experimentation and is currently the Director of Experimentation at Vista. ---Lukas has co-authored many influential academic papers on exp
EP013 - Vishal Kapoor - Marketplace Experimentation: Zero to One (Part 2)
Send us FeedbackPicking up from Part One of this episode, Vishal Kapoor discusses why you need to be more surgical with experimentation when testing big bets, how marketplace experiments can set off a vicious cycle and why it's difficult to use scenario modelling to predict real-world marketplace outcomes. All this, on top of more practical experimentation tips and techniques.---Vishal Kapoor
EP012 - Vishal Kapoor - Marketplace Experimentation: Zero to One (Part 1)
Send us FeedbackVishal Kapoor is the Director of Product at Shipt. Vishal has built, launched, and scaled next-generation consumer products that have generated billions in revenue at Zynga, Lyft and Shipt. In this episode, he provides a practical masterclass on Marketplace Experimentation.---Vishal Kapoor is Director of Product at Shipt. Shipt, owned by Target Corporation, is a marketplace that fa
EP011 - Sebastien Polis - Fast-Scaling Experimentation at FinTech Dojo
Send us FeedbackSebastien Polis is the Experimentation Lead at Dojo. Sebastien knows a thing or two about creating impact with experimentation in startups and large enterprise. Hear how he has established and scaled experimentation at high-growth B2B2C FinTech Dojo.----Sebastien Polis is the Experimentation Lead at Dojo. Dojo is a UK based Fin Tech company that provides payment services to Small a
EP010 - Rohan Katyal - Yelp: A Story Of Building An Experimentation Program
Send us FeedbackRohan Katyal was the Senior PM, Experimentation at Yelp. He shares his personal story of building and growing the experimentation program from ground up at Yelp. Rohan’s approach to democratising experimentation is the subject of a Harvard Business School case study.----Rohan is a Product Manager at Facebook (Meta) working in the New Product Experimentation (NPE) team with a focus
EP009 - Denise Visser - Lessons From The Award Winning bol.com Experimentation Program
Send us FeedbackDenise Visser is the captain of the award winning experimentation program at bol.com. In this episode, we learn how Denise established and grew the bol.com experimentation program from less than 100 experiments in 2018, to more than 1,000 experiments p.a. in 2022.Denise Visser is the Product Experimentation Manager at bol.com. bol.com is the largest eCommerce business in the Nether
EP008 - Justin Porcano - How Upwell Design Hacked IKEA To Test The Walhub
Send us FeedbackJustin Porcano share how he creates experiments and experience prototypes to quickly understand user needs and use cases for solving problems. In this episode, we learn how Justin hacked IKEA to perform an experiment to test a new product idea, the Walhub.Justin Porcano is a Senior Industrial Design Manager at Fjord/Accenture. He has 13 years-experience designing consumer electroni
EP007 - Ruben de Boer - A Change Management Framework For Experimentation
Send us FeedbackRuben de Boer uses the principles of behavioural psychology to elicit organisational transformation to successfully embed experimentation programs in complex businesses . In this episode, we discuss Ruben's four quadrant framework for effective experimentation program change management.Ruben is Lead Conversion Manager and consultant at Online Dialogue. He has been working in e
EP006 - Michael Luca - The Power of Experiments: Decision-Making in a Data-Driven World
Send us FeedbackMichael Luca is an Associate Professor at Harvard Business School and co-author of the book The Power of Experiments: Decision-Making in a Data-Driven World. In this episode we learn how eBay saved $50M by stopping paid advertising, how Airbnb overlooked second and third order effects of experimentation and why Uber changed their experimentation strategy.Michael's research, te
EP005 - James Slatyer - Accelerating Experimentation at Australia’s #1 Online Real Estate Marketplace
Send us FeedbackJames Slatyer knows how to successfully navigate large, complex organisations to create impact with experimentation . In this episode, we discuss how he established experimentation at REA Group, Australia's #1 online real estate advertiser (realestate.com.au).James is the Head of Product (Membership) at REA Group. For the past 10 years he has held a variety of Digital Leadersh
EP004 - Jonny Longden - Scaling Experimentation at Sky
Send us FeedbackJonny Longden knows how to implement and scale experimentation programs in complex matrix organisations. In this episode, we discuss how he established and scaled the experimentation team at Sky, including some of the hurdles and challenges he encountered along the way.Jonny Longden is Conversion Director at Journey Further, a performance marketing agency that works with the world’
EP003 - Eden Bidani - Creating a Killer Value Proposition
Send us FeedbackEden Bidani knows how to get businesses noticed, drive traffic and convert more customers. In this episode, she teaches us how to develop a value proposition, why customer research is critical in forming a strong proposition and strategies for testing your value proposition.Eden Bidani is the founder of Greenlight Copy, an agency that helps companies develop smart messaging strateg
EP002 - Kate Sutton - Experimentation at the United Nations
Send us FeedbackKate Sutton knows what it takes to solve some of the world's toughest humanitarian challenges. In this episode, she teaches us how to innovate successfully in the public sector, how to use experiments to create learning loops and why sustainable scaling is so important.Kate Sutton is the Head of Innovation Centre, Bangkok, for the United Nations Development Program (UNDP). Pri
Product Experimentation Podcast (Trailer)
Send us FeedbackExperimentation Masters PodcastThe leading resource for product experimentation.Learn practical tips, methods and techniques from world-leading experts in experimentation.Design better experiments, lead with more confidence and have more impact in your organisation. Learn faster. Make better decisions.
