Experimentation Program
A formal structure and culture within an organization dedicated to continuous learning through testing.
Keywords:
experimentation program, culture of experimentation
Contents
Deep Dive
Metaphysical Synthesis & Analysis
The Synthesis
An experimentation program is the organizational capability to run A/B tests at scale. Ronny Kohavi's work at Microsoft and Amazon shows that mature experimentation programs run hundreds of tests simultaneously. For PMs, this requires infrastructure (testing platforms), culture (hypothesis-driven thinking), and process (experiment review). The best programs have low friction: anyone can run a test.
Metaphysical Foundation
An experimentation program is the institutionalization of learning. It makes testing the default, not the exception.
Evolutionary Path
From occasional tests to continuous experimentation to automated optimization, testing has become more systematic and scalable.
Strategic Interplays
Experimentation programs enable Ab Testing at scale. They power the learning-engine and inform product-discovery.