Remove A/B Testing Remove Definition Remove Metrics
article thumbnail

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

This is why you can’t add up your A/B test results. If you’re at a company that A/B tests everything and then announces the great results – that’s wonderful, of course, but just run the thought experiment of summing together all of those A/B tests. Rarely does it match.

article thumbnail

28 ways to grow supply in a marketplace — by Lenny Rachitsky, ex-Airbnb

Andrew Chen

Converting travelers to hosts definitely moved the needle when we launched a new market. The biggest gains in optimization don’t come from brute-force A/B tests, but from trying to understand the real barriers to people using your product. Retention metrics roundup of articles and links by Andrew Chen. Airbnb Germany.

Retention 111
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

What to look for when you’re hiring a Head of Growth

Andrew Chen

This is where the classical definition of a “network effect” is wrong. Roadmap : Testing a series of more scalable growth channels, showing that if one network can be built, then multiple networks might be launched as well. There were projects to help with A/B testing (Morpheus!),

Scaling 82
article thumbnail

Organizational Development: Theories on Organizational Change

Walk Me

The definition of organizational development comes in three sections : Uses a critical/ science-based process – Scientific and intensive market research is the basis for organizational development processes. Although we can include individual and group interventions within this, they are all achieved from the organizational perspective.

article thumbnail

28 ways to grow supply in a marketplace — by Lenny Rachitsky, ex-Airbnb

Andrew Chen

Converting travelers to hosts definitely moved the needle when we launched a new market. The biggest gains in optimization don’t come from brute-force A/B tests, but from trying to understand the real barriers to people using your product. Retention metrics roundup of articles and links by Andrew Chen. Airbnb Germany.

article thumbnail

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included!

Andrew Chen

Of course, as an investor you can’t run A/B tests or analyze results directly, but you can form hypotheses, ideate, and apply the same type of thinking. Thinking about new user experience, engagement metrics, and other important concepts. The problem is that the Growth Accounting Framework provides for lagging metrics.

Metrics 111
article thumbnail

Electing a President in a Microtargeted World

Harvard Business Review

Definitely the scale. In your work, do you only focus on the metrics side, or do you decide what sort of messaging would go out in targeted ads? So we'll do a lot of A/B testing with online ads. It definitely does, especially in the case of a new product entering the market.