Remove A/B Testing Remove Definition Remove Metrics
article thumbnail

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

This is why you can’t add up your A/B test results. If you’re at a company that A/B tests everything and then announces the great results – that’s wonderful, of course, but just run the thought experiment of summing together all of those A/B tests. Rarely does it match.

article thumbnail

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included!

Andrew Chen

Of course, as an investor you can’t run A/B tests or analyze results directly, but you can form hypotheses, ideate, and apply the same type of thinking. Thinking about new user experience, engagement metrics, and other important concepts. The problem is that the Growth Accounting Framework provides for lagging metrics.

Metrics 111
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

a16z Podcast: Why paid marketing sucks, Network effects, Viral Growth, and more

Andrew Chen

And we cover everything from the basics of growth and defining key metrics to know, to the nuances of paid vs organic marketing and the role of network effects and more. Sometimes aren’t these metrics ways to figure that out or is this all when you have product-market fit… like is there a pre- and a post- difference between these?

article thumbnail

What to look for when you’re hiring a Head of Growth

Andrew Chen

This is where the classical definition of a “network effect” is wrong. Roadmap : Testing a series of more scalable growth channels, showing that if one network can be built, then multiple networks might be launched as well. There were projects to help with A/B testing (Morpheus!),

Scaling 82
article thumbnail

Organizational Development: Theories on Organizational Change

Walk Me

The definition of organizational development comes in three sections : Uses a critical/ science-based process – Scientific and intensive market research is the basis for organizational development processes. Although we can include individual and group interventions within this, they are all achieved from the organizational perspective.

article thumbnail

28 ways to grow supply in a marketplace — by Lenny Rachitsky, ex-Airbnb

Andrew Chen

Converting travelers to hosts definitely moved the needle when we launched a new market. The biggest gains in optimization don’t come from brute-force A/B tests, but from trying to understand the real barriers to people using your product. Retention metrics roundup of articles and links by Andrew Chen. Airbnb Germany.

article thumbnail

28 ways to grow supply in a marketplace — by Lenny Rachitsky, ex-Airbnb

Andrew Chen

Converting travelers to hosts definitely moved the needle when we launched a new market. The biggest gains in optimization don’t come from brute-force A/B tests, but from trying to understand the real barriers to people using your product. Retention metrics roundup of articles and links by Andrew Chen. Airbnb Germany.