article thumbnail

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

This is why you can’t add up your A/B test results. If you’re at a company that A/B tests everything and then announces the great results – that’s wonderful, of course, but just run the thought experiment of summing together all of those A/B tests. Rarely does it match.

article thumbnail

2018 essay collection on growth metrics, marketplaces, viral growth in the enterprise, and more (PDF included)

Andrew Chen

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included! The deck unpacks a lot of different topics: How “growth accounting” metrics are great, but are lagging indicators. DAU/MAU is an important metric to measure engagement, but here’s where it fails.

Metrics 80
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included!

Andrew Chen

Of course, as an investor you can’t run A/B tests or analyze results directly, but you can form hypotheses, ideate, and apply the same type of thinking. Thinking about new user experience, engagement metrics, and other important concepts. The problem is that the Growth Accounting Framework provides for lagging metrics.

Metrics 111
article thumbnail

2018 essay collection on growth metrics, marketplaces, viral growth in the enterprise, and more (PDF included)

Andrew Chen

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included! The deck unpacks a lot of different topics: How “growth accounting” metrics are great, but are lagging indicators. DAU/MAU is an important metric to measure engagement, but here’s where it fails.

Metrics 40
article thumbnail

How to break into Silicon Valley

Andrew Chen

In my case, I was very interested in the state of the art on growing users, metrics, network effects, and marketing. I had a superpower in my domain knowledge of CAC, A/B testing, funnel optimization, lead gen, etc, and began to merge all of this thinking with consumer products.

article thumbnail

The 3 Pillars of an Effective Data Management Strategy: Monitoring, Tracking, and Reporting

SME Strategy

For instance, in Marketing, data is being used to calculate ROI on marketing campaigns, or come up with new pricing strategies based on A/B testing of campaigns which helps marketing and managers bring in more revenue, and stay ahead of the competition.

article thumbnail

How to design a referral program

Andrew Chen

These larger headline numbers always tested much better on A/B tests, whether in email marketing or banner form, and while it might feel like the reward becomes unattainable, it’s possible to create a second or third or fourth tier to go along with the big headline number. The Payback.