article thumbnail

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

This is why you can’t add up your A/B test results. If you’re at a company that A/B tests everything and then announces the great results – that’s wonderful, of course, but just run the thought experiment of summing together all of those A/B tests. Rarely does it match.

article thumbnail

2018 essay collection on growth metrics, marketplaces, viral growth in the enterprise, and more (PDF included)

Andrew Chen

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included! The deck unpacks a lot of different topics: How “growth accounting” metrics are great, but are lagging indicators. DAU/MAU is an important metric to measure engagement, but here’s where it fails.

Metrics 80
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

2018 essay collection on growth metrics, marketplaces, viral growth in the enterprise, and more (PDF included)

Andrew Chen

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included! The deck unpacks a lot of different topics: How “growth accounting” metrics are great, but are lagging indicators. DAU/MAU is an important metric to measure engagement, but here’s where it fails.

Metrics 40
article thumbnail

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included!

Andrew Chen

Of course, as an investor you can’t run A/B tests or analyze results directly, but you can form hypotheses, ideate, and apply the same type of thinking. Thinking about new user experience, engagement metrics, and other important concepts. The problem is that the Growth Accounting Framework provides for lagging metrics.

Metrics 111
article thumbnail

Performance Appraisal Systems: Everything You Need to Know

15Five

The objective is what the business or employee wants to achieve, and the key results are measurable metrics that show how well the business or individual is accomplishing the objectives. Implementation: Companies can implement forced ranking by establishing clear performance criteria and using objective metrics to evaluate employees.

Scaling 52
article thumbnail

How to break into Silicon Valley

Andrew Chen

In my case, I was very interested in the state of the art on growing users, metrics, network effects, and marketing. I had a superpower in my domain knowledge of CAC, A/B testing, funnel optimization, lead gen, etc, and began to merge all of this thinking with consumer products.

article thumbnail

The 3 Pillars of an Effective Data Management Strategy: Monitoring, Tracking, and Reporting

SME Strategy

For instance, in Marketing, data is being used to calculate ROI on marketing campaigns, or come up with new pricing strategies based on A/B testing of campaigns which helps marketing and managers bring in more revenue, and stay ahead of the competition.