article thumbnail

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

Then your revenue/installs/whatever goes up by +10% right? This is why you can’t add up your A/B test results. Similarly, this is a reason to be skeptical of vendors and 3rd parties who have case studies that’ll increase your revenue by X just because they increase their ad conversion rate (or whatever) by X.

article thumbnail

How to build a billion dollar digital marketplace – examples from Uber, eBay, Craigslist, and more

Andrew Chen

Since the 2014 article, Uber has blown past his estimate by 10X, with top line revenues to support it. Today, Craigslist in over 57,000 cities, generating $700M in revenue per year (on job listings fees!) Optimization : A/B testing growth levers – from email/SMS/push copy – to when/how to reach out.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Hypothesis-Driven Development and the Generalist Superhero

UVA Darden

The star analyst is now a data scientist, a private equity associate is tasked with reinventing a company’s IT instead of engineering its finances, and the marketer is now a “growth hacker” running A/B tests. In the tech world, we sometimes call these “traction roles.” In the MBA world, we call it “general management.”

article thumbnail

The 3 Pillars of an Effective Data Management Strategy: Monitoring, Tracking, and Reporting

SME Strategy

For instance, in Marketing, data is being used to calculate ROI on marketing campaigns, or come up with new pricing strategies based on A/B testing of campaigns which helps marketing and managers bring in more revenue, and stay ahead of the competition. For example, let's say your organization's goal is to increase revenue.

article thumbnail

10 Employee Training Metrics You Should Know

AIHR

It is usually linked to greater revenue and business impact. You may want to use A-B testing here, where you communicate the training program to employees using different messages to measure the effectiveness of different images and email subject headers used when presenting the course. Training Return on Investment.

Metrics 96
article thumbnail

A/B Testing and the Benefits of an Experimentation Culture

Harvard Business Review

The secret to getting value from data is testing, and if you’re looking to grow your online business, implementing well-executed, consistent A/B testing is a necessity. A/B Testing in Action. The most obvious benefit of a test like this is the ability to improve our product and increase our revenue.

article thumbnail

From Clicks To Converts; Maximise Your Digital Advertisement Outputs In 2020

Vantage Circle

Here’s the golden quote by digital marketing guru Neil Patel, “Don’t optimize for conversations, optimize for revenue.”. One way of achieving this is through A/B testing. In A/B testing, you take your ad and modify it to create a second version of the original. Final Touches.