One Company A/B Tested Hybrid Work. Here’s What They Found.
Harvard Business Review
OCTOBER 29, 2024
The six-month experiment reversed managers’ opinions on hybrid work — and offers three important lessons.
This site uses cookies to improve your experience. To help us insure we adhere to various privacy regulations, please select your country/region of residence. If you do not select a country, we will assume you are from the United States. Select your Cookie Settings or view our Privacy Policy and Terms of Use.
Cookies and similar technologies are used on this website for proper function of the website, for tracking performance analytics and for marketing purposes. We and some of our third-party providers may use cookie data for various purposes. Please review the cookie settings below and choose your preference.
Used for the proper function of the website
Used for monitoring website traffic and interactions
Cookies and similar technologies are used on this website for proper function of the website, for tracking performance analytics and for marketing purposes. We and some of our third-party providers may use cookie data for various purposes. Please review the cookie settings below and choose your preference.
Harvard Business Review
OCTOBER 29, 2024
The six-month experiment reversed managers’ opinions on hybrid work — and offers three important lessons.
Andrew Chen
JULY 2, 2018
This is why you can’t add up your A/B test results. If you’re at a company that A/B tests everything and then announces the great results – that’s wonderful, of course, but just run the thought experiment of summing together all of those A/B tests. Rarely does it match.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Harvard Business Review
APRIL 18, 2023
Testing your approach with a randomized sample of employees can help you find out what works and what doesn’t.
Kellogg Insight
JUNE 30, 2024
A new model can help you reduce the length or size of your experiments by as much as 50 percent, for significant cost savings.
GMC
APRIL 30, 2012
A/B Testing. Brian Christian reports in the May 2012 edition of Wired that (now-classic) A/B testing of web site variations has virtually replaced HiPPO decision-making in tech circles, at least for web design decisions. HiPPO is “highest-paid person’s opinion.”).
Forbes Leadership
JUNE 9, 2022
As consumer behavior and sentiment shift, split tests can be run and materials modified to better speak to the needs and desires of prospective customers or clients.
Harvard Business Review
OCTOBER 3, 2024
A/B testing by Instacart suggests that telling customers about stocking times can increase spending and decrease the proportion of items replaced or refunded.
Alison Green
SEPTEMBER 16, 2022
You will thus master the techniques of A/B testing and online marketing. • SEO/Content challenge – This challenge consists in enhancing the SEO of our platform by featuring our content on Wikipedia. That’s gross enough, but they’re also deliberately misleading about how it will benefit the people working for free.
Andrew Chen
FEBRUARY 5, 2024
And this why tutorials, splash screens, and lengthy signup flows are a bad idea) If you’ve been building apps for a long time and have seen the results of a lot of A/B tests, you quickly realize that people are a flighty bunch. Every time you ask the user click you lose half of them.
Harvard Business Review
DECEMBER 20, 2024
The top 10 most-read articles from HBR in 2024 range in topics, including answering a tricky interview question, A/B testing hybrid work arrangements, the new rules of executive presence, and leadership lessons from retired quarterback Tom Brady.
Andrew Chen
DECEMBER 26, 2018
Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look. Everyone’s had the frustrating experience of running an A/B test, seeing a big lift, closing it out, and expecting the top level metrics to move a lot. But they don’t.
Andrew Chen
AUGUST 8, 2022
These larger headline numbers always tested much better on A/B tests, whether in email marketing or banner form, and while it might feel like the reward becomes unattainable, it’s possible to create a second or third or fourth tier to go along with the big headline number. The Payback.
UVA Darden
JANUARY 12, 2023
The star analyst is now a data scientist, a private equity associate is tasked with reinventing a company’s IT instead of engineering its finances, and the marketer is now a “growth hacker” running A/B tests.
Andrew Chen
AUGUST 23, 2021
People solve this with ideas like wait list hacks, A/B tested invite flows, contact importers, “people you may know” algos. Without the right users there at the beginning, a user-generated content product would inherently be too shallow on content. Low engagement would lead to more low engagement.
Andrew Chen
FEBRUARY 26, 2024
I had a superpower in my domain knowledge of CAC, A/B testing, funnel optimization, lead gen, etc, and began to merge all of this thinking with consumer products. I had previously worked in online ads, with customers from WSJ, CBS, MySpace, etc, and had even gotten a patent filed on ad targeting (yes, US7747676B1).
Vantage Circle
MARCH 13, 2019
One way of achieving this is through A/B testing. A/B testing is basically a way of testing two variants of the same variable by testing the subject's response to both the variants and statistically determining the more effective of the two. Final Touches.
Alison Green
OCTOBER 19, 2022
The other option would be for you and your fellow team members to push back on your PI’s preferred strategy, possibly suggesting some A/B testing so you get real data on what does and doesn’t work … but it doesn’t sound like you want to take that on, which is completely reasonable. Putting video game playing on your resume.
Andrew Chen
OCTOBER 17, 2017
Optimization : A/B testing growth levers – from email/SMS/push copy – to when/how to reach out. Use cases : Understanding use cases and how to up-sell and cross-sell the stickiest ones. Offers/promotions : Using offers and content throughout the calendar cycle to engage.
Andrew Chen
JUNE 21, 2017
He’ll ask about the sample sizes on your A/B tests. As it’s been widely reported, TK cares about the details. He’ll look at your graphs and ask about week-to-week deviations. I’ve worked on projects where he wants to give final approval for the final mockups of flows.
SME Strategy
MARCH 6, 2023
For instance, in Marketing, data is being used to calculate ROI on marketing campaigns, or come up with new pricing strategies based on A/B testing of campaigns which helps marketing and managers bring in more revenue, and stay ahead of the competition.
Zenefits
AUGUST 25, 2022
A/B testing. A/B testing is a great way to test marketing campaigns and ensure that your organization takes advantage of the most effective means of attracting customers or users. Let’s dig into 10 of the top trends that go along with modern growth marketing efforts.
AIHR
JULY 31, 2023
A/B testing everything will be incredibly valuable. It can also tell you if certain questions in your application process deter candidates from filling them out or completing them so you can eliminate these questions. You may also discover that images and videos highlighting company culture could encourage applications.
Andrew Chen
DECEMBER 26, 2018
Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look. Everyone’s had the frustrating experience of running an A/B test, seeing a big lift, closing it out, and expecting the top level metrics to move a lot. But they don’t.
15Five
JANUARY 25, 2024
Here’s a quick example of an OKR for a marketing department: Objective : Increase conversion rates across all channels Key results : Increase the conversion rate of key landing pages from 10% to 20% Improve email conversion rate from 2%-4% Conduct A/B testing on product pages with the goal of running two statistically significant improvements Benefits: (..)
Get Lighthouse
DECEMBER 15, 2022
So they let the data do the talking and ran an A/B test. In the case of Netflix, that included admitting when you're wrong, even publicly. In a heated debate between the CEO, Reed Hastings, and another executive, they could not come to an agreement.
Andrew Chen
JUNE 25, 2019
The biggest gains in optimization don’t come from brute-force A/B tests, but from trying to understand the real barriers to people using your product. Question: Is this a channel your competition hasn’t tried yet? Tactic #17: Optimize conversion. All conversion optimization should start with user research.
Andrew Chen
DECEMBER 10, 2018
It has tracking codes so you can see how well it circulates, and you A/B test the whole thing to make sure it’s highly optimized to be viral and spread. Of course, we’ve improved the whole thing based on the latest tech. It integrates into Facebook Messenger and your email addressbook.
Vantage Circle
JANUARY 31, 2023
So they ran an A/B test, and the results were in Tom’s favor. This value is best exemplified in the story Patty McCord recalls in her book “ Powerful.” ” In the story, she recalls how CEO Reed Hastings was once involved in a heated debate with another executive Tom.
Andrew Chen
NOVEMBER 1, 2018
Of course, as an investor you can’t run A/B tests or analyze results directly, but you can form hypotheses, ideate, and apply the same type of thinking. 2) Then, to identify potential upside based learnings from within the company as well as across benchmarks from across industry.
Andrew Chen
NOVEMBER 1, 2021
There were projects to help with A/B testing (Morpheus!), There were teams working referral programs, landing pages, adtech integrations, funnel optimizations, activation sequences over email, retention and loyalty programs, as well as all the underlying infrastructure.
Walk Me
AUGUST 24, 2022
Netflix is one example of such a company, using A/B tests and sharing data collection findings with all aspects of the organization to use continuous change to foster a learning culture. Organizational knowledge is used more efficiently in this way. Trans-organizational Change.
Walk Me
JULY 18, 2022
How they communicate. Segmenting target audience . Use audience demographic personas to reflect demographic to attract. Speaking to the target audience. Unique campaigns. Acquisition. Lead acquisition is an integral aspect of CRM, as it cements customers’ initial interest by allowing them to engage with the service or product.
Andrew Chen
JUNE 25, 2019
The biggest gains in optimization don’t come from brute-force A/B tests, but from trying to understand the real barriers to people using your product. Question: Is this a channel your competition hasn’t tried yet? Tactic #17: Optimize conversion. All conversion optimization should start with user research.
Andrew Chen
DECEMBER 10, 2018
It has tracking codes so you can see how well it circulates, and you A/B test the whole thing to make sure it’s highly optimized to be viral and spread. Of course, we’ve improved the whole thing based on the latest tech. It integrates into Facebook Messenger and your email addressbook.
Andrew Chen
SEPTEMBER 4, 2018
And you can start to draw conclusions, sort of a natural A/B test in order to do that. You can say, “Well, you know, this market which is like, has much more density in terms of the numbers of scooters behaves like this.”
Andrew Chen
AUGUST 10, 2023
I use tons of A/B testing and experiments in messaging to make this happen. Should the user be “forced” to activate in any way, by adding required signup steps? … and on and on For new user flows, I try to get more users that hit the landing page to ultimately become activated users.
Andrew Chen
NOVEMBER 13, 2018
There’s a long laundry list of skills that are critical, but not often considered core to the product: adtech integrations, signup funnel A/B testing, optimizing notification delivery, testing price points, testing cohort curves, etc. Yes, occasionally there are people who know all of it – but they are rare!
Andrew Chen
JANUARY 23, 2017
This is the realm of A/B testing, funnel optimization, viral loop construction, building viral content, and creating sticky products. Execute thoughtfully and iteratively, so that you are learning about your product and platform. If you are prepared, and have mastered the tactics of the trade, then this is when you can shine.
Expert insights. Personalized for you.
We have resent the email to
Are you sure you want to cancel your subscriptions?
Let's personalize your content