Skip to content

Marketing Thought

Clarifying management/marketing theory

Menu
  • Neil Bendle
  • Popular Marketing Metrics: How Not To Mess Them Up
  • Marketing Metrics 4th Edition Book
  • Marketing PhD Applications
  • Advice For The Marketing Academic Job Market
  • Sustainable Marketing Strategy
  • Public Policy, Behavioral Economics and Marketing
Menu

Why Don’t Businesses Experiment More?

Posted on January 27, 2017December 10, 2021 by neilbendle

One puzzle for academics, myself included, is why businesses don’t experiment more?

Why Don’t Businesses Experiment More?

Experiments have great potential to improve business outcomes. Often businesses don’t seem to do much experimenting.

Companies pay amazing amounts of money to get answers from consultants with overdeveloped confidence in their own intuition. Managers rely on focus groups—a dozen people riffing on something they know little about—to set strategies. And yet, companies won’t experiment to find evidence of the right way forward.

Ariely, 2010, page 34

There are likely several reasons for this. Consultants give answers and answers are nice. Even if the consultant isn’t correct they give confidence. Even more critically the consultants probably support what a senior executive thinks is a good idea.

Do Experiments Discriminate Amongst Customers?

One of the more interesting objections is that business experiments often mean you aren’t treating all customers the same. Still, is this fair? Not really, I’d argue. It seems to me if it improves customer outcomes in the long-term the risk of testing is worth taking. You don’t know any customer is getting worse outcomes from the outset. After all, you only test if you don’t know (even if you have a guess). As such, I don’t think you are being unfair to any consumers. Plus consider the nature of random assignment which is key to the best tests. You aren’t deliberately discriminating against any group of consumers as they could be in the group that turns out to get the best offer.

Trending
The Destiny of Accounting Measures of Customer Assets

Random Assignment
Random Assignment

Experimentation is used effectively in medicine to improve our knowledge. Business rarely has such important outcomes which makes the downside risks of testing much less. We, therefore, don’t need to be as careful as medicine. So let marketers do much more testing.

For more on experiments and testing see here, here, here, and here.

Read: Dan Ariely (2010) Why Businesses Don’t Experiment, Harvard Business Review, April

Share on Social Media
twitter facebook linkedin reddit

  • Using Data In Decisions
  • The Brussels Effect
  • Communicating Numbers
  • Market Research Lessons

MASB’s Universal Marketing Dictionary

Need a marketing definition? Use MASB’s Universal Marketing Dictionary. Click for the MASB Universal Marketing Dictionary

Pages in Marketing Thought

  • A Plea About Language Used In Marketing
  • Advice For The Marketing Academic Job Market
  • Behavioral Econ For Kids: The Cartoon Book
  • Data Visualization Advice
  • Machine Learning (ML) And Marketing: What Should You Know?
  • Marketing In The Movies
  • Marketing Metrics 4th Edition Book
    • Chapter of Marketing Metrics 4th Edition, Free Sample
  • Marketing PhD Applications
  • Marketing Thought Website Data
  • Neil Bendle
  • Popular Marketing Metrics: How Not To Mess Them Up
    • Brand Valuation: Progress But Lots More Needed
    • Customer Equity: Nice Idea, Bit Of A Mess In Execution
    • How To Use, And Misuse, Customer Lifetime Value (CLV)
    • Is ROI The Most Abused Term In Marketing?
    • Market Share: Always An Indicator Never A Target
    • Marketing Accounts: A Better Way To Measure Marketing Performance
    • Measuring Competition With The Bendle Panda Index
    • Net Promoter Score: Sadly Not As Magical As Supporters Suggest
    • Profit Measurement: Choose Your Own Level Is Problematic
    • Tobin’s Q: Why Academics Should Listen To Managers
    • Total Q, A New Improved Tobin’s Q? Not By Much
    • Value Of A Like: Do Not Use For Budgeting
  • Public Policy, Behavioral Economics and Marketing
  • Recommended Books
  • Sustainable Marketing Strategy
    • B Corp Research Papers
    • Marketing Strategy
      • Measuring Culture Is A Challenge, But Don’t Be Silly
      • Rationality And Marketing Strategy
      • Segmentation, Targeting and Positioning
      • Strategy And Evolutionary Thinking
  • Sustainable Marketing Strategy Cases
©2023 Marketing Thought | Built using WordPress and Responsive Blogily theme by Superb
Go to mobile version