Skip to content

Marketing Thought

Clarifying management/marketing theory

Menu
  • Neil Bendle
  • Popular Marketing Metrics: How Not To Mess Them Up
  • Marketing Metrics 4th Edition Book
  • Marketing PhD Applications
  • Advice For The Marketing Academic Job Market
  • Sustainable Marketing Strategy
  • Public Policy, Behavioral Economics and Marketing
Menu

Lying With Statistics

Posted on April 15, 2016September 29, 2021 by neilbendle

While statistics can help us understand the world there is plenty of opportunity to abuse them to mislead. Darrell Huff wrote a short book that was first published in 1952 on lying with statistics. Some of the text shows its age (lots of male pronouns and references to gentleman) but many of the lessons remain applicable today. Reading Huff’s advice and teach yourself how not to be lied to with statistics.

Lying With Statistics: The Biased Sample

Huff works through a number of problems in the way statistics are presented. First he notes the problem of bias in the sample used. This is a classic challenge of survey research: you must ensure those you ask are representative of whoever you are studying.

Lying With Statistics: The Mean Of A Varied Group

He highlights the problem of using the mean when there is a large variance of outcomes. The mean of nine people with no income and someone gaining ten million dollars a year is $1 million. This seems misleading as most people aren’t doing well. An alternative measure of the average, the median or middle value, shows the average person earning nothing.

Trending
Don’t Use One Industry To Create Examples For CLV (Customer Lifetime Value)

Lying With Statistics: Small Samples And Statistical Ties

Conclusions being drawn from too small samples is something that annoys Huff. Huff also doesn’t like it when conclusions are drawn despite results being statistically tied. This happens all the time in the reporting of election polling. One candidate appears to be ahead with 51% versus the other candidate’s 49% but the result is within the margin of error. They are essentially the same.

The Two Graphs Are Really The Same And Neither Means Anything Lying With Statistics
The Two Graphs Are Really The Same And Neither Means Anything

Lying With Statistics: Graphs

His thoughts on graphs seem painfully relevant today. I’ve seen plenty of graphs without numbers on the Y-axis (or even numbers on the X-axis sometimes). Such graphs are worse than useless. When I see them I hope these graphs are meant to mislead. The alternative seems to be that the presenter doesn’t know what they are doing.

Lying With Statistics: Context And Academic Bias

He complains about context being removed and also that people conclude that something that comes after something else must have been caused by the earlier event.

Huff notes that: “Even the man in academic work may have a bias (possibly unconscious) to favor, a point to prove, an axe to grind” (Huff, 1993, page 123). That anyone could say such a thing is shocking to me. Still academics should bear this in mind. Lets try and make sure that we don’t, and that our colleagues don’t, mislead with statistics. At the very least we should always label our Y-axis.

Read: Darrell Huff (1993) How To Lie with Statistics, WW Norton, 1st Revised Edition

For more one visualization see here.

Share on Social Media
twitter facebook linkedin reddit

  • Using Data In Decisions
  • The Brussels Effect
  • Communicating Numbers
  • Market Research Lessons

MASB’s Universal Marketing Dictionary

Need a marketing definition? Use MASB’s Universal Marketing Dictionary. Click for the MASB Universal Marketing Dictionary

Pages in Marketing Thought

  • A Plea About Language Used In Marketing
  • Advice For The Marketing Academic Job Market
  • Behavioral Econ For Kids: The Cartoon Book
  • Data Visualization Advice
  • Machine Learning (ML) And Marketing: What Should You Know?
  • Marketing In The Movies
  • Marketing Metrics 4th Edition Book
    • Chapter of Marketing Metrics 4th Edition, Free Sample
  • Marketing PhD Applications
  • Marketing Thought Website Data
  • Neil Bendle
  • Popular Marketing Metrics: How Not To Mess Them Up
    • Brand Valuation: Progress But Lots More Needed
    • Customer Equity: Nice Idea, Bit Of A Mess In Execution
    • How To Use, And Misuse, Customer Lifetime Value (CLV)
    • Is ROI The Most Abused Term In Marketing?
    • Market Share: Always An Indicator Never A Target
    • Marketing Accounts: A Better Way To Measure Marketing Performance
    • Measuring Competition With The Bendle Panda Index
    • Net Promoter Score: Sadly Not As Magical As Supporters Suggest
    • Profit Measurement: Choose Your Own Level Is Problematic
    • Tobin’s Q: Why Academics Should Listen To Managers
    • Total Q, A New Improved Tobin’s Q? Not By Much
    • Value Of A Like: Do Not Use For Budgeting
  • Public Policy, Behavioral Economics and Marketing
  • Recommended Books
  • Sustainable Marketing Strategy
    • B Corp Research Papers
    • Marketing Strategy
      • Measuring Culture Is A Challenge, But Don’t Be Silly
      • Rationality And Marketing Strategy
      • Segmentation, Targeting and Positioning
      • Strategy And Evolutionary Thinking
  • Sustainable Marketing Strategy Cases
©2023 Marketing Thought | Built using WordPress and Responsive Blogily theme by Superb
Go to mobile version