Capacity Building Solutions, Inc. · Frederick, Maryland (240) 426-4457  ·  robin_ed@capacity-building.com
Capacity Building  ·  Library  ·  Favorite Article

Where Data-Driven Decision-Making Can Go Wrong

August 15, 2024  ·  1 min read

When considering internal data or the results of a study, often business leaders either take the evidence presented as gospel or dismiss it altogether. Both approaches are misguided. What leaders need to do instead is conduct rigorous discussions that assess any findings and whether they apply to the situation in question.
Such conversations should explore the internal validity of any analysis (whether it accurately answers the question) as well as its external validity (the extent to which results can be generalized from one context to another). To avoid missteps, you need to separate causation from correlation and control for confounding factors. You should examine the sample size and setting of the research and the period over which it was conducted. You must ensure that you’re measuring an outcome that really matters instead of one that is simply easy to measure. And you need to look for—or undertake—other research that might confirm or contradict the evidence.

By employing a systematic approach to the collection and interpretation of information, you can more effectively reap the benefits of the ever-increasing mountain of external and internal data and make better decisions.

Share

Talk to Ed about your business.

Bring the decision you've been circling. The problem you haven't said out loud. The one you've been carrying alone.

Leadership thinking, in your inbox.

Ed’s frameworks, the occasional hard-won lesson, and what he’s reading. No spam, unsubscribe anytime.