How to Stop Measuring the Wrong Things

We all know that what gets counted counts. But what do you do when you know the wrong things are getting counted (or measured)? This post is for church and nonprofit leaders who suspect their numbers aren’t telling the real story.

First, it helps to understand why what gets counted counts. What gets counted signals importance. Yet some of the things most important to us and our organizations tend not to be counted or valued.

This matters because whatever you count, you will use your resources to create the conditions to count more of it, making it the most important thing over time. You want to see or hear about the things you can count, so you can report them and prove success.

Two examples

For many churches, the thing we count is attendance. We measure attendance and growth, and then we put our resources into creating something people can attend. But measuring attendance doesn’t speak to the impact of making disciples or loving our neighbors. It assumes those impacts will simply happen if people come to church. That is a risky assumption when you spend funds and resources on an outcome you never measure, and therefore never know.

Countries offer another example. We tend to measure Gross Domestic Product (GDP) to tell us how an economy is performing. While this measurement is important, it focuses on growth, not on whether a population is thriving. In an August 2020 article for Scientific American, Professor Joseph E. Stiglitz writes, “The GDP measures market output: the monetary value of all the goods and services produced in an economy during a given period, usually a year.... It does not even measure crucial aspects of the economy such as its sustainability: whether or not it is headed for a crash.” GDP also tells us nothing about how market output relates to people’s well-being. (For more on this, see Kate Raworth’s talk on Doughnut Economics.)

These examples invite the questions: Are we measuring the wrong things? Are we measuring what truly matters to us? And once you realize you might be measuring the wrong things, what do you do?

Slow Down

First, look at why you are measuring what you are measuring. Then ask: Is this telling you anything about the change you want to see through your work? Is it helping you see what is working or not working? Is it helping you make better decisions? What do you really want to know about the impact of your programs? You have to create the time and space to explore these questions.

Get Specific

Be really clear about the problem you are trying to solve, or the change you are hoping to make, and why it matters. We ask people to answer this question: What is the change you want to make, or the transformation you want to see, in people, a place, policy or systems? Once you answer that question, your intended impact will be easier to put into words. And once you can put it into words, you will have a better sense of what to measure.

Understand Your Stakeholders

Understand who is asking you to measure what, and why. What do others want to know about your impact? Are they invested in it, and if so, why? Being clear about who is investing in the impact and what they want to see is crucial. Misunderstandings with stakeholders often cause measurement to get out of line with what matters. If your stakeholders ask you to measure something you think is irrelevant, make a case for measuring differently. Getting clear about the problem you want to solve will help you make that case.

Articulate Your Theory of Change

A theory of change explains how a program creates the change you want. Once you know the change you want to make, ask: How will that change happen? What are the steps to get there? Your answers become your theory of change. From there, you can test your assumptions about how your work contributes to change. A theory of change can also help stakeholders and funders give things time to work, while you look for early signs of impact.

Give It Time, But Communicate Early and Often

Impact doesn’t happen overnight. Value the early signs of change. The green shoots that come out of the ground in early spring point to the blooms to come. The frost might get them first, but you have a reason to be hopeful. Tell the story of the green shoots, and if the frost does come, tell that story, too.

Previous
Previous

What Next? A Planning Tool for Ministries

Next
Next

Article: Investing in the Future as a Way of Repairing the Past