One of the great challenges of the kind of work I and others are doing is figuring out how to measure our progress. We often have fundors involved who want to know what our metrics are, but more importantly our communities themselves need to know if their efforts are effective. All to often our work is sidelined when someone says where’s your strategic plan? Many of us don’t believe in strategic planning. We say show me a plan that was actually followed and that was helpful. But, still, we don’t have much that we work with instead. Sure, we follow our intuition and we’re good at using conversation and other tools. But it feels insufficient.
And I am so tired of hearing if you don’t know where you’re going, you’ll never get there . What does it mean to work with making the path by walking on it? How do we get collective reassurance that we’re headed in the right direction and not just spinning our wheels? One insight I had a few years ago was that in our new ways of working, we measure from the inside out. Rather than having a fixed set of reference points (goals and objectives) constructed in advance, we’re actually called on to learn how to watch what is actually happening in order to understand the direction that is emerging from within our system and then we have to talk about what that direction means.
One methodology I’ve come across that works in this way is something called Most Significant Change. The link will lead you to a version of the user’s guide from a couple of years ago. I have some problems with the methodology in that it uses a somewhat elitist process to refine data — but I think it has a promising, simple, fresh start. You ask people to notice what is significant about changes and then look for patterns and trends in their responses.
Someone recently forwarded an interesting article from a 2006 NonProfit Quarterly Evaluation for the way we Work. Michael Quinn Patter, the author, begins by saying The very possibility articulated in the idea of making a major difference in the world ought to incorporate a commitment to not only bring about significant social change, but also think deeply about, evaluate, and learn from social innovation as the idea and process develops. However, because evaluation typically carries connotations of narrowly measuring predetermined outcomes achieved through a linear cause-effect intervention, we want to operationalize evaluative thinking in support of social innovation through an approach we call developmental evaluation.
I’ve also been collecting interesting pieces of this and that for the last several years while this question has been bubbling in me including:
- Learning for Social Change
- A Framework for Learning and Results in Community
- Organic Evaluation at Santerpol Roulant
- Introduction to Outcome Asset Impact Model
And many more. I’ve been collecting these for some time and finally have an opportunity to read and think about them. I’m very curious. What are others here finding helpful in terms of Evaluation and Measurement? What are you doing? What kinds of resources and documentation are helpful? What can you share here?