|
Measuring the Unmeasurable
One of the most common objections I hear regarding metrics and evaluation is "I can't measure that!" That usually is a fuzzy variable that in some way touches on changes that is occurring within people like a change in attitudes, thoughts, or behaviors. Certain variables may feel outside of the reach of measurement but it's been my experience that there is a lot more that can be measured than what may appear at first blush.
So, this month we offer resources to help measure the unmeasurable:
- Register to participate in an upcoming webinar on reducing the measurement angst.
- Read one of my columns from the Dayton B2B magazine on logic modeling. (Logic modeling is the foundation towards measuring these otherwise unmeasurable items.)
- Learn how we measured a nebulous variable within the real workd in "What we've been up to ..."
- Finally, check out the blog on logic modeling and "Get Rid of Cable" commercial.
As always, if we can support you in any way as you're trying to measure the unmeasurable, give us a call at 937-242-7024.
Enjoy!
Lana J. Rucks, Ph.D.
Principal Consultant
|
|
Webinar: Reducing the Outcomes Angst: A step-by-step approach to identify what to measure Presented by The Evalua|t|e Center
Deciding what to measure (and what not to measure) towards gathering evidence of impact can be a daunting task, but it doesn't need to be. In this webinar, Lana Rucks, a National Science Foundation Advanced Technological Education external evaluator, will provide a step-by-step approach for making the decisions around what should be measured as an indication of impact.
Webinar Date: Wednesday, March 21, 2012 1:00pm - 2:30pm
Fee: Complimentary (sponsored by The Evalua|t|e Center)
|
|
Article: Using logic models to create a clear picture
Lana is thrilled to be a regular writer with the Dayton B2B magazine. This article is one of her recent columns (click here to learn more about the magazine).
"...the strength of the logic model lies in the fact that it focuses everyone to have a more systematic-scientific understanding of how actions are connected to desired outcomes. This is true in the actual product of the logic model as well as in the process of developing one."
Click here to download the full article |
|
Blog: Logic Model of "Get Rid of Cable"
posted by Tuesday, March 13, 2012
 | | DIRECTV - "Don't Wake Up in a Roadside Ditch" 2012 Commercial |
So, I'm not sure if you've seen these commercials or not, but Direct TV has a series of ads that have an unlikely series of consequences to having cable: ending-up in a ditch, taking in stray animals, and having a grandson who wears a dog collar.
space
One evening while watching the commercial, it dawned on me that it was a logic model. Ok, I admit, it's not a classic example but it's still a logic model.
space
Doubt me? Ok do this: Watch the video clip above. Then download the logic model document and watch the video clip again ... it's a logic model, just a really funny one! |
The Rucks Group is a research and consulting firm that gathers, analyzes, and interprets data to enable our for-profit and non-profit clients to make quality strategic decisions. We specialize in providing services for evaluation & research, measurement, and capacity building. To learn more, visit us at www.therucksgroup.com.
|
|
|
|
|
|
What we've been up to ...
Measuring Changes in Self-Efficacy
Self-efficacy is a construct that a diverse group of individuals are interested in measuring. This interest in self-efficacy is likely because attitudinal changes in self-efficacy should occur before actual behavioral changes do.
We have two different situations in which we've measured self-efficacy: 1) Students in a Aviation Diesel Course expansion; and 2) Professionals attending a training session to implement a new organization-wide policy.
In our work with students, we modified the General Self-Efficacy Scale as well as developed original questions (all within the same questionnaire). For instance, one question item read "When it comes to working on Diesel Engines, I can always manage to solve difficult problems if I try hard enough." (Also, I have come across a STEM self-efficacy scale, I'll blog on that later).
In working with professionals, we took a different approach. We didn't want to make what we were tapping into too obvious because then respondents would have given the "right answers" simply out of self-presentational motives. Instead, we asked questions around comfort level and the perceived ability to deal with the implementation of a new policy.
In both situations we tapped into the construct of self-efficacy but by asking slightly different questions. |
|
