Evaluating Change

Programs are designed and implemented to create change, often throughout multiple levels of a program; but at the very basic level, change occurs in individuals. Quoting Albert Wenger, “change creates information.” Information about changes that occurred during a program is essential to evaluate a program.

According to Radhakrishna and Relado (2009), a program might influence change in a program participant’s knowledge, attitude, skills, aspirations (KASA), and behavior. Another common set of individual outcomes called KAP include knowledge, attitudes, and practices (for example, see Chaplowe (2008)). At their intersection, changes in:

  • what participants understand (knowledge),
  • what participants use to base their decisions (attitudes/beliefs), and
  • what participants eventually enact (practices/behaviors)

lead to useful information about the potential impact of a program.

 

Scheduling Evaluation Interviews

Interviewing multiple individuals for a project is time consuming and scheduling those interviews also can be time consuming. There are several online applications that can match available interview times between interviewers and interviewees; however, I created an easy, quick, and no-cost system to schedule interview times using a Google Doc as described below.

I created a Google Doc that listed available day/times I was available for interviews. This Google Doc was shared with all interviewees at the same time using a shared link giving them permission to view but not edit the online document.

I easily and quickly edited the online document with days/times that became available or unavailable as my time commitments changed. At some level, using a Google Doc in this manner was a quick way to develop an instant website describing my availability. I used an email similar to the one below to share this process with those I was planning to interview.

Hi Dana,

[Opening Intro]

I’d like to schedule an hour phone conversation to talk with you about [name of program].

This online document suggests several day/time possibilities. Please reply to this email with your preferred choices. If none will work, please suggest a couple others. I’ll confirm in a return email.

I’m really looking forward to talking with you about [name of program].

Thanks,

Chris