Categories
evaluation design programs

Programming and Domains of Evaluation Questions

In Developing Monitoring and Evaluation Frameworks, Markiewicz and Patrick (2016) laid out the relationship of program development and implementation to five domains of evaluation questions. In doing so, they’ve contributed to the discussion in the previous post about what evaluation is for. At the very least, drilling down the domains of evaluation questions alter the types of program decisions to be considered and answered.

The following table, adapted from their work, summarizes the five domains of evaluation questions aligned to five program components.

Program Component Domains of Evaluation Questions Description of Domains
Planning and designAssessing the appropriateness of the program’s design-Suitability of program design in context
-Fit of program with program theory and/or logic
-Testing of underlying assumptions
-Extent program meets the priorities and needs of key stakeholders
Objectives Assessing program effectiveness in meeting it’s objectives, its value, and quality – Fidelity of implementation
-Achievement of program objectives
-Assessment of the quality and value of the program
ImplementationExamining efficiency and fidelity in program implementation-Conversion of inputs to outputs and outputs to results
-Governance and management
ResultsEstablishing impact: intended and unintended, and the degree to which change is attributable to the program-Changes (results) produced by the program, intended and unintended, direct and indirect
Sustainability of resultsIdentifying ongoing sustainable benefits from the program-Continuation of program benefits
Categories
evaluation

Why Evaluation?

In a recent blog post published during the AEA 2019 Conference, Cameron Norman, initiated a list of things that evaluation is for. Recalling this list was helpful during a recent family gathering when I was asked about work. Rather than focus on the means of evaluation, I found myself talking more about the ends of evaluation which coincided with many of the things on his list shared below. Evaluation is for…

  • Decision making
  • Seeing the future
  • Design and innovation
  • Asking better questions
  • Creating conversation
  • Speaking truth to power
  • Honoring our work
  • Learning
  • Leading system change
  • Telling stories about who we are as a people
  • Promoting health and preventing harm
  • Reinforcing democratic ideals
  • Provoking curiosity
  • Recognizing humanity

Make sure to check out Cameron’s blog post that elaborates on each of these.