Complex evaluations in the political context: Engaging stakeholders in evaluation design

While evaluators can often access examples of complex evaluation frameworks and reports, detailed information about the processes used to develop these frameworks is less available. This article provides insight into the development of an evaluation framework for a whole-of-government multi-component reform program, being implemented by stakeholders over a 10-year period. This program incorporates multiple tiers (activity-level and program-level) of evaluations, planned at critical points of implementation. This article focuses on the consultation process adopted in developing an evaluation framework to capture implementation progress and program outcomes and impacts at three different time points. A consultative, iterative approach, emphasizing stakeholder engagement, was adopted to mitigate the effects of challenges of responding to the variable nature of the program and multiple stakeholders with a vested interest in its implementation. Continual reflection and quality improvement allowed these challenges to be addressed, and will continue to allow lessons learned from earlier evaluations to inform the design of future studies