Why is it important to know how well a program was implemented? How do you know whether a program was implemented as designed? For answers to these questions and more, view the slides and recordings of these two webinars on evaluating program implementation.
- Measuring Program Implementation held October 1, 2019
Dr. Hulleman reviewed the importance of developing a logic model and using systematic measurement approaches to examine program implementation. He reviewed the merits and limitations of different methods for measuring implementation in research and development projects and shared tools and resources to help the DRK-12 community develop and refine their implementation measurement plans. A preview of Webinar 2 encouraged participants to return for part two of the discussion, during which a DRK-12 principal investigator (PI) or co-PI served as a discussant to share an authentic example of approaches and challenges for measuring implementation in his/her project.
Slides | Webinar recording
- Developing a Program Implementation Measurement Framework held October 10, 2019
In the second part of this series, Dr. Hulleman demonstrated how to develop an implementation measurement framework, aligned to a program logic model. The measurement framework provided a foundation for systematically examining implementation. Dr. Hulleman discussed practical considerations, such as reporting burden and availability and quality of data. Then he invited the DRK-12 discussant to share challenges encountered in measuring program implementation and receive feedback on how best to identify appropriate measurement indicators and thresholds for the key components of programs they are studying.
Slides | Webinar recording
Presenter: Chris Hulleman, PhD, research associate professor, University of Virginia, is director of the Motivate Lab and an associate professor at the Curry School of Education. He also is a fellow at the Carnegie Foundation for the Advancement of Teaching and codirector of the Motivation Research Institute at James Madison University. His research explores how motivation and mind-sets impact human development and growth and researches methods of evaluating educational interventions. He received his doctorate in experimental social and personality psychology from the University of Wisconsin–Madison in 2007.
These webinars were organized by AIR and supported by a grant from the National Science Foundation (DRL-1813777). Opinions, findings, and conclusions or recommendations expressed during this webinar do not necessarily reflect the views of the National Science Foundation.
Questions? Contact Sonica Dhillon at gdhillon@air.org.