Journal of MultiDisciplinary Evaluation (JMDE)
Not a member yet
528 research outputs found
Sort by
Revisiting and Expanding Scriven's Fallacies About Formative and Summative Evaluation
This article outlines the origins of the formative and summative evaluation and then revisits Scriven’s claims about eight fallacies. We add to seven further fallacies especially that there are such concepts as formative and summative assessment. The argument is to return to Scriven’s original claims that formative relates to improvement and summative relates to status, the primary purpose of formative evaluation is to stimulate summative evaluation, and both demand rigor and must lead to claims about merit, worth or significance
Canadian Evaluation Society Tribute to Dr. Michael Scriven
During his long career, Dr. Michael Scriven made significant contributions to building the evaluation profession in Canada. The Canadian Evaluation Society recognized Dr. Scriven with an In Memoriam sent in the CES Newsletter to all CES members on September 25, 2023. This article contains the substantive content of the tribute to Michael Scriven by the Canadian Evaluation Society. Published with the permission of the Canadian Evaluation Society and the Canadian Journal of Program Evaluation/La Revue canadienne d'evaluation de programme
Neither to Praise nor to Bury, Simply to Remember? In Memory of Michael Scriven
A remembrance of Michael Scriven and his, sometimes perplexing, understanding of and contributions to evaluation
Scriven's Goal-Free Evaluation
Youker examines goal-free evaluation's history and importance, advocating for its broader acceptance in program evaluation practice
Reviewing Michael Scriven’s Contributions to JMDE
Dr. Michael Scriven was a founding member and editor of JMDE, as well as a prolific contributor. This manuscript reviews Scriven's substantive manuscripts and revisits the three most-downloaded articles.
The Evaluation Metro Map
Background: The practice and profession of evaluation continue to evolve. Over the years, evaluation scholars and practitioners have developed a broad—and still broadening—range of evaluation approaches. These evaluation approaches are often combined with various study designs in real-world evaluations. To provide an overview of these approaches and designs, and inspired by my son’s love of metro trains, I created an evaluation metro map.
Purpose: The purpose of this article is to describe the background, purpose, and benefits and limitations of the evaluation metro map.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: Not applicable.
Data Collection and Analysis: Not applicable.
Findings: Not applicable
Influence of Michael Scriven in Japan
Dr. Ryo Sasaki's remembrance of Michael Scriven and his sizable influence on evaluation study and practice in Japan
Editors' Note
When Dr. Scriven died on August 28, 2023, we lost a legend and an important voice in the evaluation field. Surely, his impact will be explored for years to come. Given Scriven’s role, along with Dr. E. Jane Davidson, in founding JMDE, we created this special issue for those who knew him to say a few words about their perceptions of his impact. Our initial compass for this special issue dedicated to Scriven was three-fold. Firstly, as he was a champion of JMDE and a frequent contributor, we were in a unique position to look back through the journal’s history and summarize his published contributions. Secondly, some expressed the desire to revisit and reinvigorate some of Scriven’s contributions. Finally, we wanted to provide a venue for more personal reflections on how Scriven impacted individual lives. Taking time to reflect on personal and professional relationships with Scriven and his intellectual contributions has given contributors to this issue a way to remember and say thank you. We hope that these contributions do some justice to Dr. Michael Scriven’s legacy, remind you of his role in our discipline’s development, and focus your attention, for more than a few moments, on the intellectual giant that left us
Deconstructing the Imperial Episteme: Decolonizing Knowledge Production in Program Evaluation
Scholars, practitioners, and activists have all contributed to the discussion of decolonization of evaluation practice in recent years as attention has increasingly focused on the persistent harms of colonization. While these discussions have led to the development of evaluation frameworks rooted in Indigenous and locally-situated understandings, values, and methods, little attention has been paid to the colonial origins of Western-based evaluation practices that continue to pervade the field. This article seeks to contribute to the conversation about decolonization by focusing on the ways in which Western social theory, born of colonizing nations, has been influenced by the processes of colonization. Drawing on scholars and theorists from the Global South, this article highlights specific apparatuses for dismantling imperial ways of thinking and ways of knowing, and proposes a path forward for evaluators who wish to grapple with the deeply imperial epistemological roots of our field of practice
The Aspirations, Challenges, and Influence of the Program Evaluation Standards 3rd Edition
Background: The revisions to The Program Evaluation Standards, third edition (2011) were substantial. The authors of this revision were the most knowledgeable individuals to question about aspects of the PES.
Purpose: To better understand the historical roots and intent of The Program Evaluation Standards, to analyze impact, and to look toward the future, it was critical to examine the aspirations, challenges, and impact associated with the PES via interviews with the authors.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: This qualitative study included three basic interview questions, with supporting follow-up questions for each of the basic questions.
Data Collection and Analysis: The results of this study were determined by the authors’ responses to interview questions, which were then coded by emergent patterns and themes.
Findings: Results of the interviews found that the authors aspired to provide relevant, up-to-date, and useful standards to guide evaluators, stakeholders, and students. They were able to successfully resolve challenges associated with the PES third edition revisions, and overall these resolved challenges made the edition stronger. Finally, the authors integrated the standards into their professional work, which positively influenced them, students, and other stakeholders