Journal of MultiDisciplinary Evaluation (JMDE)
Not a member yet
528 research outputs found
Sort by
Revisiting and Expanding Scriven's Fallacies About Formative and Summative Evaluation
Full text linkThis article outlines the origins of the formative and summative evaluation and then revisits Scriven’s claims about eight fallacies. We add to seven further fallacies especially that there are such concepts as formative and summative assessment. The argument is to return to Scriven’s original claims that formative relates to improvement and summative relates to status, the primary purpose of formative evaluation is to stimulate summative evaluation, and both demand rigor and must lead to claims about merit, worth or significance
Canadian Evaluation Society Tribute to Dr. Michael Scriven
Full text linkDuring his long career, Dr. Michael Scriven made significant contributions to building the evaluation profession in Canada. The Canadian Evaluation Society recognized Dr. Scriven with an In Memoriam sent in the CES Newsletter to all CES members on September 25, 2023. This article contains the substantive content of the tribute to Michael Scriven by the Canadian Evaluation Society. Published with the permission of the Canadian Evaluation Society and the Canadian Journal of Program Evaluation/La Revue canadienne d'evaluation de programme
Neither to Praise nor to Bury, Simply to Remember? In Memory of Michael Scriven
Full text linkA remembrance of Michael Scriven and his, sometimes perplexing, understanding of and contributions to evaluation
Scriven's Goal-Free Evaluation
Full text linkYouker examines goal-free evaluation's history and importance, advocating for its broader acceptance in program evaluation practice
Reviewing Michael Scriven’s Contributions to JMDE
Full text linkDr. Michael Scriven was a founding member and editor of JMDE, as well as a prolific contributor. This manuscript reviews Scriven's substantive manuscripts and revisits the three most-downloaded articles.
The Evaluation Metro Map
Full text linkBackground: The practice and profession of evaluation continue to evolve. Over the years, evaluation scholars and practitioners have developed a broad—and still broadening—range of evaluation approaches. These evaluation approaches are often combined with various study designs in real-world evaluations. To provide an overview of these approaches and designs, and inspired by my son’s love of metro trains, I created an evaluation metro map.
Purpose: The purpose of this article is to describe the background, purpose, and benefits and limitations of the evaluation metro map.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: Not applicable.
Data Collection and Analysis: Not applicable.
Findings: Not applicable
Influence of Michael Scriven in Japan
Full text linkDr. Ryo Sasaki's remembrance of Michael Scriven and his sizable influence on evaluation study and practice in Japan
Editors' Note
Full text linkWhen Dr. Scriven died on August 28, 2023, we lost a legend and an important voice in the evaluation field. Surely, his impact will be explored for years to come. Given Scriven’s role, along with Dr. E. Jane Davidson, in founding JMDE, we created this special issue for those who knew him to say a few words about their perceptions of his impact. Our initial compass for this special issue dedicated to Scriven was three-fold. Firstly, as he was a champion of JMDE and a frequent contributor, we were in a unique position to look back through the journal’s history and summarize his published contributions. Secondly, some expressed the desire to revisit and reinvigorate some of Scriven’s contributions. Finally, we wanted to provide a venue for more personal reflections on how Scriven impacted individual lives. Taking time to reflect on personal and professional relationships with Scriven and his intellectual contributions has given contributors to this issue a way to remember and say thank you. We hope that these contributions do some justice to Dr. Michael Scriven’s legacy, remind you of his role in our discipline’s development, and focus your attention, for more than a few moments, on the intellectual giant that left us
AI for Evaluators: Opportunities and Risks
Full text linkBackground: The emergence of widely available and applicable artificial intelligence (AI) raises ethical, practical, and professional concerns for professional evaluators. The authors explore potential answers to emerging questions as to how evaluators can engage AI in an effective and responsible way.
Purpose: Advance the conversation around AI technology and its integration into professional evaluation practice.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: Not applicable.
Data Collection and Analysis: Not applicable.
Findings: Authors explore two main use cases for AI: namely, proposal writing and evaluation design drafting. We also discuss four challenges for evaluators engaging with AI: The proliferation of the digital environment with excess output, market disruption and the emergence of new roles, the so-called "alignment problem", and the challenge to evaluators' to use their agency. Moving forward, the authors recommend evaluators familiarize themselves with AI technology, use it transparently, think critically about the effects of AI on their work, and use perspective when considering the potential ramifications of this new tool
The Aspirations, Challenges, and Influence of the Program Evaluation Standards 3rd Edition
Full text linkBackground: The revisions to The Program Evaluation Standards, third edition (2011) were substantial. The authors of this revision were the most knowledgeable individuals to question about aspects of the PES.
Purpose: To better understand the historical roots and intent of The Program Evaluation Standards, to analyze impact, and to look toward the future, it was critical to examine the aspirations, challenges, and impact associated with the PES via interviews with the authors.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: This qualitative study included three basic interview questions, with supporting follow-up questions for each of the basic questions.
Data Collection and Analysis: The results of this study were determined by the authors’ responses to interview questions, which were then coded by emergent patterns and themes.
Findings: Results of the interviews found that the authors aspired to provide relevant, up-to-date, and useful standards to guide evaluators, stakeholders, and students. They were able to successfully resolve challenges associated with the PES third edition revisions, and overall these resolved challenges made the edition stronger. Finally, the authors integrated the standards into their professional work, which positively influenced them, students, and other stakeholders