Journal of MultiDisciplinary Evaluation (JMDE)
Not a member yet
528 research outputs found
Sort by
What Counts as Credible Evidence in Applied Research and Evaluation Practice?
Get PDFA review of the book What Counts as Credible Evidence in Applied Research and Evaluation Practice? by Stewart I. Donaldson, Christina A. Christie, & Melvin M. Mark, published in 2008 by Sage
The Use of Kōans for Insight Evaluation Approach Training
Get PDFBackground: Since publishing a trilogy of articles relating Eastern mysticism to evaluation, the authors have received many inquiries about training. Purpose: The article explains one promising new method under development—adapting the Zen practice of kōans for evaluation training. Setting: Not applicable. Subjects: Not applicable. Research Design: Not applicable. Data Collection and Analysis: Not applicable. Findings: Not applicable. Conclusions: The authors believe that kōans can be used as a poetic technology for recalibrating evaluation practioners’ attitudes and actions about evaluation. Keywords: Insight evaluation approach, Eastern mysticism, kōans, training, Zen, enlightenmen
Theory Construction and Model-Building Skills: A Practical Guide for Social Scientists
Get PDFA review of the book Theory Construction and Model-Building Skills: A Practical Guide for Social Scientists by James Jaccard & Jacob Jacoby published in 2010 by Guilford
“Process Values” and “Deep Values” in Evaluation
Get PDFBackground: Many evaluation theorists and practitioners have advocated the application of cultural values to the evaluation process to ensure cultural appropriateness and responsiveness.
Purpose: This article draws a distinction between these “process values” and “deep values” in evaluation, using the specific example of cultural values to illustrate. The application of “deep values” refers to the deliberate and systematic inclusion of [in this case, cultural] values in the very definitions of “quality” and “value” used in an evaluation, and in the evaluative interpretation of evidence.
Setting: Not applicable.
Subjects: Not applicable.
Research Design: Not applicable.
Data Collection and Analysis: Not applicable.
Findings: Not applicable.
Conclusions: Including “deep cultural values” in the “merit determination” or “valuing” step in evaluation is partly about ensuring the right voices are at the sense-making table, but it’s also about having practical evaluation-specific methodologies for systematically and transparently building in those cultural values
Evaluation Development and Use in Social Work Practice
Get PDFBackground: Social workers entering the profession typically receive little, if any, content or training on evaluation practice. This is, in part, due to limited course offerings outside of the typical courses in most schools of social work. In addition, practicing social workers who often serve in the role as field instructors have not fully embraced the use of research in practice, and tend to employ less rigorous evaluative methods. Purpose: The purpose of this study was to explore the development and use of evaluation knowledge among social work practitioners who supervise social work students. Setting: Not applicable. Intervention: Not applicable. Research Design: A mixed method, sequential research design within the context of an exploratory study was used to determine factors that facilitate evaluation, identify and prioritize evaluation competencies, and determine the extent to which evaluation constructs contribute to self efficacy, evaluation competency, evaluation influence, and leadership behaviors. Data Collection and Analysis: A web-based survey was used followed by a participatory method that included the use of a web-based software to identify and prioritize activities that contribute to the development of evaluation knowledge and skill. Findings: Results suggest social work education has a critical role in promoting evaluation practice, establishing evaluation practice competencies, and using evaluation results to inform policy and practice
Applying the Model for Collaborative Evaluations to a Multicultural Seminar in a Nonprofit Setting
Get PDFBackground: The diversity within organizations and the stakeholders served require an awareness and appreciation of multiple value perspectives. The challenges with respect to the handling of these perspectives and inappropriate biases resulting from poorly chosen value premises reinforce the importance of seeking out and engaging diverse and relevant evaluation stakeholders.
Purpose: This article addresses stakeholder engagement in evaluations by presenting an application of the Model for Collaborative Evaluations (MCE) to the evaluation of a multiculturalism seminar.
Setting: A nonprofit organization that promotes an understanding of multicultural environments through various programs, including a multiculturalism seminar.
Intervention: The article examines the application of the MCE to an organization.
Research Design: Single-case study.
Data Collection and Analysis: The collaboration team consisted of five members plus an external evaluator. The steps outlined in the MEC were strictly adhered to for fidelity purposes. Data collection was completed using interviews and written questionnaires.
Findings: The MEC approach that was used in this formative evaluation actively engaged the key stakeholders during the evaluation process. With a collaborative approach to evaluation decision- making, the collaboration members were able to share their various points of view and, as a result, there was a lower likelihood that a particular idea would be overlooked. The MCE enhanced the quality of the evaluation by establishing an open and shared evaluation environment while attending to the intended and unintended effects of the collaborative relationships. In addition, the MEC provided increased shared ownership in the evaluation that also led to an increased quality of information for decision-making and receptivity of the findings
The 2009 Claremont Debates-Appendix A: David Fetterman's PowerPoint Slides
No full textDr. David Fetterman's slide deck from the 2009 Claremont Evaluation Debates
What Do All These Numbers Mean? Data Visualization as an Innovative Methodology to Make Program Decisions
Get PDFBackground: There is a lack of consistent, comprehensible data collection and analysis methods for evaluating teacher preparation program’s coverage of required standards for accreditation. Of particular concern is the adequate coverage of standards and competencies that address the teaching of English learners and teachers of students from culturally and linguistically diverse backgrounds.
Purpose: To graphically convey the findings of a faculty survey regarding English learner and multicultural content in teacher preparation coursework in order to inform them of inadequate coverage (and saturation) of those particular teaching standards and competencies.
Setting: A small teacher preparation program in a Northern California public university that prepares elementary school teachers and special education teachers.
Intervention: 10 full and part-time faculty members in a teacher preparation program that prepares elementary and special education teachers.
Research Design: Congruency study, in which raw data from faculty survey responses were compared with rated program responses to teacher preparation standards by means of a relational database with graphing output capabilities.
Data Collection: A survey instrument was designedandadministeredtoallfacultymembers in the program.
Findings: The resulting radar maps and other graphic outputs allowed faculty to clearly see where their course content aligned with the program accreditation response and where more coverage of that particular competency was necessary.
Conclusions: The use of relational databases was a highly effective method for helping one teacher preparation program to visualize their progress towards meeting standards for teacher preparation in the area of student diversity and the teaching of English learners
A Comment on Lempert's "Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’"
Get PDFThis piece includes general and specific comments on
Cochrane Handbook for Systematic Reviews of Interventions
Get PDF"Cochrane Handbook for Systematic Reviews of Interventions" edited by Julian P.T. Higgins & Sally Green, 200