141 research outputs found
Table 1
Summary of Quality Assessment Tool Characteristics in Studies Reviewed in Protogerou, C., and Hagger, M.S. (2018). A case for a study quality appraisal in survey studies in psychology. Submitted for publication
Cleo Protogerou's Quick Files
The Quick Files feature was discontinued and it’s files were migrated into this Project on March 11, 2022. The file URL’s will still resolve properly, and the Quick Files logs are available in the Project’s Recent Activity
Effects of habit and intention on behavior: Meta-analysis and test of key moderators
In a meta-analysis of research on measures of the habit construct, we aimed to estimate the size and variability of habit–behavior and intention–behavior relations, and habit as a mediator of past–future behavior relations. Furthermore, we investigated the theory-consistent moderators of these relations including opportunity for habit formation and behavioral complexity, and the capacity of different habit measures to detect these effects. We also tested effects of behavior type, behavior measure, and measurement lag as moderators of these effects, and explored convergence in correlations among habit measures and their indication of a single habit factor. A database search identified studies (k = 267) reporting relations among habit measures (behavioral frequency × context stability, response frequency, self-report measures), behavior, and intention. Data were analyzed using multilevel meta-analytic structural equation modeling. Habit and intention independently predicted behavior, and habit partially mediated past–future behavior relations. Larger habit–behavior relations were observed in studies targeting behaviors with high opportunity for habit formation and lower complexity, but no analogous effects for intention–behavior relations. Similar trends for these moderators were observed across the habit measures, although differences were nonzero for self-reported habit measures only. Habit–behavior relations were larger in studies adopting self-report habit measures that included behavioral frequency items and those with greater measurement lag. Convergence in habit measure correlations, and their indication of a single habit factor, was supported. Findings corroborate and extend prior research on habit, particularly convergence in behavioral effects of the habit measures. Findings are expected to catalyze future habit research using experimental methods and non-self-report measures. (PsycInfo Database Record (c) 2023 APA, all rights reserved
A checklist to assess the quality of survey studies in psychology
Study quality is emerging as an essential component of evidence syntheses and allows practitioners and policymakers to make informed decisions based on the quality of the evidence reviewed. Study quality is typically assessed by checklists of pre-determined quality criteria. Few study quality checklists have been systematically evaluated, and none have been developed specifically for survey studies in psychology. The present study addresses this evidence gap by developing the quality of survey studies in psychology (Q-SSP) checklist, using an expert-consensus method. An international panel of experts in psychology research and quality assessment (N = 53) evaluated the inclusion and importance of candidate quality items and offered commentary. The resulting checklist was used to evaluate a set of survey studies and inter-rater reliability of checklist scores was computed. A preliminary test of criterion validity of checklist scores was conducted using on a sample of survey studies with ‘known differences’ in study quality verified by experts. Experts exhibited high agreement on inclusion and importance ratings of the candidate items. Minor adjustments were made to the candidate items based on experts' feedback. Inter-rater reliability of study quality scores using the checklist was high. Some evidence for criterion validity of scores using the checklist was obtained. Overall, we provide preliminary data to support the Q-SSP checklist as a potential means to evaluate the quality of survey studies in psychology. We recommend a large-scale study using the Q-SSP checklist to assess study quality in studies with known differences in quality verified by experts.peerReviewe
- …
