553 research outputs found
bib – Supplemental material for Efficient Standard Errors in Item Response Theory Models for Short Tests
No full textSupplemental material, bib for Efficient Standard Errors in Item Response Theory Models for Short Tests by Lianne Ippel and David Magis in Educational and Psychological Measurement</p
Combining item purification and multiple comparison adjustment methods in detection of differential item functioning
No full textReproducibility code for the paper "Combining item purification and multiple comparison adjustment methods in detection of differential item functioning" by Adéla Hladká, Patrícia Martinková, and David Magis (Multivariate Behavioral Research, In Press, https://doi.org/10.1080/00273171.2023.2205393).
Funding information: grant number 21-03658S from the Czech Science Foundation and by the institutional support RVO 67985807 from the Institute of Computer Science of the Czech Academy of Sciences
Combining item purification and multiple comparison adjustment methods in detection of differential item functioning
No full textReproducibility code for the paper "Combining item purification and multiple comparison adjustment methods in detection of differential item functioning" by Adéla Hladká, Patrícia Martinková, and David Magis (Multivariate Behavioral Research, In Press, https://doi.org/10.1080/00273171.2023.2205393).
Funding information: grant number 21-03658S from the Czech Science Foundation and by the institutional support RVO 67985807 from the Institute of Computer Science of the Czech Academy of Sciences
Combining item purification and multiple comparison adjustment methods in detection of differential item functioning
No full textReproducibility code for the paper "Combining item purification and multiple comparison adjustment methods in detection of differential item functioning" by Adéla Hladká, Patrícia Martinková, and David Magis (Multivariate Behavioral Research, In Press, https://doi.org/10.1080/00273171.2023.2205393).
Funding information: grant number 21-03658S from the Czech Science Foundation and by the institutional support RVO 67985807 from the Institute of Computer Science of the Czech Academy of Sciences
Open-source CAT software: R packages and Concerto
No full textTogether with the investigation of new or updated CAT procedures, it is of primary importance to ensure development of appropriate, flexible and useful CAT software. Open-source CAT algorithms have been recently proposed and are offering very promising tools for future practical CAT implementations, though yet under development.
After a brief overview of available (commercial) software, I will present and compare the characteristics of some open-source R packages as CAT solutions: catR (Magis, & Raîche, 2012), catIrt (Nydick, 2013) and MAT (Choi, 2011), as well as the R-based software Firestar (Choi, 2009). A more complete description of catR will be given and (depending on time and computer constraints) a short illustrative session will be proposed. Finally, the web platform Concerto (Kosinski & Rust, 2011) will be shortly introduced.
References:
Choi, S. W. (2009). Firestar: Computerized adaptive testing simulation program for polytomous item response theory models. Applied Psychological Measurement, 33, 644-645.
Choi, S. W. (2011). MAT: Multidimensional Adaptive Testing (MAT). R package version 0.1-3.
Kosinski, M., & Rust, J. (2011). The development of Concerto: An open source online adaptive testing platform. Paper presented at the International Association for Computerized Adaptive Testing, Pacific Grove, CA.
Magis, D., & Raîche, G. (2012). Random generation of response patterns under computerized adaptive testing with the R package catR. Journal of Statistical Software, 48 (8), 1-31.
Nydick, S. W. (2013). catIrt: An R package for simulating IRT-based computerized adaptive tests. R package version 0.4-1
Asymptotic distribution of robust estimators of ability and applications
No full textIn item response theory (IRT), ability estimation can be seriously affected by abnormal responses occurring from e.g., cheating, inattention, lack of time, guessing, tiredness, stress… Those phenomena may influence the ability estimation process tremendously. One the one hand, person fit indices were developed as post-hoc approaches to identify abnormal responses patterns as a whole (e.g., Meijer & Sijtsma, 2001). On the other hand, getting uncontaminated ability estimates would also be a challenging issue.
Robust estimators were proposed in the IRT framework to lessen the impact of abnormal responses onto the estimation process (Mislevy & Bock, 1982; Schuster & Yuan, 2011; Wainer & Wright, 1980). Yet, these estimators are still rarely used in practice, mostly because very little is known about their statistical properties.
The purpose of this talk is to briefly present these robust ability estimators, and to derive their asymptotic distribution under mild regularity conditions. In particular, a simple formula for the asymptotic standard error (ASE) of these estimators is obtained (Magis, in press). Results of a simulation study that involves both presence and absence of cheating in the data generation process will be outlined.
References:
Magis, D. (in press). On the asymptotic standard error of a class of robust estimators of ability in dichotomous item response models. British Journal of Mathematical and Statistical Psychology.
Meijer, R., & Sijtsma, K. (2001). Methodology review: Evaluating person fit. Applied Psychological Measurement, 25, 107-135. doi: 10.1177/01466210122031957
Mislevy, R. J., & Bock, R. D. (1982). Biweight estimates of latent ability. Educational and Psychological Measurement, 42, 725-737. doi: 10.1177/001316448204200302
Schuster, C., & Yuan, K.-H. (2011). Robust estimation of latent ability in item response models. Journal of Educational and Behavioral Statistics, 36, 720-735. doi: 10.3102/1076998610396890
Wainer, H., & Wright, B. D. (1980). Robust estimation of ability in the Rasch model. Psychometrika, 45, 373-391. doi: 10.1007/BF0229391
REALISME MAGIS DALAM NOVEL O KARYA EKA KURNIAWAN
No full textTujuan penelitian ini ialah mengetahui bentuk dari realisme magis pada novel O
dengan rumusan masalah bagaimana realisme magis dalam novel O karya Eka
Kurniawan. Metode yang digunakan ialah metode Close Reading dengan teknik
analisis isi melalui pendekatan postmodernisme. Metode close reading yang
digunakan hanya mengambil diksi-diksi dari kutipan yang membentuk realisme
magis dan tema-tema kecil, serta tema utama untuk menemukan pesan dalam
novel. Penelitian ini dilakukan di Jakarta, selama semester genap tahun
2016/2017. Penelitian ini difokuskan pada bentuk realisme magis dalam novel O.
Adapun subfokus penelitian ini ialah menganalisis realisme magis dengan lima
karakteristik yang dirumuskan oleh Wendy.B Faris. Untuk menganalisis
penelitian dibantu oleh tabel analisis lima karakteristik realisme magis dengan
kriteria analisis yang meliputi (1) irreducible element (elemen tak tereduksi), (2)
phenomenal world (dunia fenomenal), (3) unsettling doubt (keraguan yang
meresahkan), (4) merging realms (penggabungan dua dunia/wilayah) dan (5)
Disruption of time, space, and identity (gangguan waktu, ruang, dan identitas).
Berdasarkan hasil analisis menggunakan lima karakteristik realisme magis, novel
O karya Eka Kurniawan memenuhi lima karakteristik realisme magis dengan
karakteristik yang dominan adalah karakteristik phenomenal world (dunia
fenomenal). Hal ini didasari oleh permainan narasi oleh pengarang terhadap
peleburan hal fantasi dan realitas yang tidak ingin terlempar secara jauh ke dalam
sebuah realisme. Dari hasil analisis itulah terbentuk sebuah pesan secara implisit
mengenai hakikat hidup. Jadi, dapat dikatan lima karakteristik realisme magis
tersebut memiliki keterkaitan satu sama lain dalam mewujudkan bentuk dari
realisme magis pada novel yang dianalisis. (M.Y.M).
The purpose of this study is to know the form of magical realism in novel O with
the formulation of the problem is how the magical realism in the novel O by Eka
Kurniawan. The method used is the method of Close Reading with content
analysis techniques through postmodernism approach. The method of close
reading that is used only takes the dictions from the citation which forms magical
realism and small themes, as well as the main theme for finding the message in
the novel. This research was conducted in Jakarta, during the even semester of
2016/2017. This research is focused on the form of magical realism in novel O.
The subfokus of this research is to analyze the magical realism with five
characteristics formulated by Wendy.B Faris. To analyze the research is assisted
by the analysis table of the five characteristics of magical realism with the
analysis criteria that include (1) irreducible element, (2) phenomenal world, (3)
unsettling doubt, (4) merging realms, and (5) Disruption of time, space, and
identity. Based on the results of the analysis using the five characteristics of
magical realism, novel O works by Eka Kurniawan meet the five characteristics of
magical realism with the dominant characteristic is phenomenal world
characteristic. It is based on a narrative game by the author of the fusion of
fantasy and reality that does not want to be thrown into a realism. From the results
of that analysis formed an implicit message about the nature of life. Thus, the five
characteristics of magical realism are related to each other in realizing the form of
magical realism in the novel analyzed. (M.Y.M
Differential item functioning among multiple groups: an outlier identification approach
No full textDifferential item functioning (DIF) has received increasing focus in the past decades. Recently, Magis and De Boeck (2010) proposed to identify differentially functioning items as outliers in a one-dimensional space of DIF measures, using robust statistical tools for outlier identification. The purpose of this talk is to present an extension of this approach for the case of more than one focal group.
In this multiple group framework, items can be characterized by multiple vectors of DIF measures, one for each focal group, so that a multivariate DIF space is obtained. DIF items can then be identified as outliers in this multivariate space, based on robust multivariate estimators of location and dispersion. The MCD (Minimum Covariance Determinant) estimator is shown to be adequate for this purpose. A major asset of the method that it can rely on existing DIF indices to define the DIF vectors, and that it does not need a purification step. Alternatively, it can be used to determine on an anchor set. The method will be illustrated by an example about calculator effects on mathematics test items
An efficient standard error formula for the weighted likelihood estimator of ability
No full textThe weighted likelihood estimator (WLE; Warm, 1989) has become a very popular ability estimator in item response theory. It was developed to basically cancel the estimation bias of the maximum likelihood estimator (MLE) with short tests. However, some uncertainty remains about its standard error formula. Warm (1989) established the asymptotic equivalence of the standard errors of both MLE and WLE, but there exists actually various practical formulas for the latter (Magis & Raîche, 2012; Nydick, 2013; Partchev, 2012; Warm, 2007), leading obviously to confusion.
The purpose of this talk is to briefly sketch a general approach to derive a first-order approximation of the standard error of the WLE. Based on asymptotic adjustments of the law of large numbers and central limit theorem, a simple formula is derived. The efficiency of the latter is compared to aforementioned formulas by means of a simulation study under Rasch modeling. Preliminary results indicate that the derived formula has lower bias and RMSE than any other competing formula, especially with short tests. All formulas behave similarly with longer tests, as expected
Finiteness of the weighted likelihood estimator and applications to CAT
No full textThe purpose of this talk is to present some recent research on the weighted likelihood estimator (WLE) of ability in item response theory (IRT). This estimator is quite commonly used as an alternative to usual maximum likelihood and Bayesian estimators. However, the uestion of providing finite ability estimates was left unsolved and led to some controversy. Recently, Magis and Verhelst (in press) established that the WLE always returns finite values, independently of the IRT model, the number of items, and the item responses. This general result will be briefly outlined.
The finiteness of the WLE has straightforward impact within the field of computerized adaptive testing (CAT). One technical and crucial issue in CAT is to accurately estimate the latent ability at the early stages of the adaptive process, when only a few items are available. Currently heuristic adjustments are adviced to avoid infinite estimates with only a few item responses. In this talk it will be highlighted how the use of the WLE throughout the CAT can be a promising and performant approach to solve this issue
- …
