Type I error rates for the likelihood ratio test for de tecting differential item functioning (DIF) were investi gated using monte carlo simulations. Two- and three-parameter item response theory (IRT) models were used to generate 100 datasets of a 50-item test for samples of 250 and 1,000 simulated examinees for each IRT model. Item parameters were estimated by marginal maximum likelihood for three IRT models: the three-parameter model, the three-parameter model with a fixed guessing parameter, and the two-parameter model. All DIF comparisons were simulated by ran domly pairing two samples from each sample size and IRT model condition so that, for each sample size and IRT model condition, there were 50 pairs of reference and focal groups. Type I error rates for the two-param eter model were within theoretically expected values at each of the α levels considered. Type I error rates for the three-parameter and three-parameter model with a fixed guessing parameter, however, were different from the theoretically expected values at the α levels considered.
Baker, F.B. (1988). GENIRV: Computer program for generating item responses [Computer program]. Madison: University of Wisconsin, Department of Educational Psychology, Laboratory of Experimental Design.
2.
Candell, G.L., & Drasgow, F. (1988). An iterative procedure for linking metrics and assessing item bias in item response theory. Applied Psychological Measurement, 12, 253-260.
3.
Cohen, A.S., & Kim, S.-H. (1993). A comparison of Lord's χ2 and Raju's area measures in detection of DIF. Applied Psychological Measurement ,17, 39-52.
4.
Draba, R.E. (1977). The identification and interpretation of item bias (Research Memorandum No. 25. Chicago: The University of Chicago, Department of Education, Educational Statistics Laboratory.
5.
Haebara, T. (1980). Equating logistic ability scales by a weighted least squares method. Japanese Psychological Research, 22, 144-149.
6.
Holland, P.W., & Thayer, D.T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 129-145). Hillsdale NJ: Erlbaum.
7.
Kim, S.-H., & Cohen, A.S. (1991). A comparison of two area measures for detecting differential item functioning. Applied Psychological Measurement , 15, 269-278.
8.
Kim, S.-H., & Cohen, A.S. (1992). Effects of linking methods on detection of DIF . Journal of Educational Measurement, 29, 551-566.
9.
Kim, S.-H., & Cohen, A.S. (1995). A comparison of Lord's chi-square, Raju's area measures, and the likelihood ratio test on detection of differential item functioning. Applied Measurement in Education, 8, 291-312.
10.
Kim, S.-H., Cohen, A.S., & Kim, H.-O. (1994). An investigation of Lord's procedure for detection of differential item functioning. Applied Psychological Measurement , 18, 217-228.
11.
Linn, R.L., Levine, M.V., Hastings, C.N., & Wardrop, J.L. (1981). Item bias in a test of reading comprehension. Applied Psychological Measurement, 5, 159-173.
12.
Lord, F.M. (1968). An analysis of the Verbal Scholastic Aptitude Test using Birnbaum's three-parameter logistic model. Educational and Psychological Measurement, 28, 989-1020.
13.
Lord, F.M. (1977). A study of item bias using item characteristic curve theory. In Y H. Poortinga (Ed.), Basic problems in cross-cultural psychology (pp. 19-29). Amsterdam , The Netherlands: Swets & Zeitlinger.
14.
Lord, F.M. (1980). Applications of item response theory to practical testing problems. Hillsdale NJ: Erlbaum.
15.
McLaughlin, M.E., & Drasgow, F. (1987). Lord's chi-square test of item bias with estimated and with known person parameters. Applied Psychological Measurement , 11, 161-173.
Mislevy, R.J., & Bock, R.D. (1990). BILOG 3: Item analysis and test scoring with binary logistic models [Computer program]. Mooresville IN: Scientific Software.
18.
Neyman, J., & Pearson, E.S. (1928). On the use and interpretation of certain test criteria for purposes of statistical inference: Part I and Part II. Biometrika, 20A, 174-240, 263-294.
19.
Park, D.G., & Lautenschlager, G.J. (1990). Improving IRT item bias detection with iterative linking and ability scale purification. Applied Psychological Measurement, 14, 163-173.
20.
Pine, S.M. (1977). Applications of item characteristic curve theory to the problem of test bias. In D. J. Weiss (Ed.), Applications of computerized adaptive testing: Proceedings of a symposium presented at the 18th annual convention of the Military Testing Association (Research Rep. No. 77-1, pp. 37-43). Minneapolis : University of Minnesota, Department of Psychology, Psychometric Methods Program.
21.
Raju, N.S. (1988). The area between two item characteristic curves . Psychometrika, 53, 495-502.
22.
Raju, N.S. (1990). Determining the significance of estimated signed and unsigned areas between two item response functions. Applied Psychological Measurement, 14, 197-207.
23.
Rudner, L.M. (1977, April). An approach to biased item identification using latent trait measurement theory. Paper presented at the annual meeting of the American Educational Research Association, New York.
24.
Shepard, L.A., Camilli, G., & Williams, D.M. (1984). Accounting for statistical artifacts in item bias research. Journal of Educational Statistics , 9, 93-128.
25.
Stocking, M., & Lord, F.M. (1983). Developing a common metric in item response theory . Applied Psychological Measurement, 7, 207-210.
Thissen, D., Steinberg, L., & Gerrard, M. (1986). Beyond group-mean differences: The concept of item bias. Psychological Bulletin, 99, 118-128.
28.
Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 147-169). Hillsdale NJ: Erlbaum.
29.
Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67-113). Hillsdale NJ: Erlbaum.
30.
Wainer, H. (1993). Model-based standardized measurement of an item's differential impact. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 123-135). Hillsdale NJ: Erlbaum.
31.
Wright, B.D., & Stone, M.H. (1979). Best test design. Chicago: MESA Press.
