Rajaratnam, Cronbach and Gleser's generalizability formula for stratified-parallel tests and Raju's coefficient beta are generalized to estimate the reliability of a composite of criterion-referenced tests, where the parts of the composite have different cutting scores. The new formulas are especially useful, for example, in estimating the reliability of a criterion-referenced test with several objectives, where each objective has a different cutting score. Livingston's and Brennan and Kane's formulas for criterion referenced tests are shown to be special cases of the new formulas.
References
1.
Brennan, R. L. and Kane, M. T.An index of dependability for mastery tests. Journal of Educational Measurement, 1977, 14, 277-289. (a).
2.
Brennan, R. L. and Kane, M. T.Signal/Noise ratio for domain-referenced tests. Psychometrika, 1977, 42, 609-625. (b).
3.
Cronbach, L. J.Coefficient alpha and the internal structure of tests . Psychometrika, 1951, 16, 297-334.
4.
Cronbach, L. J. , Gleser, G. C., Nanda, H., Rajaratnam, N.The dependability of behavioral measurements: The theory of generalizability for scores and profiles. New York, Wiley, 1972.
5.
Glaser, R. and Nitko, A. J.Measurement in learning and instruction. In R. L. Thorndike (ed.), Educational Measurement, Washington, D. C., American Council on Education, 1971.
6.
Hambleton, R. K. , Swaminathan, R., Algina, J., and Coulson, D. B.: Criterion-referenced testing and measurement: A review of technical issues and developments. Review of Educational Research, 1978, 48, 1-47.
7.
Hambleton, R. K. and Novick, M. R.: Toward an integration of theory and method for criterion-referenced tests. Journal of Educational Measurement, 1973, 10, 159-170.
8.
Harris, C. W.An interpretation of Livingston's reliability coefficient for criterion-referenced tests . Journal of Educational Measurement, 1972, 9, 27-29.
9.
Huynh, H.On the reliability of decisions in criterion-referenced testing . Journal of Educational Measurement, 1976, 13, 253-264.
10.
Kuder, G. F. and Richardson, M. W.: The theory of the estimation of the test reliability. Psychometrika, 1937, 2, 151-160.
11.
Livingston, S. A.Criterion-referenced applications of classical test theory . Journal of Educational Measurement, 1972, 9, 13-26.
12.
Lord, F. M. and Novick, M. R.Statistical theories of mental tests. Reading, Mass.: Addison-Wesley, 1998.
13.
Rajaratnam, N. , Cronbach, L. J., and Gleser, G. C.Generalizability of stratified-parallel tests. Psychometrika, 1965, 30, 39-56.
14.
Raju, N. S.A note on Livingston's coefficient for criterion-referenced tests. Paper presented at the annual meeting of The American Educational Research Association, New Orleans, 1973.
15.
Raju, N. S.A generalization of coefficient alpha . Psychometrika, 1977, 42, 549-565.
16.
Raju, N. S.Note on two generalizations of coefficient alpha . Psychometrika, 1979, 44, 347-349.
17.
Shavelson, R. J. , Block, J. H., and Ravitch, M. M.Criterion-referenced testing: Comments on reliability. Journal of Educational Measurement, 1972, 9, 133-137.
18.
Swaminathan, H. , Hambleton, R. K., and Algina, J.Reliability of criterion-referenced tests: A decision-theoretic formulation. Journal of Educational Measurement, 1974, 11, 263-268.
19.
Subkoviak, M.Estimating reliability from a single administration of a criterion-referenced test . Journal of Educational Measurement, 1976, 13, 265-275.
