Special education has criticized many norm-referenced tests for their lack of demonstrated reliability with exceptional populations. Current advocacy of using criterion-referenced tests with handicapped persons has failed to consider the lack of empirical data on their reliability. A review of alternative methodologies and a conceptual framework for the study of reliability of criterion-referenced tests are presented. The possibility of aptitude-x-assessment interactions is considered and implications are discussed.
References
1.
Berk, R.A.Item analysis. In R. A. Berk (Ed.), Criterion-referenced measurement: The state of the art. Baltimore: The Johns Hopkins University Press, 1980.
2.
Brennan, R.L.Applications of generalizability theory. In R. A. Berk (Ed.), Criterion-referenced measurement: The state of the art. Baltimore: The Johns Hopkins University Press, 1980.
3.
Campbell, D.T., & Stanley, J.C.Experimental and quasi-experimental designs for research on teaching . In N. L. Gage (Ed.), Handbook of research on teaching. Chicago: Rand McNally, 1963.
4.
Connolly, A.J., Nachtman, W., & Pritchett, E.M.Key Math Diagnostic Arithmetic Test. Circle Pines, Minn.: American Guidance Service, 1971.
5.
Cronbach, L.G., Glaser, S.C., Nanda, H., & Rajaratnam, N.The dependability of behavioral measurement: Theory of generalizability for scores and profiles. New York: Wiley, 1972.
6.
Glaser, R., & Nitko, A.J.Measurement in learning and instruction. In R. L. Thorndike (Ed.), Educational measurement (2nd ed.). Washington, D.C.: American Council on Education, 1971.
7.
Goodstein, H.A.Individualizing instruction through matrix teaching. Education and Training of the Mentally Retarded, 1974, 9, 187-190.
8.
Goodstein, H.A., Kahn, H., & Cawley, J.F.The achievement of educable mentally retarded children on the Key Math Diagnostic Arithmetic Test. Journal of Special Education , 1976, 10, 61-70.
9.
Gorth, W.P., & Hambleton, R.K.Measurement considerations for criterion-referenced testing and special education. Journal of Special Education , 1972, 6, 303-314.
Hambleton, R.K.Test score validity and standard setting methods. In R. A. Berk (Ed.), Criterion-referenced measurement: The state of the art. Baltimore: The Johns Hopkins University Press, 1980.
12.
Hambleton, R.K., & Eignor, D.R.Guidelines for evaluating criterion-referenced tests and test manuals . Journal of Educational Measurement, 1978 , 15, 321-327.
13.
Hambleton, R.K., & Novick, M.R.Toward an integration of theory and method for criterion-referenced tests . Journal of Educational Measurement. 1973 , 10, 159-170.
14.
Hambleton, R.K., Swaninathan, H., Algina, J., & Coulson, D.B.Criterion-referenced testing and measurement: A review of technical issues and developments. Review of Educational Research, 1978, 48, 1-47.
15.
Hammill, D.D.Evaluating children for instructional purpose. Academic Therapy , 1971, 6, 341-353.
16.
Hively, W., Maxwell, G., Rabehl, G., Sension, D., & Lunden, S.Domain-referenced curriculum evaluation: A technical handbook and a case study from the MINNMAST Project. CSE Monograph Series in Evaluation , No. 1. Los Angeles: Center for the Study of Evaluation, University of California, 1973.
Mann, L.Psychometric phrenology and the new faculty psychology: The case against ability assessment and training. Journal of Special Education , 1971, 5, 3-14.
22.
Millman, J.Criterion-referenced measurement. In W. J. Popham (Ed.), Evaluation in education. Berkeley, Calif.: Mc-Cutchan, 1974 .
23.
Milman, J.Computer-based item generation. In R. A. Berk (Ed.), Criterion-referenced measurement: The state of the art. Baltimore: The Johns Hopkins University Press, 1980.
24.
Nitko, A.J.Varieties of criterion-referenced tests. Review of Educational Research, 1980, 50, 461-485.
Popham, W.J.Domain specification strategies. In R. A. Berk (Ed.), Criterion-referenced measurement: The state of the art. Baltimore: The Johns Hopkins University Press, 1980.
27.
Popham, W.J., & Husek, T.R.Implications of criterion-referenced measurement. Journal of Educational Measurement, 1969, 6, 1-9.
28.
Proger, R.B., & Mann, L.Criterion-referenced measurement: The world of gray versus black and white . Journal of Learning Disabilities, 1973, 6, 18-30.
29.
Rahmlow, H.F., & Woodley, K.K.Objectives-based testing: A guide to effective test development. Englewood Cliffs, N.J.: Educational Technology Publications , 1979.
30.
Stephens, T.M.Teaching skills to children with learning and behavior problems. Columbus, Ohio: Charles E. Merrill, 1977.
31.
Subkoviak, M.J.Decision consistency approaches. In R. A. Berk (Ed.), Criterion-referenced measurement: The state of the art. Baltimore: The Johns Hopkins University Press, 1980.
32.
Swaminathan, H., Hambleton, R.K., & Algina, J.Reliability of criterion-referenced tests: A decision theoretic formulation . Journal of Educational Measurement, 1974 , 11, 263-267.
33.
Wallace, G., & Kauffman, J.M.Teaching children with learning problems. Columbus, Ohio: Charles E. Merrill, 1978.
34.
Wiederholt, J.E., Hammill, D.D., & Brown, V.The resource teacher: A guide to effective practices. Boston: Allyn & Bacon, 1978.
Brennan, R.L.Extensions of generalizability theory to domain-referenced testing . (ACT Technical Bulletin, No. 30). Iowa City: The American College Testing Program, 1978.
37.
Goodstein, H.A.Accountability and the MR learner. Paper presented at the annual convention of the Council for Exceptional Children, Los Angeles , April 1975.
38.
Cronbach, L.G. , & Snow, R.E.Final report: Individual differences in learning ability as a function of instructional variables. Stanford, Calif.: Stanford University, March 1969.
