A FORTRAN subroutine is presented to calculate a generalized measure of agreement between multiple raters and a set of correct responses at any level of measurement and among multiple responses, along with the associated probability value, under the null hypothesis.
References
1.
Berry, K. J. , & Mielke, P. W. (1988). A generalization of Cohen's kappa agreement measure to interval measurement and multiple raters. Educational and Psychological Measurement, 48, 921-933.
2.
Berry, K. J. , & Mielke, P. W. (1990). A generalized agreement measure. Educational and Psychological Measurement, 50, 123-125.
3.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
4.
Guetzkow, H. (1950). Unitizing and categorizing problems in coding qualitative data. Journal of Clinical Psychology, 6, 47-58.
5.
Hubert, L. (1977). Kappa revisited. Psychological Bulletin, 84, 289-297.
6.
Light, R. J. (1971). Measures of response agreement for qualitative data: Some generalizations and alternatives. Psychological Bulletin, 76, 365-377.
7.
Tukey, J. W. (1950). Discussion on symposium on statistics for the clinician. Journal of Clinical Psychology, 6, 61-74.
