A Reliability Generalization Meta-Analysis of Coefficient Alpha for the Maslach Burnout Inventory

Abstract

The purpose of this study was to synthesize internal consistency reliability for the subscale scores on the Maslach Burnout Inventory (MBI). The authors addressed three research questions: (a) What is the mean subscale score reliability for the MBI across studies? (b) What factors are associated with observed variance in MBI subscale score reliability? (c) What are the implications for appropriate use based on MBI subscale mean internal consistency estimates? Of the 221 studies reviewed, 84 provided alpha coefficients and were used in the current analysis. Results suggest that mean alpha estimates across subscales generally fell within the .70 to .80 range. Scale variance and language most often accounted for the variance in coefficient alpha, although some variations were apparent between subscales. Of the three MBI subscales, Personal Accomplishment and Depersonalization mean alpha estimates were well below recommended levels for high-stakes decisions, such as the diagnosis of burnout syndrome. Recommendations for the use of the current version of the instrument’s scale scores as well as suggestions for scale refinement are provided.

Keywords

MBI burnout reliability generalization meta-analysis

References

Benevides-Pereira, A.M.T. , & Das Neves Alves, R. (2007). A study on burnout syndrome in healthcare providers to people living with HIV. AIDS Care , 19, 565-571.

Beretvas, S.N. , Meyers, J.L. , & Leite, W.L. ( 2002). A reliability generalization study of the Marlowe-Crowne Social Desirability Scale. Educational and Psychological Measurement , 62, 570-589.

Beretvas, S.N. , & Pastor, D.A. ( 2003). Using mixed-effects models in reliability generalization studies. Educational and Psychological Measurement, 63, 75-95.

Burnished or burnt out: The delights and dangers of working in health. (1994, December 10). Lancet, 344, 1583-1584.

Caruso, J.C. ( 2000). Reliability generalization of the NEO Personality Scales . Educational and Psychological Measurement, 60, 236-254.

Deditius-Island, H.K. , & Caruso, J.C. ( 2002). An examination of the reliability of scores from Zuckerman’s Sensation Seeking Scales, Form V. Educational and Psychological Measurement, 62, 728-734.

Hakstian, A.R. , & Whalen, T.E. ( 1976). A k-sample significance test for independent alpha coefficients . Psychometrika, 41, 219-231.

Halbesleben, J.R.B. , & Buckley, M.R. ( 2004). Burnout in organizational life. Journal of Management, 30, 859-879.

Halbesleben, J.R.B. , & Demerouti, E. ( 2005). The construct validity of an alternative measure of burnout: Investigating the English translation of the Oldenburg Burnout Inventory. Work and Stress, 19, 208-220.

10.

Henson, R.K. ( 2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.

11.

Kristensen, T.S. , Borritz, M. , Villadsen, E. , & Christiansen, K.B. (2005). The Copenhagen Burnout Inventory: A new tool for the assessment of burnout. Work & Stress, 19, 192-207.

12.

Legassie, J. , Zibrowski, E.M. , & Goldszmidt, M.A. (2008). Measuring resident well-being: Imposterism and burnout syndrome in residency. Journal of General Internal Medicine, 23, 1090-1095.

13.

Maslach, C. ( 1982). Burnout: The cost of caring. New York, NY: Prentice Hall.

14.

Maslach, C. , & Jackson, S.E. ( 1981). The measurement of experienced burnout. Journal of Occupational Behaviour, 2, 99-113.

15.

Maslach, C. , & Jackson. S.E. ( 1986). Maslach Burnout Inventory manual (2nd ed.). Palo Alto, CA: Consulting Psychologist’s Press.

16.

Maslach, C. , Jackson, S.E. , & Leiter, M. ( 1996). Maslach Burnout Inventory manual (3rd ed.). Palo Alto, CA: Consulting Psychologist’s Press.

17.

Maslach, C. , Schaufeli, W.B. , & Leiter, M.P. ( 2001). Job burnout. Annual Review of Psychology , 52, 397-422.

18.

Nunnally, J.C. ( 1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.

19.

Nunnally, J.C. , & Bernstein, I. ( 1994). Psychometric theory (3rd. ed.). New York, NY: McGraw-Hill .

20.

Panagopoulou, E. , Montgomery, A. , & Benos, A. ( 2006). Burnout in internal medicine physicians: Differences between residents and specialists. European Journal of Internal Medicine, 17, 195-200.

21.

Peterson, R.A. ( 1994). A meta-analysis of Cronbach’s coefficient alpha . Journal of Consumer Research, 21, 381-391.

22.

Poghosyan, L. , Aiken, L.H. , & Sloane, D.M. ( 2009). Factor structure of the Maslach Burnout Inventory: An analysis of data from large scale cross-sectional surveys of nurses from eight countries. International Journal of Nursing Studies, 46, 894-902.

23.

Rodriguez, M.C. , & Maeda, Y. ( 2006). Meta-analysis of coefficient alpha. Psychological Methods, 11, 306-322.

24.

Schaufeli, W.B. , Bakker, A.B. , Hoogduin, K. , Schaap, C. , & Kladler, A. ( 2001). On the clinical validity of the Maslach Burnout Inventory and the Burnout Measure. Psychology and Health, 16, 565-582.

25.

Schaufeli, W. , & Enzmann, D. ( 1998). The burnout companion to study and practice: A critical analysis. Philadelphia, PA: Taylor & Francis.

26.

Schaufeli, W.B. , & Taris, T.W. ( 2005). The conceptualization and measurement of burnout: Common ground and worlds apart. Work & Stress, 19, 256-262.

27.

Schaufeli, W.B. , & Van Dierendonck, D. (1995). A cautionary note about the cross-national and clinical validity of cut-off points for the Maslach Burnout Inventory. Psychological Reports, 76, 1083-1090.

28.

Shields, A.L. , & Caruso, J.C. ( 2004). A reliability induction and reliability generalization study of the Cage Questionnaire. Educational and Psychological Measurement, 64, 254-270.

29.

Shirom, A. ( 1989). Burnout in work organizations. In C. L. Cooper and I. T. Robertson (Eds.), International Review of Industrial and Organizational Psychology, Vol. IV, (pp. 25-49). New York: Wiley.

30.

Vacha-Haase, T. ( 1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6-20.

31.

Vacha-Haase, T. , Henson, R.K. , & Caruso, J.C. ( 2002). Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562-569.

32.

Vanheule, S. , Rosseel, Y. , & Vlerick, P. ( 2007). The factorial validity and measurement invariance of the Maslach Burnout Inventory for human services. Stress & Health, 23, 87-91.

33.

Vassar, M. , Wheeler, D.L. , & Worley, J.A. ( 2009). Score reliability in personality research. In L. B. Palcroft & M. V. Lopez (Eds.), Personality assessment: New research. (pp. 205-222). Hauppauge, NY: Nova Science.

34.

Viswesvaran, C. , & Ones, D.S. ( 2000). Measurement error in ‘‘big five factors’’ personality assessment: Reliability generalization across studies and measures . Educational and Psychological Measurement, 60, 224-235.

35.

Wallace, K.A. , & Wheeler, A.J. ( 2002). Reliability generalization of the life satisfaction index . Educational and Psychological Measurement, 62, 674-684.

36.

Weber, A. , & Jaekel-Reinhard, A. (2000). Burnout syndrome: A disease of modern societies? Occupational Medicine, 50, 512-517.

37.

Worley, J.A. , Vassar, M. , Wheeler, D.L. , & Barnes, L.L.B. (2008). Factor structure of scores from the Maslach Burnout Inventory: A review and meta-analysis of 45 exploratory and confirmatory factor-analytic studies. Educational and Psychological Measurement, 68, 797-823.

38.

Yin, P. , & Fan, X. ( 2000). Assessing the reliability of Beck Depression Inventory scores: Reliability generalization across studies. Educational and Psychological Measurement, 60, 201-223.

39.

Note: References for studies used in the meta-analysis can be found at the following URL: http://www.healthsciences.okstate.edu/ruralhealth/documents/MBIRGReferences.pdf