Mental Health QUERI Initiative: Expert Ratings of Criteria to Assess Performance for Major Depressive Disorder and Schizophrenia

Abstract

The purpose of this study was to examine mental health care experts' opinions about performance measures and associated data elements that could serve as the basis of an information system for monitoring the implementation of clinical practice guidelines for major depressive disorder (MDD) and schizophrenia in the Veterans Health Administration (VHA). Nineteen mental health care experts rated the meaningfulness and validity of performance measures and automated data elements. For MDD, experts rated the following measures as very meaningful and valid: (a) the results of depression screening, (b) the occurrence and results of diagnostic assessment for MDD, (c) the provision of antidepressant medication or psychotherapy, and (d) whether antidepressant medications were prescribed within the therapeutic dose range recommended by practice guidelines. For schizophrenia, expert reviewers rated therapeutic doses of antipsychotic medication and assessment for antipsychotic medication side effects as being very meaningful and valid. Performance measures that evaluate clinically significant aspects of care using specific, valid data elements are the most meaningful. Translation efforts by the VHA's Mental Health Quality Enhancement Research Initiative program include additional studies of the validity of some of the proposed data elements and the development of national clinical reminders for performance measures judged to be meaningful.

Keywords

Clinical practice guidelines depression performance measurement quality of care schizophrenia

References

1. Fischer EP , Marder SR , Smith GR , et al. Quality enhancement research initiative in mental health. Med Care. 2000;38(6 suppl 1):I-70-I-81.

2. Owen RR , Thrush CR , Kirchner JE , et al. Performance measurement for schizophrenia: adherence to guidelines for antipsychotic dose. Int J Qual Health Care. 2000;12:475-482.

3. Chen RS , Nadkarni PM , Levin FL , et al. Using a computer database to monitor compliance with pharmacotherapeutic guidelines for schizophrenia. Psychiatr Serv. 2000;51:791-794.

4. Lehman AF , Steinwachs DM , Survey Coinvestigators of the PORT Project. Patterns of usual care for schizophrenia: initial results from the Schizophrenia Patient Outcomes Research Team (PORT) client survey. Schizophr Bull. 1998;24:11-20.

5. Goldman LS , Nielsen NH , Champion HC . Awareness, diagnosis, and treatment of depression. J Gen Intern Med. 1999;14:569-580.

6. McQuaid JR , Stein MB , Laffaye C , et al. Depression in a primary care clinic: the prevalence and impact of an unrecognized disorder.J Affect Disord. 1999;55:1-10.

7. Wang PS , Berglund P , Kessler RC . Recent care of common mental disorders in the United States: prevalence and conformance with evidence-based recommendations. J Gen Intern Med. 2000;15:284-292.

8. Demakis JG , McQueen L , Kizer KW , et al. Quality Enhancement Research Initiative (QUERI): a collaboration between research and clinical practice. Med Care. 2000;38(6 suppl 1):I-17-I-25.

9. Cannon DS , Allen SN . A comparison of the effect of computer and manual reminders on compliance with a mental health clinical practice guideline. J Am Med Inform Assoc. 2000;7:196-203.

10.

10. McGlynn EA . Choosing and evaluating clinical performance measures. Jt Comm J Qual Improv. 1998;24:470-479.

11.

11. McGlynn EA , Asch SM . Developing a clinical performance measure. Am J Prev Med. 1998;14:14-21.

12.

12. Hudson TJ , Owen RR , Lancaster AE , et al. The feasibility of using automated data to assess guideline-concordant care for schizophrenia. J Med Syst. 1999;23:299-307.

13.

13. Rosenheck R , Leslie D , Sernyak M . From clinical trials to realworld practice: use of atypical antipsychotic medication nationally in the Department of Veterans Affairs. Med Care. 2001;39: 302-308.

14.

14. Austin SM , Balas EA , Mitchell JA , et al. Effect of physician reminders on preventive care: meta-analysis of randomized clini cal trials. Proc Annu Symp Comput Appl Med Care. 1994;121-124.

15.

15. Balas EA , Austin SM , Mitchell JA , et al. The clinical value of computerized information services. A review of 98 randomized clinical trials. Arch Fam Med. 1996;5:271-278.

16.

16. Shea S , DuMouchel W , Bahamonde L. A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. J Am Med Inform Assoc. 1996;3:399-409.

17.

17. Hunt DL , Haynes RB , Hanna SE , et al. Effects of computerbased clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998;280:1339-1346.