Measuring Deception: Test-Retest Reliability of Physicians’ Self-Reported Manipulation of Reimbursement Rules for Patients

Abstract

This study examined the test-retest reliability of physicians’ self-reported manipulation of reimbursement rules for patients. The test-retest reliability of self-report of three specific tactics were examined: (1) exaggerating the severity of patients’ conditions, (2) changing a patient’s official (billing) diagnosis, and (3) reporting signs or symptoms that patients did not have. The reliability of a scaled summary measure of physicians’manipulation of reimbursement rules was also assessed. Overall, the authors found high levels of test-retest agreement across all three items and the summary measure. These findings suggest that self-report can be used to produce reliable data on this controversial issue. Specifically, the three items reported here can be used to produce a reliable summary measure of physicians’manipulation of reimbursement rules to help patients obtain care that physicians perceive as necessary.

References

Aday, L. A. 1996. Designing and conducting health surveys. 2d ed. San Francisco: Jossey-Bass.

Azjen, I. , and M. Fishbein . 1980. Understanding attitudes and predicting social behavior. Englewood Cliffs, NJ: Prentice Hall.

Bernat, J. , S. Ringel , B. Vickrey , and C. Keran . 1997. Attitudes of neurologists concerning the ethical dimensions of managed care. Neurology 49:4-13.

Biemer, P. , S. Sudman , and R. M. Groves . 1991. Measurement errors in surveys. New York: John Wiley.

Bradburn, N. M. , S. Sudman , and Associates . 1979. Improving interview method and questionnaire design: Response effects to threatening questions in survey research. San Francisco: Jossey-Bass.

Cain, J. M. 1993. Is deception for reimbursement in obstetrics and gynecology justified? Obstetrics and Gynecology 82 (3): 475-478.

Carmines, E. G. , and R. A. Zeller . 1979. Reliability and validity assessment. Beverly Hills, CA: Sage.

Embree, B. G. , and P. C. Whitehead . 1993. Validation and reliability of self-reported drinking behavior: Dealing with the problem of response bias. Journal of Studies on Alcohol 54 (3): 334-344.

Ericksen, J. A. , and S. A. Steffer . 1999. Kiss and tell: Surveying sex in the twentieth century. Cambridge, MA: Harvard University Press.

10.

Fleiss, J. L. 1982. Statistical methods for rates and proportions. 2d ed. New York: John Wiley.

11.

Freeman, V. G. , S. S. Rathore , K. P. Weinfurt , K. A. Schulman , and D. P. Sulmasy , 1999. Lying for patients: Physician deception of third-party payers. Archives of Internal Medicine 159:2263-2270.

12.

Hilzenrath, D. 1998. Healing vs. honesty: For doctors, managed care’s cost controls pose moral dilemma. Washington Post, 15 March, H6.

13.

Kaiser Family Foundation . 1999. Survey of physicians and nurses. Menlo Park, CA: Henry J. Kaiser Family Foundation.

14.

Morreim, E. H. 1991. Gaming the system: Dodging the rules, ruling the dodgers. Archives of Internal Medicine 151:443-447.

15.

Novack, D. H. , B. J. Detering , R. Arnold , L. Forrow , M. Ladinsky , and J. C. Pezzullo . 1989. Physicians’ attitudes toward using deception to resolve difficult ethical problems. Journal of the American Medical Association 261 (20): 2980-2985.

16.

Nunnally, J. C. 1964. Educational measurement and evaluation. New York: McGraw-Hill.

17.

Nunnally, J. C. , and I. H. Bernstein . 1994. Psychometric theory. 3d ed. New York: McGraw-Hill.

18.

Parsons, J. A. , R. B. Warnecke , R. F. Czaja , J. Barnsley , and A. Kaluzny . 1994. Factors associated with response rates in a national survey of primary care physicians. Evaluation Review 18:756-766.

19.

Rost, K. , R. Smith , D. B. Matthews , and B. Guise . 1994. The deliberate misdiagnosis of major depression in primary care. Archives of Family Medicine 3:333-337.

20.

Shortell, S. M. , T. M. Waters , K. W. Clarke , and P. P. Budetti . 1998. Physicians as double agents: Maintaining trust in an era of multiple accountabilities. Journal of the American Medical Association 280 (12): 1102-1108.

21.

Sudman, S. , and N. M. Bradburn . 1974. Response effects in surveys: A review and synthesis. Chicago: Aldine.

22.

VanGeest, J. B. , M. K. Wynia , D. S. Cummins , and I. B. Wilson . 2001. Effects of different monetary incentives on the return rate of a national survey of physicians. Medical Care 39:197-201.

23.

Wynia, M. K. , D. S. Cummins , J. B. VanGeest , and I. B. Wilson . 2000. Physician manipulation of reimbursement rules for patients: Between a rock and a hard place. Journal of the American Medical Association 283:1858-1865.