Outcomes Research Primer

Piccirillo JF Outcomes research and otolaryngology. Otolaryngol Head Neck Surg 1994;111:764–9.

Roper WL Winkenwerder W Hackbarth GM Krakauer H. Effectiveness in health care. An initiative to evaluate and improve medical practice. N Engl J Med 1988;319: 1197–202.

Epstein AM The outcomes movement—will it get us where we want to go? N Engl J Med 1990;323:266–9.

Relman AS Assessment and accountability. The third revolution in medical care. N Engl J Med 1988;319: 1220–2.

Bergner M. Quality of life, health status, and clinical research. Med Care 1988;27:S148–56.

Cella DF Bonomi AE Measuring quality of life: 1995 update. Oncology 1995;9:47–60.

Charlson ME Pompei P Ales HL . A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J Chronic Dis 1987;40:373–83.

Chassin MR Kosecoff J Park RE . Does inappropriate use explain geographic variations in the use of health care services? JAMA 1987;258:2533–7.

D'Agostino RB Kwan H. Measuring effectiveness: What to expect without a randomized control group. Med Care 1995;33:AS95–105.

Donabedian A. The quality of care: How can it be assessed? JAMA 1988;260:1743–8.

Eddy DM Clinical decision making: From theory to practice. Cost-effectiveness analysis. A conversation with my father. JAMA 1992a;267: 1669–75.

Eisenberg JM Economics. JAMA 1995;273:1670–1.

Ellwood PM Shattuck lecture—outcomes management. A technology of patient experience. N Engl J Med 1988;318: 1549–56.

Epstein AM The outcomes movement—Will it get us where we want to go? N Engl J Med 1990;323:266–9.

Feinstein AR Clinical biostatistics. XLI. Hard science, soft data, and the challenges of choosing clinical variables in research. Clin Pharmacol Ther 1977;22: 485–98.

Gill TM Feinstein AR A critical appraisal of the quality of quality-of-life measurements. JAMA 1994;272:619–26.

Greenfield S. The state of outcomes research: Are we on target? [editorial]. N Engl J Med 1989;320:1142–3.

Guyatt GH Bombardier C Tugwell PX Measuring disease-specific quality of life in clinical trials. Canadian Medical Association Journal 1986;134:889–95.

Iezzoni LI Severity of illness measures. Comments and caveats. Med Care 1990;28: 757–61.

Kassirer JP The quality of care and the quality of measuring it. N Engl J Med 1993;329:1263–5.

Katz JN Larson MG Phillips CB Fossel AH Liang MH Comparative measurement sensitivity of short and longer health status instruments. Med Care 1992;30:917–25.

Leape LL Park RE Solomon DH Chassin MR Kosecoff J Brook RH Does inappropriate use explain small-area variations in the use of health care services? JAMA 1990;263:669–72.

Lohr KN Outcome measurement: Concepts and questions. Inquiry 1988;25:37–50.

Patrick DL Deyo RA Generic and disease-specific measures in assessing health status and quality of life. Med Care 1989;27:S217–32.

Phelps CE The methodologic foundations of studies of the appropriateness of medical care. N Engl J Med 1993;329:1241–5.

Piccirillo JF Outcomes research and otolaryngology. Otolaryngol Head Neck Surg 1994;111:764–9.

Piccirillo JF Feinstein AR Black-box mathematics and medical practice. Arch Otolaryngol Head Neck Surg 1993;119:147–55.

Pliskin N Taylor AK General principles: Cost benefit and decision analysis. In: Bunker J Barnes B Mosteller F , editors. Costs, risks and benefits of surgery. New York: Oxford University Press; 1977. p. 5–27.

Relman AS Assessment and accountability. The third revolution in medical care. N Engl J Med 1988;319: 1220–2.

Roper WL Winkenwerder W Hackbarth GM Krakauer H. Effectiveness in health care. An initiative to evaluate and improve medical practice. N Engl J Med 1988;319: 1197–202.

Rubin HR Gandek B Rogers WH Kosinsji M McHorney CA Ware JE Jr. Patients' ratings of outpatient visits in different practice settings. Results from the Medical Outcomes Study. JAMA 1993;270: 835–40.

Sackett DL Rosenberg WMC Gray JAM Haynes RB Richardson WS Evidence based medicine: What it is and what it isn't. BMJ 1996;312:71–2.

Tarlov AR Ware JE Jr, Greenfield S Nelson EC Perrin E Zubkoff M. The Medical Outcomes Study: An application of methods for monitoring the results of medical care. JAMA 1989;262:925–30.

Wennberg J Gittelsohn A. Variations in medical care among small areas. Sci Am 1982;246:120–34.

Wennberg JE Outcomes research, cost containment, and the fear of health care rationing. N Engl J Med 1990;323:1202–4.

Assessing medical technologies. Washington (DC): National Academy Press; 1985.

Committee on Methods for Setting Priorities for Guidelines Development, Institute of Medicine. In: Field MJ , editor. Setting priorities for clinical practice guidelines. Washington (DC): National Academy Press; 1995.

Aaronson NK Quality of life assessment in clinical trials. Control Clin Trials 1989;10:195S–208S.

Aaronson NK Quality of life research in clinical trials. A need for common rules and language. Oncology 1990;4: 59–66.

Anderson JP Kaplan RM Berry CC Bush JW Rumbaut RG Interday reliability of function assessment for a health status measure: The Quality of Well-Being Scale. Med Care 1989;27:1076–84.

Apgar V. A proposal for a new method of evaluation of the newborn infant. Anesth Analg 1953;32:260–7.

Baldwin LM Inui TS Stenkamp S. The effect of coordinated, multidisciplinary ambulatory care on service use, charges, quality of care and patient satisfaction in the elderly. J Community Health 1993;18:95–108.

Bergner M. Measurement of health status. Med Care 1985;23:696–704.

Bergner M Bobbitt RA Carter WB Gilson BS The Sickness Impact Profile: Development and final revision of a health status measure. Med Care 1981;19:787–805.

Berwick DM Continuous improvement as an ideal in health care. N Engl J Med 1989;320:53–6.

Berwick DM Godfrey AB Roessner J. Curing health care. San Francisco (CA): Jossey-Bass; 1990.

Bjelle A. Functional status assessment. Curr Opin Rheumatol 1991;3:280–5.

Borchardt WW Patient perception of quality in the clinic setting and relevant strategies for improvement. College Review 1994;6:72–97.

Brazier JE Harper R Jones NMB . Validating the SF-36 health survey questionnaire: New outcome measure for primary care. BMJ 1992;305:160–4.

Brook RH Lohr KN Monitoring quality of care in the Medicare program. Two proposed systems. JAMA 1987;258: 3138–41.

Brook RH McGlynn EA Maintaining quality of care. In: Ginzberg E , editor. Health services research. Key to health policy. Cambridge (MA): Harvard University Press; 1991. p. 284–314.

Brook RH Ware JE Davies-Avery A . Overview of adult health status measures fielded in Rand's Health Insurance Study. Med Care 1979;17:1–131.

Brook RH Ware JE Rogers WH . Does free care improve adults' health? Results from a randomized trial. N Engl J Med 1983;309:1426–34.

Busschbach JJV Horikx PE van den Bosch JMM De la Riviere AB de Charro FT Measuring the quality of life before and after bilateral lung transplantation in patients with cystic fibrosis. Chest 1994;105:911–7.

Caine N Harrison SC Sharpies LD Wallwork J. Prospective study of quality of life before and after coronary bypass grafting. BMJ 1991;302:511–6.

Carey RG Lloyd RC Measuring quality improvement in health care. A guide to statistical process control applications. New York: Quality Resources; 1995.

Cella DF Cherin EA Quality of life during and after cancer treatment. Compr Ther 1988;14:69–75.

Cella DF Tulsky DS Measuring quality of life today: Method-ologic aspects. Oncology 1990;4:29–38.

Cella DF Tulsky DS Gray G . The functional assessment of cancer therapy scale: Development and validation of the general measure. J Clin Oncol 1993;11:570–9.

Chassin MR Kosecoff J Park RE . Indications for selected medical and surgical procedures: a literature review and ratings of appropriateness: coronary angiography, publication R3204/1-CWF-HF-HCFA-PMT-RWJ. Santa Monica (CA): The Rand Corp; 1986.

Chassin MR Kosecoff J Solomon DH Brook RH How coronary angiography is used. Clinical determinants of appropriateness. JAMA 1987;258: 2543–7.

Cleary PD McNeil BJ Patient satisfaction as an indicator of quality of care. Inquiry 1988;25:25–36.

Davies AR Ware JE Involving consumers in quality of care assessment. Health Aff (Millwood) 1988;7:33–48.

Daugherty C Ratain MJ Grochowski E . Perceptions of cancer patients and their physicians involved in phase I trials. J Clin Oncol 1995;13:1062–72.

de Haes JCJM van Knippenberg FCE Quality of life of cancer patients: Review of the literature. In: Aaronson NK Beckmann J , editors. The quality of life of cancer patients. New York: Raven Press; 1987. p. 167–82.

Deyo RA Carter WB Strategies for improving and expanding the application of health status measures in clinical settings. A researcher-developer viewpoint [discussion], Med Care 1992;30:176–86.

Deyo RA Patrick DL The significance of treatment effects: The clinical perspective. Med Care 1995;33:AS286–91.

Donovan JL Frankel SJ Eyles JD Assessing the need for health status measures. J Epidemiol Community Health 1993:47:158–62.

Eisenberg JM Clinical economics. A guide to the economic analysis of clinical practice. JAMA 1989;262: 2879–86.

Elinson J. In discussion: Donabedian A Spitzer W Tarlov A. Advances in health assessment conference discussion panel J Chronic Dis 1987;40(Suppl 1):183S–91S.

Elmore JG Feinstein AR A bibliography of publications on observer variability (final installment). J Clin Epidemiol 1992;45:567–80.

Epstein AM Hall JA Tognetti J . Using proxies to evaluate quality of life. Med Care 1989;27:S91–8.

Feinstein AR The pre-therapeutic classification of co-morbidity in chronic disease. J Chron Dis 1970;23:455–69.

Feinstein AR Clinical biostatistics. XVI. The process of prognostic stratification. Part 2. Clin Pharmacol Ther 1972;13: 609–24.

Feinstein AR Clinical biostatistics. XIV. The purposes of prognostic stratification. Clin Pharmacol Ther 1972;13: 285–97.

Feinstein AR The ‘chagrin factor’ and qualitative decision analysis. Arch Intern Med 1985;145:1257–9.

Feinstein AR Para-analysis, faute de mieux, and the perils of riding on a data barge. J Clin Epidemiol 1989;42:929–35.

Feinstein AR Horwitz RI Double standards, scientific methods, and epidemiologic research. N Engl J Med 1982;307:1611–7.

Ferrans CE Powers MJ Quality of life index: Development and psychometric properties. Adv Nurs 1985;8:15–24.

Fowler FJ Cleary PD Magaziner J Patrick DL Benjamin KL Methodological issues in measuring patient-reported outcomes: The agenda of the work group on outcomes assessment. Med Care 1994;32(Suppl):JS65–76.

Fries JF Spitz PW The hierarchy of patient outcome. In: Spilker B , editor. Quality of life assessments in clinical trials. New York: Raven Press; 1990. p. 25–35.

Garnick DW Hendricks AM Comstock CB Measuring quality of care: Fundamental information from administrative datasets. Int J Qual Health Care 1994;6:163–77.

Geigle R Jones SB Outcomes measurement: A report from the front. Inquiry 1990;27:7–13.

Glaser EM Using behavioral science strategies for defining the state-of-the-art. J Appl Behav Sci 1980;16:79–92.

Goldberg HI Martin DP Christensen DB Neighbor WE Inui TS LoGerfo JP The Health of the Public Program at the University of Washington: A new role for academic medical centers. Acad Med 1991;66:499–505.

Goldmann DA Contemporary challenges for hospital epidemiology. Am J Med 1991;91:8S–15S.

Gonnella JS Hornbrook MC Louis DZ Staging of disease. A case-mix measurement. JAMA 1984;251: 637–44.

Gotay CC Korn EL McCabe MS Moore TD Cheson BD Quality-of-life assessment in cancer treatment protocols: Research issues in protocol development. J Natl Cancer Inst 1992;84:575–9.

Gouveia WA Bungay KM Massaro FJ Ware JE Jr. Paradigm for the management of patient outcomes [see comments]. Am J Hosp Pharm 1991;48:1912–6.

Greco PJ Eisenberg JM Changing physicians' practices. N Engl J Med 1993;329:1271–4.

Greene MG Adelman RD Friedmann E Charon R. Older patient satisfaction with communication during an initial medical encounter. Soc Sci Med 1994;38:1279–88.

Greenfield S Aronow HU Elashoff RM Watanbe D. Flaws in mortality data. The hazards of ignoring comorbid disease. JAMA 1988;260: 2253–5.

Greenfield S Kaplan S Ware JE Jr. Expanding patient involvement in care. Effects on patient outcomes. Ann Intern Med 1985;102: 520–8.

Greenfield S Nelson EC Recent developments and future issues in the use of health status assessment measures in clinical settings. Med Care 1992;30:MS23–41.

Griner PF Mayewski RJ Mushlin AI Greenland P. Selection and interpretation of diagnostic tests and procedures. Ann Intern Med 1981;94:553–600.

Guyatt G Feeny D Patrick D. Issues in quality of life measurement in clinical trials. Control Clin Trials 1991;12:81S–90S.

Guyatt GH Cook DJ Health status, quality of life, and the individual [commentary]. JAMA 1994;272:630–1.

Harrell FE Lee KL Califf RM Pryor DB Rosati RA Regression modelling strategies for improved prognostic prediction. Stat Med 1984;3:143–52.

Hays RD Anderson R Revicki D. Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res 1993;2:441–9.

Hays RD Kravitz RL Mazel RB . The impact of patient adherence on health outcomes for chronic disease patients in the Medical Outcomes Study. J Behav Med 1994;17:347–60.

Hays RD Stewart AL Construct validity of MOS health measures. In: Stewart AL Ware JE , editors. Measuring functioning and well-being: The Medical Outcomes Study approach. Durham (NC): Duke University Press; 1992, p. 325–42.

Hays RD Stewart AL Sleep measures. In: Stewart AL Ware JE , editors. Measuring functioning and well-being: the Medical Outcomes Study approach. Durham (NC): Duke University Press; 1992. p. 235–59.

Health Services Research Group. A guide to direct measures of patient satisfaction in clinical practice. Can Med Assoc J 1992;146:1727–31.

Horwitz RI Feinstein AR The application of therapeutic-trial principles to improve the design of epidemiologic research: A case-control study suggesting that anticoagulants reduce mortality in patients with myocardial infarction. J Chronic Dis 1981;34:575–83.

Iezzoni LI Using risk-adjusted outcomes to assess clinical practice: An overview of issues pertaining to risk adjustment. Ann Thorac Surg 1994;58:1822–6.

Iezzoni LI Daley J Heeren T . Using administrative data to screen hospitals for high complication rates. Inquiry 1994;31:40–55.

Iezzoni LI Foley SM Heeren T . A method for screening the quality of hospital care using administrative data: Preliminary validation results. Qual Rev Bull 1992;18:361–71.

Iezzoni LI Greenberg LG Widespread assessment of risk-adjusted outcomes: Lessons from local initiatives. Jt Comm J Qual Improv 1994;20:305–16.

Iezzoni LI Restuccia JD Shwartz M . The utility of severity of illness information in assessing the quality of hospital care. The role of the clinical trajectory. Med Care 1992;30: 428–44.

Jaeschke R Guyatt GH How to develop and validate a new quality of life instrument. In: Spilker B , editor. Quality of life assessments in clinical trials. New York: Raven Press; 1990. p. 47–57.

Jenkins CD Assessment of outcomes of health intervention. Soc Sci Med 1992;35:367–75.

Jenkins CD Jono RT Stanton BA Stroup-Benham CA The measurement of health-related quality of life: Major dimensions identified by factor analysis. Soc Sci Med 1990;31:925–31.

Juniper EF Guyatt GH King DR Comparison of methods for selecting items for a disease-specific quality of life questionnaire: Importance versus factor analysis. Qual Life Res 1994;3:52–3.

Kahn KL Rogers WH Rubenstein LV Measuring quality of care with explicit process criteria before and after implementation of the DRG-based prospective payment system. JAMA 1990;264:1969–73.

Kahn KL Roth CP Kosecoff J . Indications for selected medical and surgical procedures: a literature review and ratings of appropriateness: diagnostic upper gastrointestinal endoscopy, publication R-3204/4-CWJ-HF-HCFA-PMT-RWJ. Santa Monica (CA): Rand Corp; 1986.

Kaplan MH Feinstein AR The importance of classifying initial co-morbidity in evaluating the outcome of diabetes mellitus. J Chronic Dis 1974;27:387–404.

Kaplan RM Anderson JP Wu AW . The Quality of Well-Being Scale: Applications in AIDS, cystic fibrosis, and arthritis. Med Care 1989;27:S27–43.

Katz S , editor. The Portugal Conference: Measuring quality of life and functional status in clinical and epidemiological research. J Chronic Dis 1987;40:459–650.

Knaus WA Draper EA Wagner DP Zimmerman JE APACHE II: A severity of disease classification system. Crit Care Med 1985;13:818–29.

Kosecoff J Kanouse DE Rogers WH . Effects of the National Institutes of Health Consensus Development Program on physician practice. JAMA 1987;258:2708–13.

Krahn M Gafni A. Discounting in the economic evaluation of health care interventions. Med Care 1993;31:403–18.

Krause NM Jay GM What do global self-rated health items measure? Med Care 1994;32:930–42.

L'Abbe KA Detsky AS O'Rourke K. Meta-analysis in clinical research. Ann Intern Med 1987;107:224–33.

Laffel G Blumenthal D. The case for using industrial quality management science in health care organizations. JAMA 1989;262:2869–73.

Langner SR Hutelmyer C. Patient satisfaction with outpatient human immunodeficiency virus care as delivered by nurse practitioners and physicians. Holistic Nursing Practice 1995;10:54–60.

Leebov W Vergare M Scott G. Patient satisfaction: a guide to practice enhancement. Oradell (NJ): Medical Economics; 1990.

Lewis CC Pantell RH Kieckheffer GM Assessment of children's health status: Field test of new approaches. Med Care 1989;27:s54–65.

Lewis JR Patient views on quality care in general practice: Literature review. Soc Sci Med 1994;39:655–70.

Light RJ Pillemer DB Summing up The science of reviewing research. Cambridge (MA): Harvard University Press; 1984.

Maklan CW Greene R Cummings MA Methodological challenges and innovations in patient outcomes research. Med Care 1994;32(Suppl):JS13–21.

McCormick B. Can research change the way MDs practice medicine? Hospitals 1990;64:32–6.

Merrick NJ Fink A Brook RH . Indications for selected medical and surgical procedures: a literature review and ratings of appropriateness: carotid endarterectomy, publication R-3204/6-CWJ-HF-HCFA-PMT-RWJ. Santa Monica (CA): Rand Corp; 1986.

Mills JL Sounding board: Data torturing. N Engl J Med 1993;329:1196–9.

Mitchell JB Bubolz T Paul JE . Using Medicare claims for outcomes research. Med Care 1994;32(Suppl):JS38–51.

Moinpour CM Feigl P Metch B Hayden KA Meyskens FL Crowley J. Quality of life endpoints in cancer clinical trials: Review and recommendations. J Natl Cancer Inst 1989;81:485–95.

Moloney TW Paul B. The consumer movement takes hold in medical care. Health Aff (Millwood) 1991;10:268–79.

Moses LE Measuring effects without randomized trials? Options, problems, challenges. Med Care 1995;33:AS8–14.

Mullan F Jacoby I. The town meeting for technology: The maturation of consensus conferences. JAMA 1985;254:1068–72.

New York State Department of Health. Coronary artery bypass surgery in New York State, 1990–1992. Albany (NY): New York State Department of Health; 1993.

Nolan TW Provost LP Understanding variation. Quality Progress 1990;5:70–8.

O'Brien BJ Buxton MJ Ferguson BA Measuring the effectiveness of heart transplant programs: Quality of life data and their relationship to survival analysis. J Chronic Dis 1987;40:137s–53s.

O'Brien BJ Buxton MJ Patterson DL Relationship between functional status and health-related quality-of-life after myocardial infarction. Med Care 1993;31:950–5.

O'Young J McPeek B. Quality of life variables in surgical trials. J Chronic Dis 1987;40:513–22.

Oye RK Landefeld CS Jayes RL Outcomes in SUPPORT. J Clin Epidemiol 1990;43(Suppl):83S–7S.

Palmer RH Strain R Maurer J Rothrock J Thompson M. Quality assurance in eight adult Medicare practices. Med Care 1984;22:632–43.

Park RE Brook RH Kosecoff J . Explaining variations in hospital death rates: Randomness, severity of illness, quality of care. JAMA 1992;264:484–90.

Parkerson GR Broadhead WE Tse C-KJ. Comparison of the Duke Health Profile and the MOS Short-Form in healthy young adults. Med Care 1991;29:679–83.

Parkerson GR Broadhead WE Tse C-KJ. The Duke Health Profile. A 17-item measure of health and dysfunction. Med Care 1990;28: 1056–72.

Parkerson GR Connis RT Broadhead WE Patrick DL Taylor TR Tse C-KJ. Disease-specific versus generic measurement of health-related quality of life in insulin-dependent diabetic patients. Med Care 1993;31:629–39.

Parkerson GR Gehlbach SH Wagner EH James SA Clapp NE Muhlbaier LH The Duke-UNC Health Profile: An adult health status instrument for primary care. Med Care 1981;XIX:806–27.

Patton MD Action research and the process of continual quality improvement in a cancer center. Oncol Nurs Forum 1993;20:751–5.

Pauker SG Kassirer JP Decision analysis. N Engl J Med 1987;316:250–7.

Payer L. Medicine and culture. New York: Penguin Books; 1988.

Perry S. The NIH Consensus Development Program: A decade later. N Engl J Med 1987;317:485–8.

Powe NR Turner JA Maklan CW Ersek M. Alternative methods for a formal literature review and meta-analysis in AHCPR patient outcomes research teams. Med Care 1994;32(Suppl):JS22–37.

Power EJ Identifying health technologies that work. From the Congressional Office of Technology Assessment. JAMA 1995;274:205.

Raskin IE Maklan CW Medical treatment effectiveness research: A view from inside the Agency for Health Care Policy and Research. Evaluation and the Health Professions 1991;14:161–86.

Richardson J. Cost utility analysis: What should be measured? Soc Sci Med 1994;39:7–21.

Robbins JA Bertakis KD Helms LJ Azari R Callahan EJ Creten DA The influence of physician practice behaviors on patient satisfaction. Fam Med 1993;25:17–20.

Ross CK Steward CA Sinacore JM A comparative study of seven measures of patient satisfaction. Med Care 1995;33:392–406.

Ruta DA Garratt AM Leng M Russell IT MacDonald LM A new approach to the measurement of quality of life: The patient-generated index. Med Care 1994;32:1109–26.

Safran DG Tarlov AR Rogers WH Primary care performance in fee-for-service and prepaid health care system: Results from the Medical Outcomes Study. JAMA 1994;271:1579–86.

Schag CAC Heinrich RL Development of a comprehensive quality of life measurement tool: CARES. Oncology 1990;4:135–8.

Schipper H. Guidelines and caveats for quality of life measurement in clinical practice and research. Oncology 1990;4:51–7.

Schipper H Clinch J McMurray A Levitt M. Measuring the quality of life of cancer patients: The Functional Living Index—cancer: Development and validation. J Clin Oncol 1984;2:472–83.

Scott IU Schein OD West S Bandeen-Roche K Enger C Folstein MF Functional status and quality of life measurement among ophthalmic patients. Arch Ophthalmol 1994;112:329–35.

Simmer TL Nerenz DR Rutt WM Newcomb CS Benfer DW A randomized, controlled trial of an attending staff service in general internal medicine. Med Care 1991;29:JS31–40.

Sox HC Blatt MA Higgins MC Marton KI Medical decision making. Stoneham (MA): Butterworths; 1989.

Spierer M Sims HW Micklitsch CN Lewis BE Assessment of patient satisfaction as part of a physician performance evaluation: The Fallon Clinic experience. J Ambulatory Care Manage 1994;17:1–7.

Spitzer WO Dobson AJ Hall J . Measuring the quality of life of cancer patients. A concise QL-index for use by physicians. J Chronic Dis 1981;34: 585–97.

Sprangers MAC Cull A Bjordal K. The European organization for research and treatment of cancer approach to quality of life assessment: Guidelines for developing questionnaire modules. Qual Life Res 1993;2:287–95.

Stalfelt AM Quality of life during induction treatment of acute myeloid leukemia: A comparison of three intensive chemotherapy regimens using three instruments for quality of life assessment. Acta Oncol 1994;33:477–85.

Steinberg EP Bergner M Sommer A . Variations in cataract management: Patient and economic outcomes. Health Serv Res 1990;25:727–31.

Stewart AL Hays RD Ware JE Methods of constructing health measures. In: Stewart AL Ware JE , editors. Measuring functioning and well-being: The Medical Outcomes Study approach. Durham (NC): Duke University Press; 1992. p. 67–85.

Stewart AL Hays RD Ware JE Health perceptions, energy/fatigue, and health distress measures. In: Stewart AL Ware JE , editors. Measuring functioning and well-being: The Medical Outcomes Study approach. Durham (NC): Duke University Press; 1992. p. 143–72.

Street RL Gold WR McDowell T. Using health status surveys in medical consultations. Med Care 1994;32:732–44.

Tanenbaum SJ What physicians know. N Engl J Med 1993;329:1268–70.

Teasdale G Jennett B. Assessment of coma and impaired consciousness: A practical scale. Lancet 1974;2:81–4.

Tsvat J Weeks JC Guadagnoli E . Using health-related quality of life information: Clinical encounters, clinical trials, and health policy. J Gen Intern Med 1994;9:576–82.

Tunis SR Hayward RS Wilson MC Internists' attitudes about clinical practice guidelines. Ann Intern Med 1994;120:956–63.

Ware JE Standards for validating health measures: Definition and content. J Chronic Dis 1987;40:473–80.

Ware JE Davies AR Rubin HR Patients' assessments of their care Office of Technology Assessment The quality of medical care: information for consumers. Washington (DC): US Congress; 1988. p. 231–47.

Ware JE Hays RD Methods for measuring patient satisfaction with specific medical encounters. Med Care 1988;26:393–402.

Ware JE Sherbourne CD The MOS 36 Item Short-Form Health Survey (SF-36): I. Conceptual framework and item selection. Med Care 1992;30: 473–83.

Ware JE Snyder MK Dimensions of patient attitudes regarding doctors and medical care services. Med Care 1975;13:609–15.

Ware JE Snyder MK Wright WR Davies AR Defining and measuring patients' satisfaction with medical care. Evaluation and Program Planning 1983;6:247–63.

Ware JE Jr. Conceptualizing and measuring generic health outcomes. Cancer 1991;67:774–9.

Weinstein M Fineberg H. Clinical decision analysis. Philadelphia: WB Saunders; 1980.

Wen SW Hernandez R Naylor CD Pitfalls in nonrandomized outcomes studies. The case of incidental appendectomy with open cholecystectomy. JAMA 1995;274: 1687–91.

Wennberg J Gittelsohn A. Small area variations in health care delivery. Science 1973;182:1102–7.

Wennberg JE Barnes BA Zubkoff M. Professional uncertainty and the problem of supplier-induced demand. Soc Sci Med 1982;16:811–24.

Wennberg JE Bunker JP Barnes B. The need for assessing the outcomes of common medical practices. Annu Rev Public Health 1980;1:277–95.

Wennberg JE Roos N Sola L Schori A Jaffe R. Use of claims data systems to evaluate health care outcomes. Mortality and reoperation following prostatectomy. JAMA 1987;257: 933–6.

Wensing M Grol R Smits A. Quality judgements by patients on general practice care: A literature analysis. Soc Sci Med 1994;38:45–53.

Wilson SR Patient and physician behavior models related to asthma care. Med Care 1993;31:MS49–60.

Winkler JD Kanouse DE Brodsley L . Popular press coverage of eight National Institutes of Health consensus development topics. JAMA 1986;255:1323–7.

Wray NP Ashton CM Kuykendall DH . Selecting disease—outcomes pairs for monitoring the quality of hospital care. Med Care 1995;33:75–89.

Yerushalmy J. Statistical problems in assessing methods of medical diagnosis, with special reference to x-ray techniques. Public Health Rep 1947;62:1432–49.

Zubrod CG Schneiderman M Frei E. Appraisal of methods for the study of chemotherapy of cancer in man: Comparative therapeutic trial of nitrogen mustards and triethylene thiophosphoramide. J Chronic Dis 1960;11:7–30.

Consensus Development Panel. NIH Consensus Development Conference Consensus Statement on Acoustic Neuroma. Bethesda (MD): N1H; 1991 Dec 11–13.

Early identification of hearing impairment in infants and young children. NIH Consensus Statement, Mar 1–3. 1993;11(1):1–24.

Baker CA Factors associated with rehabilitation in head and neck cancer. Cancer Nurs 1992;15:395–400.

Benninger MS King F Nichols RD Management guidelines for improvement of otolaryngology referrals from primary care physicians. Otolaryngol Head Neck Surg 1995;113:446–52.

Bjordal K Kaasa S Mastekaasa A. Quality of life in patients treated for head and neck cancer: A follow-up study 7–11 years after radiotherapy. Int J Radiat Oncol Biol Phys 1994;28:847–56.

Browman GP Levine MN Hodson DI . The Head and Neck Radiotherapy Questionnaire: A morbidity/quality-of-life instrument for clinical trials of radiation therapy in locally advanced head and neck cancer. J Clin Oncol 1993;11:863–72.

Burns L Chase D Goodwin WJ Treatment of patients with stage IV cancer: Do the ends justify the means? Otolaryngol Head Neck Surg 1987;97:8–14.

Dana ST Sinusitis panel develops reimbursement criteria [out of committee]. AAO-HNS Bull 1993;12(12):11.

Fielder H Denholm SW Lyons RA . Measurement of health status in patients with vertigo. Clin Otolaryngol 1996;21:124–6.

Gliklich RE Hilinski JM Longitudinal sensitivity of generic and specific health measures in chronic sinusitis. Qual Life Res 1995;4:27–32.

Gliklich RE Metson R. A comparison of sinus computed tomography (CT) staging systems for outcomes research. Am J Rhinol 1994;8:291–7.

Gliklich RE Metson R. Techniques for outcomes research in chronic sinusitis. Laryngoscope 1995;105:387–90.

Gliklich RE Metson R. The health impact of chronic sinusitis in patients seeking otolaryngologic care. Otolaryngol Head Neck Surg 1995;113:104–9.

Gotay CC Moore TD Assessing quality of life in head and neck cancer. Qual Life Res 1992;1:5–17.

Grimby A Rosenthall U. Health-related quality of life and dizziness in old age. Gerontology 1995;41:286–98.

Grundfast KM Management of otitis media and the new Agency for Health Care Policy and Research guideline. Arch Otolaryngol Head Neck Surg 1994;120:797–8.

Hannley M. Academy enters outcomes research arena with new protocol: Treatment outcomes for obstructive sleep apnea [news & views from the office of research development]. AAO-HNS Bull 1992;11(9):33.

Harris JP Anderson JP Novak R. An outcomes study of cochlear implants in deaf patients: Audiologic, economic, and quality-of-life changes. Arch Otolaryngol Head Neck Surg 1995;121:398–404.

Hassan SJ Weymuller EA Jr. Assessment of quality of life in head and neck cancer patients. Head Neck 1993;15:485–96.

Hoffman SR Dersarkissian RM Buck SH Stinziano GD Buck GM Sinus disease and surgical treatment: A results oriented quality assurance study. Otolaryngol Head Neck Surg 1989;100:573–7.

Hoffman SR Mahoney MC Chmiel JF Stinziano GD Hoffman KN Symptom relief after endoscopic sinus surgery: An outcomes-based study. Ear Nose Throat J 1993;72:413–4, 419–20.

Isenberg SF Rosenfeld RM Problems and pitfalls in community-based outcomes research. Otolaryngol Head Neck Surg 1997;116:662–5.

Jacobson GP Newman CW The development of the dizziness handicap inventory. Arch Otolaryngol Head Neck Surg 1990;116:424–7.

Johns ME The medical appropriateness of tympanostomy tubes proposed for children younger than 16 years in the United States [editorial comment]. Arch Otolaryngol Head Neck Surg 1994;120:801–2.

Juniper EF Guyatt GH Development and testing of a new measure of health status for clinical trials in rhinoconjunctivitis. Clin Exp Allergy 1991;21:77–83.

Kleinman LC Kosecoff J Dubois RW Brook RH The medical appropriateness of tympanostomy tubes proposed for children younger than 16 years in the United States. JAMA 1994;271:1250–5.

Kuk FK Tyler RS Russell D . The psychometric properties of a tinnitus handicap questionnaire. Ear Hear 1990;11:434–45.

List MA Ritter-Sterr CA Baker TM Longitudinal assessment of quality of life in laryngeal cancer patients. Head Neck 1996;18:1–10.

Mangham CA Decision analysis of auditory brainstem responses and rotational vestibular tests in acoustic tumor diagnosis. Otolaryngol Head Neck Surg 1987;96:22–9.

McNeil BJ Weichselbaum R Pauker SG Speech and survival.

Meister S. Emerging risk: Failure to detect heating disability in newborns. The problem: Lack of screening programs for normal newborns. QRC Advisor 1993;10: 1–4.

Mulrow CD Aguilar C Endicott JE Quality-of-life changes and hearing impairment: A randomized trial. Ann Intern Med 1990;113:188–94.

Mulrow CD Aguilar C Endicott JE . Association between hearing impairment and the quality of life of elderly individuals. J Am Geriatr Soc 1990;38:45–50.

O'Rourke IC McNeil RJ Walker PJ Bull CA Objective evaluation of the quality of palliation in patients with oesophageal cancer comparing surgery, radiotherapy and intubation. Aust N Z J Surg 1992;62:922–30.

Piccirillo JF Decision analysis in head and neck cancer. Arch Otolaryngol Head Neck Surg 1991;117:933.

Piccirillo JF The inclusion of comorbidity in a staging system for head and neck cancer. Oncology 1995;9:831–6.

Piccirillo JF The use of patient satisfaction data to assess the impact of continuous quality improvement efforts in an academic otolaryngology office. Arch Otolaryngol Head Neck Surg 1996;122:1045–8.

Piccirillo JF Edwards D Haiduk A Yonan C Thawley SE Psychometric and clinimetric validity of the 31-item rhinosinusitis outcome measure (RSOM-31). Am J Rhinol 1995;9:297–306.

Plante DA Piccirillo JF Sofferman RA Decision analysis of treatment options in pyriform sinus carcinoma. Med Decis Making 1987;7:74–83.

Rosenfeld RM Pilot study of outcomes in pediatric rhinosinusitis. Arch Otolaryngol Head Neck Surg 1995;121:729–36.

Rosenfeld RM Mandel EM Bluestone CD Systemic steroids for otitis media with effusion in children. Arch Otolaryngol Head Neck Surg 1991;117:984–9.

Rubin HR Can patients evaluate the quality of hospital care? Med Care Rev 1990;47:267–326.

Rubin HR Wu AW Patient satisfaction: Its importance and how to measure it. In: Gitnick G , editor. The business of medicine: a physician's guide. New York: Elsevier Science Publishing; 1991. p. 397–409.

Sher AE Schechtman KB Piccirillo JF The efficacy of surgical treatments for obstructive sleep apnea. Sleep 1996;19:156–77.

Snyderman CH D'Amico F. Outcome of carotid artery resection for neoplastic disease: A meta-analysis. Am J Otolaryngol 1992;13:373–80.

The Otitis Media Guideline Panel. Clinical practice guideline, otitis media with effusion in young children. 1994 July. Publication No.: 94-0622. Rockville (MD): Agency for Health Care Policy and Research; 1994. p. iv.

Turner RG Nielsen DW Application of clinical decision analysis to audiological tests. Ear Hear 1984;5:125–33.

US Department of Health and Human Services. Managing otitis media with effusion in young children. Arch Otolaryngol Head Neck Surg 1994;120:793–6.

Weiss MH Harrison LB Isaacs RS Use of decision analysis in planning a management strategy for the stage NO neck [review]. Arch Otolaryngol Head Neck Surg 1994;120:699–702.