Clinical predictions made by mental health practitioners are compared with those using statistical approaches. Sixty-seven studies were identified from a comprehensive search of 56 years of research; 92 effect sizes were derived from these studies. The overall effect of clinical versus statistical prediction showed a somewhat greater accuracy for statistical methods. The most stringent sample of studies, from which 48 effect sizes were extracted, indicated a 13% increase in accuracy using statistical versus clinical methods. Several variables influenced this overall effect. Clinical and statistical prediction accuracy varied by type of prediction, the setting in which predictor data were gathered, the type of statistical formula used, and the amount of information available to the clinicians and the formulas. Recommendations are provided about when and under what conditions counseling psychologists might use statistical formulas as well as when they can rely on clinical methods. Implications for clinical judgment research and training are discussed.
References
1.
Adams, K. M. (1974). Automated clinical interpretation of the neuropsychological battery: An ability-based approach. Unpublished doctoral dissertation, Wayne State University, Detroit, Michigan.
2.
Alexakos, C. E. (1966). Predictive efficiency of two multivariate statistical techniques in comparison with clinical predictions. Journal of Educational Psychology, 57, 297-306.
3.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
4.
Arkes, H. R. (1981). Impediments to accurate clinical judgment and possible ways to minimize their impact. Journal of Consulting and Clinical Psychology, 49, 323-330.
5.
Arkes, H. R. (1991). Costs and benefits of judgment errors: Implications for debiasing. Psychological Bulletin, 110, 486-498.
6.
Anastasi, A., & Urbina, S. (1996). Psychological testing(7th ed.). New York: Prentice Hall.
7.
Astrup, C. A. (1975). Predicted and observed outcome in followed-up functional psychosis. Biological Psychiatry, 10, 323-328.
8.
Barron, F. (1953). Some test correlates of response to psychotherapy. Journal of Consulting Psychology, 17, 235-241.
9.
Berven, N. L. (1985). Reliability and validity of standardized case management simulations. Journal of Counseling Psychology, 32, 397-409.
10.
Berven, N. L., & Scofield, M. E. (1980). Evaluation of clinical problem-solving skills through standardized case-management simulations. Journal of Counseling Psychology, 27, 199-208.
11.
Blocher, D. H. (1987). Process models for professional counseling. In The professional counselor. New York: MacMillan.
12.
Blumetti, A. E. (1972). A test of clinical versus actuarial prediction: A consideration of accuracy and cognitive functioning. Unpublished doctoral dissertation, University of Florida, Gainesville.
13.
Bolton, B. F., Butler, A. J., & Wright, G. N. (1968). Clinical versus statistical prediction of client feasibility. Wisconsin Studies in Vocational Rehabilitation[Monograph VII], University of Wisconsin Regional Rehabilitation Research Institute, Madison, WI.
14.
Bury, A. S., & Bagby, R. M. (2002). The detection of feigned uncoached and coached posttraumatic stress disorder with the MMPI-2 in a sample of workplace accident victims. Psychological Assessment, 14, 472-484.
15.
Carlin, A. S., & Hewitt, P. L. (1990). The discrimination of patient-generated and randomly generated MMPIs. Journal of Personality Assessment, 54, 24-29.
16.
Cohen, J. (1988). Statistical power analysis for the behavior sciences(2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
17.
Conrad, H. S., & Satter, G. A. (1954). The use of test scores and quality-classification ratings in predicting success in electrician's mates school. Project N-106: Research and development of the Navy's aptitude testing program. Princeton, NJ: Research and Statistical Laboratory College Entrance Examination Board.
18.
Cooke, J. K. (1967a). Clinicians' decisions as a basis for deriving actuarial formulae. Journal of Clinical Psychology, 23, 232-233.
19.
Cooke, J. K. (1967b). MMPI in actuarial diagnosis of psychological disturbance among college males. Journal of Counseling Psychology, 14, 474-477.
20.
Cooper, H. (1998). Synthesizing research: A guide for literature reviews(3rd ed.). Thousand Oaks, CA: Sage.
21.
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Orlando, FL: Harcourt Brace Jovanovich.
22.
Danet, B. N. (1965). Prediction of mental illness in college students on the basis of “ nonpsychiatric” MMPI profiles. Journal of Counseling Psychology, 29, 577-580.
23.
Dawes, R. M. (1994). House of cards: Psychology and psychotherapy built on myth. New York: Free Press.
24.
Dawes, R. M. (2002). The ethics of using or not using statistical prediction rules in psychological practice and related consulting activities. Philosophy of Science, 69, S178-S184.
25.
Dawes, R. M., & Corrigan, B. (1974). Linear models in decision making. Psychological Bulletin, 81, 95-106.
26.
Dawes, R. M., Faust, D., & Meehl, P.E. (1989). Clinical versus actuarial judgment. Science, 243, 1668-1674.
27.
Devries, A. G., & Shneidman, E. S. (1967). Multiple MMPI profiles of suicidal persons. Psychological Reports, 21, 401-405.
28.
Dickerson, J. H. (1958). The Biographical Inventory compared with clinical prediction of post counseling behavior of V.A. hospital counselors. Unpublished doctoral dissertation, University of Minnesota, Minneapolis.
29.
Dunham, H. W., & Meltzer, B. N. (1946). Predicting length of hospitalization of mental patients. American Journal of Sociology, 52, 123-131.
30.
Efron, B., & Gong, G. (1983). A leisurely look at the bootstrap, the jackknife, and cross-validation. The American Statistician, 37, 36-48.
31.
Ericsson, K. A., & Lehmann, A. C. (1996). Expert and exceptional performance: Evidence of maximal adaptation to task constraints. Annual Review of Psychology, 47, 273-305.
32.
Evenson, R. C., Altman, H., Sletten, I. W., & Cho, D. W. (1975). Accuracy of actuarial and clinical predictions for length of stay and unauthorized absence. Diseases of the Nervous System, 36, 250-252.
33.
Falvey, J. E., & Hebert, D. J. (1992). Psychometric study of clinical treatment planning simulation (CTPS) for assessing clinical judgment. Journal of Mental Health Counseling, 14, 490-507.
34.
Faust, D. (1986). Research on human judgment and its application to clinical practice. Professional Psychology, Research, and Practice, 17, 420-430.
35.
Faust, D. (1991). What if we had really listened? Present reflections on altered pasts. In D. Cicchetti & W. M. Grove (Eds.), Thinking clearly about psychology: Vol. I. Matters of public interest(pp. 185-217). Minneapolis: University of Minnesota Press.
36.
Faust, D. (1997). Of science, meta-science, and clinical practice: The generalization of a generalization to a particular. Journal of Personality Assessment, 68, 331-354.
37.
Faust, D. (2003). Holistic thinking is not the whole story: Alternative or adjunct approaches for increasing the accuracy of legal evaluations. Assessment, 10, 428-411.
38.
Fero, D. D. (1975). A lens model analysis of the effects of amount of information and mechanical decision making aid on clinical judgment and confidence. Unpublished doctoral dissertation, Bowling Green State University, Bowling Green, OH.
39.
Garb, H. N. (1989). Clinical judgment, clinical training, and professional experience. Psychological Bulletin, 105, 387-396.
40.
Garb, H. N. (1994). Toward a second generation of statistical prediction rules in psychodiagnosis and personality assessment. Computers in Human Behavior, 10, 377-394.
41.
Garb, H. N. (1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association.
42.
Gardner, W., Lidz, C. W., Mulvay, E. P., & Shaw, E. C. (1996). Clinical versus actuarial predictions of violence in patients with mental illnesses. Journal of Consulting and Clinical Psychology, 64, 602-609.
43.
Goldberg, L. R. (1965). Diagnosticians vs. diagnostic signs: The diagnosis of psychosis vs. neurosis from the MMPI. Psychological Monographs: General and Applied, 79(9), 1-27.
44.
Goldberg, L. R. (1970). Man versus model of man: A rationale, plus some evidence, for a method of improving clinical inferences. Psychological Bulletin, 73, 422-432.
45.
Goldstein, S. G., Deysach, R. E., & Kleinknecht, R. A. (1973). Effect of experience and amount of information on identification of cerebral impairment. Journal of Consulting and Clinical Psychology, 41, 30-34.
46.
Gottfredson, D. M., & Snyder, H. N. (2005). The mathematics of risk classification: Changing data into valid instruments for juvenile courts(NCJ 209158). Washington, DC: National Center for Juvenile Justice, Office of Juvenile Justice and Delinquency Prevention.
47.
Graham, J. R., Watts, D., & Timbrook, R. E. (1991). Detecting fake-good and fake-bad MMPI-2 profiles. Journal of Personality Assessment, 57, 264-277.
48.
Grebstein, L. C. (1963). Relative accuracy of actuarial prediction, experienced clinicians, and graduate students in a clinical judgment task. Journal of Consulting Psychology, 27, 127-132.
49.
Greene, R. L. (2000). The MMPI-2: An interpretive manual(2nd ed.). Boston: Allyn & Bacon.
50.
Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1-20.
51.
Grove, W. M., & Meehl, P. E. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy, and Law, 2, 293-323.
52.
Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical vs. mechanical prediction: A meta-analysis. Psychological Assessment, 12, 19-30.
53.
Gustafson, D. H., Greist, J. H., Stauss, F. F., Erdman, H., & Laughren, T. (1977). A probabilistic system for identifying suicide attempters. Computers and Biomedical Research, 10, 83-89.
54.
Halbower, C. C. (1955). A comparison of actuarial versus clinical prediction to classes discriminated by the Minnesota Multiphasic Personality Inventory. Unpublished doctoral dissertation, University of Minnesota, Minneapolis.
55.
Hall, G. C. N. (1988). Criminal behavior as a function of clinical and actuarial variables in a sexual offender population. Journal of Consulting and Clinical Psychology, 56, 773-775.
56.
Hammond, K. R. (1996). Human judgment and social policy: Irreducible uncertainty, inevitable error, unavoidable justice. New York: Oxford University Press.
57.
Hare, R. D. (1991). The revised psychopathy checklist. Toronto, Canada: Multi-Health Systems.
58.
Harvey-Cook, J. E., & Taffler, R. J. (2000). Biodata in professional entry-level selection: Statistical scoring of common format applications. Journal of Occupational and Organizational Psychology, 73, 103-118.
59.
Heaton, R. K., Grant, I., Anthony, W. Z., & Lehman, R. A. (1981). A comparison of clinical and automated interpretation of the Halstead-Reitan battery. Journal of Clinical Neuropsychology, 3, 121-141.
60.
Hedges, L. V. (1987). How hard is hard science, how soft is soft science: The empirical cumulativeness of research. American Psychologist, 42, 443-455.
61.
Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis.Orlando, FL: Academic Press.
62.
Hilton, N. Z., Harris, G. T., Rice, M. E., Lang, C., Cormier, C. A., & Lines, K. J. (2004). A brief actuarial assessment for the prediction of wife assault recidivism: The Ontario Domestic Assault Risk Assessment. Psychological Assessment, 16, 267-275.
63.
Holland, T. R., Holt, N., Levi, M., & Beckett, G. E. (1983). Comparison and combination of clinical and statistical predictions of recidivism among adult offenders. Journal of Applied Psychology, 68, 203-211.
64.
Holt, R. R. (1958). Clinical and statistical prediction: A reformulation and some new data. Journal of Abnormal and Social Psychology, 56, 1-12.
65.
Holt, R. R. (1970). Yet another look at clinical and statistical prediction: Or, is clinical psychology worthwhile?American Psychologist, 25, 337-349.
66.
Hovey, H. B., & Stauffacher, J. C. (1953). Intuitive versus objective prediction from a test. Journal of Clinical Psychology, 9, 341-351.
67.
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z. M., & Lutz, W. (1996). Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064.
68.
Hunter, J. E., & Smith, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
69.
Johnson, B. T. (1993). DSTAT 1.10: Software for the meta-analytic review of research literature. Hillsdale, NJ: Lawrence Erlbaum.
70.
Johnson, B. T., & Eagly, A. H. (2000). Quantitative synthesis of social psychological research. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social psychology. London: Cambridge University Press.
71.
Johnston, R., & McNeal, B. F. (1967). Statistical versus clinical prediction: Length of neuropsychiatric hospital stay. Journal of Abnormal Psychology, 72, 335-340.
72.
Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 801, 237-251.
73.
Kaplan, R. L. (1962). A comparison of actuarial and clinical predictions of improvement in psychotherapy. Unpublished doctoral dissertation, University of California, Los Angeles.
74.
Katsikopoulos, K., Machery, E., Pachur, T., & Wallin, A. (2004). The search for models of clinical judgment: Fast, frugal, and friendly in Paul Meehl's spirit. Unpublished manuscript. Retrieved October 15, 2004, from http://jeannicod.ccsd.cnrs.fr/documents/disk0/00/00/05/33/ijn_00000533_00/ijn_00000533_00.pdf
75.
Kelly, E. L., & Fiske, D. W. (1950). The prediction of success in the VA training program in clinical psychology. American Psychologist, 5, 395-406.
76.
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Koretz, D., Merikangas, K. R., et al. (2003). The epidemiology of major depressive disorder: Results from the National Comorbidity Survey Replication (NCS-R). Journal of the American Medical Association, 289, 3095-3106.
77.
Klehr, R. (1949). Clinical intuition and test scores as a basis for diagnosis. Journal of Consulting Psychology, 13, 34-38.
78.
Kleinmuntz, B. (1967). Sign and seer: Another example. Journal of Abnormal Psychology, 72, 163-165.
79.
Kleinmuntz, B. (1990). Why we still use our heads instead of formulas: Toward an integrative approach. Psychological Bulletin, 107, 296-310.
80.
Klinger, E., & Roth, I. (1965). Diagnosis of schizophrenia by Rorschach patterns. Journal of Projective Techniques and Personality Assessment, 29, 323-335.
81.
Kurpius, D. J., Benjamin, D., & Morran, D. K. (1985). Effect of teaching a cognitive strategy on counselor trainee internal dialogue and clinical hypothesis formulation. Journal of Counseling Psychology, 32, 262-271.
82.
Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159-172.
83.
Lambert, M. J., Hansen, N. B., Umphress, V., Lunnen, K., Okiishi, J., Burlingame, G., et al. (1996). Administration and scoring manual for the Outcome Questionnaire (OQ 45.2). Wilmington, DE: American Professional Credentialing Services.
84.
Leli, D. A., & Filskov, S. B. (1981). Clinical-actuarial detection and description of brain impairment with the W-B Form 1. Journal of Clinical Psychology, 37, 623-629.
85.
Leli, D. A., & Filskov, S. B. (1984). Clinical detection of intellectual deterioration associated with brain damage. Journal of Clinical Psychology, 40, 1435-1441.
86.
Lemerond, J. N. (1977). Suicide prediction for psychiatric patients: A comparison of the MMPI and clinical judgments. Unpublished doctoral dissertation, Marquette University, Madison, WI.
87.
Lewis, E. C., & MacKinney, A. C. (1961). Counselor vs. statistical prediction of job satisfaction in engineering. Journal of Counseling Psychology, 8, 224-230.
88.
Lefkowitz, M. B. (1973). Statistical and clinical approaches to the identification of couples at risk in marriage. Unpublished doctoral dissertation, University of Florida, Gainesville.
89.
Lichtenberg, J. W. (1997). Expertise in counseling psychology: A concept in search of support. Educational Psychology Review, 9, 221-238.
90.
Lindsey, G. R. (1965). Seer versus sign. Journal of Experimental Research in Personality, 1, 17-26.
91.
Lyle, O., & Quast, W. (1976). The Bender Gestalt: Use of clinical judgment versus recall scores in prediction of Huntington's disease. Journal of Consulting and Clinical Psychology, 44, 229-232.
92.
McHugh, R. B., & Apostolakos, P. C. (1959). Methodology for the comparison of clinical with actuarial predictions. Psychological Bulletin, 56, 301-309.
93.
Meehl, P. E. (1954). Clinical vs. statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis: University of Minnesota Press.
94.
Meehl, P. E. (1959). A comparison of clinicians with five statistical methods of identifying psychotic MMPI profiles. Journal of Counseling Psychology, 6, 102-109.
95.
Meehl, P. E. (1986). Causes and effects of my disturbing little book. Journal of Personality Assessment, 50, 370-375.
96.
Melton, R. S. (1952). A comparison of clinical and actuarial methods of prediction with an assessment of the relative accuracy of different clinicians. Unpublished doctoral dissertation, University of Minnesota, Minneapolis.
97.
Meyer, K. (1973). The effect of training in the accuracy and appropriateness of clinical judgment. Unpublished doctoral dissertation, Adelphi University, Garden City, NY.
98.
Meyer, J. J., Finn, S. E., Eyde, L. D., Kay, G. G., Kubiszyn, T. W., Moreland, K. L., et al. (1998). Benefits and costs of psychological assessment in healthcare delivery: Report of the Board of Professional Affairs Psychological Assessment Work Group(Part I). Washington, DC: American Psychological Association.
99.
Miller, D. E., Kunce, J. T., & Getsinger, S. H. (1972). Prediction of job success for clients with hearing loss. Rehabilitation Counseling Bulletin, 16, 21-29.
100.
Miller, G. A. (1985). The Substance Abuse Subtle Screening Inventory (SASSI): Manual. Bloomington, IN: Spencer Evening World.
101.
Nisbett, R. E., & Ross, L. (1980). Human inference: Strategies and shortcomings of social judgment. Englewood Cliffs, NJ: Prentice Hall.
102.
Ogles, B., Lambert, M. J., & Masters, K. S. (1996). Assessing outcome in clinical practice. Needham Heights, MA: Allyn & Bacon.
103.
Oskamp, S. (1962). The relationship of clinical experience and training methods to several criteria of clinical prediction. Psychological Monographs: General and Applied, 76, 1-27.
104.
Oxman, T. E., Rosenberg, S. D., Schnurr, P. P., & Tucker, G. J. (1988). Diagnostic classification through content analysis of patients' speech. American Journal of Psychiatry, 145, 464-468.
105.
Pepinsky, H. B., & Pepinsky, N. (1954). Counseling theory and practice. New York: Ronald Press.
106.
Perez, F. I. (1976). Behavioral analysis of clinical judgment. Perceptual and Motor Skills, 43, 711-718.
107.
Popovics, A. J. (1983). Predictive validities of clinical and actuarial scores of the Gesell Incomplete Man Test. Perceptual and Motor Skills, 56, 864-866.
108.
Quinsey, V. L., Harris, G. T., Rice, M. E., & Cormier, C. A. (1998). Violent offenders: Appraising and managing risk. Washington, DC: American Psychological Association.
109.
Rock, D. L., Bransford, J. D., & Maisto, S. A. (1987). The study of clinical judgment: An ecological approach. Clinical Psychology Review, 7, 645-661.
110.
Rosenthal, R. (1991). Meta-analytic procedures for social research(Rev. ed). Newbury Park, CA: Sage.
111.
Rosenthal, R., & Rubin, D. (1982). A simple general purpose display of magnitude of experimental effects. Journal of Educational Psychology, 74, 166-169.
112.
Rosnow, R. L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
113.
Rouse, S. V., Butcher, J. N., & Miller, K. B. (1999). Assessment of substance abuse in psychotherapy clients: The effectiveness of the MMPI-2 substance abuse scales. Psychological Assessment, 11, 101-107.
114.
Russell, E. W. (1995). The accuracy of automated and clinical detection of brain damage and lateralization on neuropsychology. Neuropsychology Review, 5, 1-68.
115.
Sarbin, T. L. (1942). A contribution to the study of actuarial and individual methods of prediction. American Journal of Sociology, 48, 593-602.
116.
Sawyer, J. (1966). Measurement and prediction, clinical and statistical. Psychological Bulletin, 66, 178-200.
117.
Schmidt, F. L., & Hunter, J. E. (1996). Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199-223.
118.
Shaffer, J. W., Perlin, S., Schmidt, C. W., & Stephens, J. H. (1974). The prediction of suicide in schizophrenia. Journal of Nervous and Mental Disease, 150, 349-355.
119.
Shagoury, P., & Satz, P. (1969). The effect of statistical information on clinical prediction. Proceedings of the 77th Annual Convention of the American Psychological Association, 4, 517-518.
120.
Sines, J. O. (1970). Actuarial versus clinical prediction in psychopathology. British Journal of Psychiatry, 116, 129-144.
121.
Spengler, P. M. (1998). Multicultural assessment and a scientist-practitioner model of psychological assessment. The Counseling Psychologist, 26, 930-938.
122.
Spengler, P. M., & Strohmer, D. C. (2001, August). Empirical analyses of a scientist-practitioner model of assessment. Paper presented at the annual meeting of the American Psychological Association, San Francisco.
123.
Spengler, P. M., Strohmer, D. M., Dixon, D. N., & Shivy, V. A. (1995). A scientist-practitioner model of psychological assessment: Implications for training, practice, and research. The Counseling Psychologist, 23, 506-534.
124.
Spengler, P. M., White, M. J., Ægisdóttir, S., Maugherman, A. S., Anderson, L. A., Cook, R. S., et al. (2005). The meta-analysis of clinical judgment project: Effects of experience on judgment accuracy. Manuscript submitted for publication.
125.
Steering Committee of the Physicians Health Study Research Group. (1988). Preliminary report: Findings from the aspirin component of the ongoing physicians' health study. New England Journal of Medicine, 318, 262-264.
126.
Stein, L. A. R., Graham, J. R., Ben-Porath, Y. S., & McNulty, J. L. (1999). Using the MMPI-2 to detect substance abuse in an outpatient mental health setting. Psychological Assessment, 11, 94-100.
127.
Stricker, G. (1967). Actuarial, naïve clinical, and sophisticated clinical prediction of pathology from figure drawings. Journal of Consulting Psychology, 31,492-494.
128.
Stricker, G., & Trieweiler, S. J. (1995). The local clinical scientist: A bridge between science and practice. American Psychologist, 50, 995-1002.
129.
Sullivan, E., Cirincione, C., Nelson, K., & Wallis, J. (2001). Classifying inmates for strategic programming. Washington, DC: National Criminal Justice Service, U.S. Department of Justice.
130.
Szuko, J. J., & Kleinmuntz, B. (1981). Statistical versus clinical lie detection. American Psychologist, 36, 488-496.
131.
Taulbee, E. S., & Sisson, B. D. (1957). Configurational analysis of MMPI profiles of psychiatric groups. Journal of Consulting Psychology, 21, 413-417.
132.
Thompson, R. E. (1952). A validation of the Glueck Social Prediction Scale for proneness to delinquency. Journal of Criminal Law, Criminology, and Police Science, 43, 451-470.
133.
Waehler, C. A., Kalodner, C. R., Wampold, B. E., & Lichtenberg, J. W. (2000). Empirically supported treatments (ESTs) in perspective: Implications for counseling psychology training. The Counseling Psychologist, 28, 657-671.
134.
Walters, G. D., White, T. W., & Greene, R. L. (1987). The use of MMPI to identify malingering and exaggeration of psychiatric symptomatology in male prison inmates. Journal of Consulting and Clinical Psychology, 1, 111-117.
135.
Wampold, B. E. (1997). Methodological problems in identifying efficacious psychotherapies. Psychotherapy Research, 7, 21-43.
136.
Watley, D. J. (1966). Counselor variability in making accurate predictions. Journal of Counseling Psychology, 13, 53-62.
137.
Watley, D. J., & Vance, F. L. (1964). Clinical versus actuarial prediction of college achievement and leadership activity. Unpublished doctoral dissertation, University of Minnesota, Minneapolis.
138.
Webb, S. C., Hultgen, D. D., & Craddick, R. A. (1977). Predicting occupational choice by clinical and statistical methods. Journal of Counseling Psychology, 24, 98-110.
139.
Wedding, D. (1983). Clinical and statistical prediction in neuropsychology. Clinical Neuropsychology, 5, 49-55.
140.
Weinberg, G. H. (1957). Clinical versus statistical prediction with a method of evaluating a clinical tool. Unpublished doctoral dissertation, Columbia University, New York.
141.
Werner, P. D., Rose, T. L., Yesavage, J. A., & Seeman, K. (1984). Psychiatrists' judgment of dangerousness in patients on an acute care unit. American Journal of Psychiatry, 141, 263-266.
142.
Westen, D., & Weinberger, J. (2004). When clinical description becomes statistical prediction. American Psychologist, 59, 595-613.
143.
Wiggins, J. S. (1981). Clinical and statistical prediction: Where are we and where do we go from here?Clinical Psychology Review, 1, 3-18.
144.
Wiggins, N., & Kohen, E. S. (1971). Man versus model of man revisited: The forecasting of graduate school success. Journal of Personality and Social Psychology, 19, 100-106.
145.
Wirt, R. D. (1956). Actuarial prediction. Journal of Consulting Psychology, 20, 123-124.
146.
Wittman, M. P., & Steinberg, L. (1944). Follow-up of an objective evaluation of prognosis in dementia praecox and manic-depressive psychosis. The Elgin Papers, 5, 216-227.
147.
Zalewski, C. E., & Gottesman, I. I. (1991). (Hu)man versus mean revisited: MMPI group data and psychiatric diagnosis. Journal of Abnormal Psychology, 100, 562-568.
