Use of a structural equations analysis to estimate the degree of predictor-related criterion bias in selection research is illustrated. For the hypothetical data considered in this paper, a likability methods factor produced significant changes in estimates of the structural parameters relating the predictors to the criterion. Regression analyses using two methods factors as covariates yielded similar results. The advantages of employing the more complicated LISREL analysis versus more familiar regression analysis are discussed and some suggestions for future research using the structural equations approach are presented.
References
1.
Austin, J. T. & Villanova, P. (1992). The criterion problem: 1917-1992. Journal flapped Psychology, 77: 836-874.
2.
Bender, P. M. & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88: 588-606.
3.
Borman, W. C. (1991). Job behavior, performance, and effectiveness. Pp. 271-326 in M. D. Dunnette & L. M. Hough (eds.), Handbook of industrial/organizational psychology. Palo Alto, CA: Consulting Psychologists Press.
4.
Bunt, D. & Armstrong, N. (1976). Teacher’s perception of eighth grade students likability and motivation as related to sex, feminity, ability, and achievement. Journal of Association for the Study of Perception, 11: 9-13.
5.
Byrne, D. (1971). The attraction paradigm. New York: Academic Press.
6.
Byrne, D., London, O. & Reeves, K. (1968). The effects of physical attractiveness, sex, and attitude similarity on interpersonal attraction. Journal of Personality, 36: 259-271.
7.
Campbell, J. P., McCloy, R. A., Oppler, S. H. & Sager, C. E. (1993). A theory of performance. Pp. 35-70 in N. Schmitt & W. C. Borman (eds.), Personnel selection in organizations. San Francisco: Jossey-Bass.
8.
Cardy, R. L. & Dobbins, G. H. (1986). Affect and appraisal accuracy: Liking as an integral dimension in evaluating performance. Journal of Applied Psychology, 71: 672-678.
9.
Cronbach, L. J. (1955). Process affecting scores on understanding of others and assumed “similarity.”Psychological Bulletin, 52: 177-193.
10.
Cronbach, L. J. & Gleser, G. C. (1953). Assessing similarity between profiles. Psychological Bulletin, 50: 456-473.
11.
Dipboye, R. L. (1985). Some neglected variables in research on discrimination in appraisals. Academy of Management Review, 10: 116-127.
12.
Ferris, G., Judge, T., Chachere, J. & Liden, R. (1991). The age context of performance-evaluation decisions. Psychology and Aging, 6: 616-622.
13.
Gavin, M. B., Williams, L. J. & Williams, M. L. (under review). Negative affectivity in employee stress and attitude research: 7he variance reduction rate versus IWO latent variable approaches.
14.
Guion. R. M. (1991). Personnel assessment, selection. and placement. PP. 327-398 in M. D. Dunnette & L. M. Hough (eds.), Handbook of industrial/organizational psychology. Palo Alto, CA: Consulting Psychologists Press.
15.
Ilgen, D. R. & Feldman, J. M. (1983). Performance appraisal: A process focus. Pp. 141-197 in B. Staw & L.L. Cummings (eds.), Research in organizational behavior, Vol. 5. Greenwich, CT: JAI Press.
16.
Jöreskog, K. G. & Sörbom, D. (1989). LISREL 7: A guide to the program and applications. Chicago: SPSS.
17.
Kenny, D. A. (1979). Correlation and causality. New York: Wiley.
18.
Kingstrom, P. O. & Mainstone, L. E. (1985). An investigation of rater-ratee acquaintance and bias. Academy of Management Journal, 28: 641-653.
19.
Klimoski, R. J. & Brickner, M. (1987). Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40: 243-260.
20.
Klimoski, R. J. & Strickland, W. J. (1977). Assessment centers-valid or merely prescient?Personnel Psychology, 30: 353-361.
21.
Kraiger, K. & Ford J. K. (1985). A meta-analysis of ratee race effects in performance ratings, Journal of Applied Psychology, 70: 56-65.
22.
Love, K. (1981). Comparison of peer assessment methods: Reliability, validity, friendship bias, and user reaction. Journal of Applied Psychology, 66: 451-457.
23.
McDaniel, M. A., Whetzel, D. L., Schmidt, F. L. & Maurer, S. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79.
24.
Oppler, S. H., Campbell, J. P., Pulakos, E. D. & Borman, W. C. (1992). Three approaches to the investigation of subgroup bias in performance measurement: Review, results, and conclusions. Journal of Applied Psychology, 77: 201-217.
25.
Pulakos, E. D., White, L. A., Oppler, S. H. & Borman, W. C. (1989). An examination of race and sex effects on performance ratings. Journal of Applied Psychology, 74: 770-780.
26.
Ross, J. & Ferris, K. (1981). Interpersonal attraction and organizational outcomes: A field examination. Administrative Science Quarterly, 26: 617-632.
27.
Schmitt, N., Gooding, R. Z., Noe, R. A. & Kirsch, M. (1984). Meta-analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37: 407-422.
28.
Schmitt, N. & Stults, D. M. (1986). Methodology review: Analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 10: 1-22.
29.
Tsui, A. & O’Reilly, C., III. (1989). Beyond simple demographic effects: The importance of relational demography in superior-subordinate dyads. Academy of Management Journal, 32: 402-423.
30.
Tucker, L. R. & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38: 1-10.
31.
Turban, D. B. & Jones, A. P. (1988). Supervisor-subordinate similarity: Types, effects, and mechanisms. Journal of Applied Psychology, 73: 228-234.
32.
Wexley, K. N., Alexander, R. A., Greenwalt, S. P. & Couch, M. A. (1980). Attitudinal congruence and similarity as related to interpersonal evaluations in manager-subordinate dyads. Academy of Management Journal, 23: 320-330.
33.
Wexley, K. N. & Nemeroff, W. F. (1974). The effects of racial prejudice, race of applicant, and biographical similarity on interviewer evaluations of job applicants. Journal of Social and Behavioral Science, 20: 66-78.
34.
Williams, L. J. & Anderson, S. E. (1994). An alternative approach to method effects using latent variable models: Applications in organizational behavior research. Journal of Applied Psychology, 79.
35.
Zalesny, M. & Kirsch, M. (1989). The effect of similarity on performance ratings and interrater agreement. Human Relations, 42: 81-96.
