Research has demonstrated that people can and often do consciously manipulate scores on personality tests. Test constructors have responded by using social desir ability and lying scales in order to identify dishonest re spondents. Unfortunately, these approaches have had limited success. This study evaluated the use of appropri ateness measurement for identifying dishonest respon dents. A dataset was analyzed in which respondents were instructed either to answer honestly or to fake good. The item response theory approach classified a higher number of faking respondents at low rates of misclassification of honest respondents (false positives) than did a social de sirability scale. At higher false positive rates, the social desirability approach did slightly better. Implications for operational testing and suggestions for further research are provided.
Anderson, C.D., Warner, J.L., & Spector, C.E. (1984). Inflation bias in self-assessment examination: Implications for valid employee selection. Journal of Applied Psychology, 69, 574-580.
2.
Bagby, R.M., Buis, T., & Nicholson, R.A. (1995). Relative effectiveness of the standard validity scales in detecting fake-bad and fake-good responding: Replication and extension. Psychological Assessment, 7, 84-92.
3.
Barrick, M.R., & Mount, M.K. (1991). The big-five personality dimensions job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
4.
Becker, T.E., & Colquitt, A.L. (1992). Potential versus actual faking of a biodata form: An analysis along several dimensions of item type . Personnel Psychology, 45, 389-406.
5.
Bernardin, H.J. (1977). The relationship of personality variables to organizational withdrawal. Personnel Psychology, 30, 17-27.
6.
Bock, R.D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
7.
Burkhart, B.R., Gynther, M.D., & Fromuth, M.E. (1980). The relative predictive validity of subtle versus obvious items on the MMPI depression scale. Journal of Clinical Psychology, 36, 748-751.
8.
Butcher, J., Dahlstrom, W.G., Graham, J.R., Tellegen, A., & Kaemmer, B. (1989). Minnesota Multiphasic Personality Inventory 2: Manual for administration and scoring. Minneapolis: University of Minnesota Press.
9.
Drasgow, F., & Hulin, C.L. (1990). Item response theory. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. I; pp. 577-636). Palo Alto CA: Consulting Psychologists Press.
10.
Drasgow, F., Levine, M.V., & McLaughlin, M.E. (1991). Appropriateness measurement for some multidimensional test batteries. Applied Psychological Measurement, 15, 171-191.
11.
Drasgow, F., Levine, M.V., Williams, B., McCusker, C., Thomasson, G.L., & Lim, R.G. (1989). An evaluation of optimal appropriateness measurement for use in practical settings (AFHRL-TP-89-41. Brooks Air Force Base TX: Air Force Human Resources Laboratory .
12.
Drasgow, F., Levine, M.V., Tsien, S., Williams, B., & Mead, A.D. (1995). Fitting polytomous item response theory models to multiple-choice tests. Applied Psychological Measurement , 19, 143-165.
13.
Drasgow, F., Williams, B., Mead, A., Levine, M.V., Thomasson, G.L., & Tsien, S. (1990). Identifying unmotivated examinees. Final Report: Contract DAAL03-86-D-0001. San Diego CA: Navy Personnel Research and Development Center.
14.
Duff, F.L. (1965). Item subtlety in personality inventory scales . Journal of Consulting Psychology, 29, 565-570.
15.
Edwards, A.L. (1970). The measurement of personality traits by scales and inventories. New York: Holt, Rinehart and Winston.
16.
Gillis, J., Rogers, R., & Dickes, S. (1990). The detection of faking bad response styles on the MMPI. Canadian Journal of Behavioural Science, 22, 408-416.
17.
Gough, H.G. (1950). The F minus K dissimulation index for the Minnesota Multiphasic Personality Inventory. Journal of Consulting Psychology , 14, 408-413.
18.
Hathaway, S.R., & McKinley, J.C. (1983). The Minnesota Multiphasic Personality Inventory manual. New York: Psychological Corporation.
19.
Hough, L.M., Eaton, N.K., Dunnette, M.D., Kamp, J.D., & McCloy, R.A. (1990). Criterion-related validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology, 75, 581-595.
20.
Hsu, L., Santelli, J., & Hsu, J. (1989). Faking detection validity and incremental validity of response latencies to MMPI Subtle and Obvious items. Journal of Personality Assessment, 53, 278-295.
21.
Krahe, B. (1989). Faking personality profiles on a standard personality inventory. Personality and Individual Differences, 10, 437-443.
22.
Lanning, K. (1989). Detection of invalid response patterns on the California Psychological Inventory. Applied Psychological Measurement, 13, 45-56.
23.
Lanyon, R.I. (1993). Development of scales to assess specific deception strategies in the Psychological Screening Inventory. Psychological Assessment, 5, 324-329.
24.
Levine, M.V., & Drasgow, F. (1982). Appropriateness measurement: Review, critique, and validating studies. British Journal of Mathematical and Statistical Psychology, 35, 42-56.
Levine, M.V., & Rubin, D.B. (1979). Measuring the appropriateness of multiple-choice test scores. Journal of Educational Statistics, 4, 269-290.
27.
Meehl, P.E., & Hathaway, S.R. (1946). The K factor as a suppressor variable in the MMPI. Journal of Applied Psychology, 30, 525-561.
28.
Meijer, R.R., Molenaar, I.W., & Sijtsma, K. (1994). Influence of test and person characteristics on nonparametric appropriateness measurement. Applied Psychological Measurement, 18, 143-151.
Muraki, E. (1990). Fitting a polytomous item response model to Likert type data. Applied Psychological Measurement, 14, 59-71.
31.
Peterson, N.G., Hough, L.M., Dunnette, M.D., Rosse, R.L., Houston, J.S., Toquam, J.L., & Wing, H. (1990). Project A.: Specification of the predictor domain and development of new selection/classification tests. Personnel Psychology, 43, 247-276.
32.
Reise, S.P., & Due, A.M. (1991). The influence of test characteristics on the detection of aberrant response patterns. Applied Psychological Measurement , 15, 217-226.
33.
Reise, S.P., & Waller, N.G. (1990). Fitting the two-parameter model to personality data. Applied Psychological Measurement, 14, 45-58.
34.
Reise, S.P., & Waller, N.G. (1993). Traitedness and the assessment of response pattern scalability. Journal of Personality and Social Psychology , 65, 143-151.
35.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement , No. 17.
36.
Sparks, C.P. (1983). Paper and pencil measures of potential. In G. P. Dreher & P. R. Sackett (Eds.), Perspectives on employee staffing and selection (pp. 349-368). Homewood IL: Dow-Jones Irwin.
37.
Tellegen, A. (1988). The analysis of consistency in personality assessment . Journal of Personality, 56, 621-663.
38.
Thissen, D. (1991). MULTILOG user's guide. Chicago : Scientific Software.
39.
Waller, N.G., & Reise, S. (1992). Genetic and environmental influences on item response pattern scalability. Behavior Genetics, 22, 135-152.
40.
Wetter, M.W., Baer, R.A., Berry, D.T., Smith, G.T., & Larsen, L.H. (1992). Sensitivity of MMPI-2 validity scales to random responding and malingering. Psychological Assessment, 4, 369-374.
41.
White, L.A., Nord, R.D., Mael, F.A., & Young, M.C. (1993). The assessment of background and life experiences (ABLE. In T. Trent & J. H. Laurence (Eds), Adaptability screening for the armed forces (pp. 101-162). Washington DC: Office of the Assistant Secretary of Defense.
42.
Wiener, D.N. (1948). Subtle and obvious keys for the Minnesota Multiphasic Personality Inventory. Journal of Applied Psychology, 12, 164-170.
43.
Young, M.C., White, L.A., & Oppler, S.H. (1991). Coaching effects on the Assessment of Background and Life Experiences (ABLE. Paper presented at the meeting of the Military Testing Association, San Antonio TX.
