The NEO Five-Factor Inventory (NEO-FFI) is often used in field-based research and clinical studies as it is designed to measure the same personality dimensions as the longer NEO Personality Inventory in a shorter time frame. In this study, the authors examined the reliability and structural validity of the NEO-FFI scores at the item level in a large sample of Jamaican young adults (N = 1,021; ages 17-24 years). Across different factor estimation and rotation methods, many NEO-FFI items performed poorly. Likewise, the estimated reliability of the NEO-FFI scores was poor (except Conscientiousness) across different estimations of reliability. These items and scores were then compared with other studies of the NEO-FFI that reported item-level pattern/structure coefficients or reliability estimates. Similarities in item performance and low reliability estimates across studies suggest that the items, rather than cultural differences, account for much of the poor performance of the NEO-FFI scores, especially in the domains of Extraversion, Openness to Experience, and Agreeableness.
Arnett, J.J. ( 2000). Emerging adulthood. A theory of development from the late teens through the twenties. American Psychologist, 55, 469-480. doi:10.1037/0003-066X.55.5.469
2.
Bartholomew, D., & Knott, M. ( 1999). Kendall’s library of statistics 7: Latent variable models and factor analysis. London, England: Edward Arnold.
3.
Becker, G. ( 2006). NEO-FFI scores in college men and women: A view from McDonald’s unified treatment of test theory. Journal of Research in Personality, 40, 911-941. doi:10.1016/j. jrp.2005.09.009
4.
Bernstein, I.H., & Teng, G. ( 1989). Factoring items and factoring scales are different: Evidence for multidimensionality due to item categorization. Psychological Bulletin, 105, 465-477. doi:10.1037/0033-2909.105.3.467
5.
Black, J. ( 2000). Personality testing and police selection: Utility of the "Big Five." New Zealand Journal of Psychology, 29, 2-9.
6.
Blackman, R., Renwick, S.J.D., Donnelly, J.P., & Logan, C. ( 2004). Big five or big two? Superordinate factors in the NEO Five Factor Inventory and the Antisocial Personality Questionnaire. Personality and Individual Differences, 37, 957-970. doi:10.1016/j.paid.2003.10.017
7.
Block, J. ( 1993). Studying personality the long way. In D. C. Funder, R. D. Parke, C. Tomlinson Keasey, & K. Widaman (Eds.), Studying lives through time: Personality and development (pp. 9-41). Washington, DC: American Psychological Association. doi:10.1037/10127-018
8.
Borkenau, P., & Ostendorf, F. ( 1990). Comparing exploratory and confirmatory factor analysis: A study on the 5-factor model of personality. Personality and Individual Differences, 11, 515-524. doi:10.1016/0191-8869(90)90065-Y
9.
Caruso, J.C. ( 2000). Reliability generalization of the NEO personality scales . Educational and Psychological Measurement, 60, 236-254. doi:10.1177/00131640021970484
10.
Caspi, A., Roberts, B.W., & Shiner, R.L. ( 2005). Personality development: Stability and change. Annual Review of Psychology, 56, 453-484. doi:10.1146/annurev.psych.55.090902.141913
11.
Central Intelligence Agency. (2008). World factbook. Retrieved from https://www.cia.gov/library/publications/the-world-factbook/
12.
Church, A.T., Katigbak, M.S., Reyes, J.A.S., Salanga, M.G.C., Miramontes, L.A., & Adams, N.B. ( 2008). Prediction and cross-situational consistency of daily behavior across cultures: Testing trait and cultural psychology perspectives . Journal of Research in Personality, 42, 1199-1215. doi:10.1016/j.jrp.2008.03.007
13.
Conley, J.J. ( 1984). The hierarchy of consistency: A review and model of longitudinal findings on adult individual differences in intelligence, personality and self-opinion. Personality and Individual Differences, 5, 11-25. doi:10.1016/0191-8869(84)90133-8
Cronbach, L.J. ( 1951). Coefficient alpha and the internal structure of tests . Psychometrika, 16, 297-334. doi:10.1007/BF02310555
17.
DeLaet, T.J., & Wise, S.L. ( 1986). The development and validation of the Personality Priorities Inventory for Adolescents. Educational and Psychological Measurement , 46, 455-459. doi:10.1177/001316448604600222
18.
Deyoung, C.G. ( 2006). Higher-order factors of the Big Five in a multi-informant sample. Journal of Personality and Social Psychology, 91, 1138-1151. doi:10.1037/0022-3514.91.6.1138
19.
Digman, J.M. ( 1990). Personality structure: Emergence of the five-factor model . Annual Reviews of Psychology, 41, 417-440.
20.
Digman, J.M. ( 1997). Higher-order factors of the Big Five. Journal of Personality and Social Psychology, 73, 1246-1256. doi:10.1037/0022-3514.73.6.1246
21.
Egan, V., Deary, I., & Austin, E. ( 2000). The NEO-FFI: Emerging British norms and an item-level analysis suggest N, A, and C are more reliable than O and E. Personality and Individual Differences, 29, 907-920. doi:10.1016/S0191-8869(99)00242-1
22.
Erdle, S., Irwing, P., Rushton, J.P., & Park, J. ( 2010). The general factor of personality and its relation to self-esteem in 628,640 Internet respondents. Personality and Individual Differences, 48, 343-346. doi:10.1016/j.paid.2009.09.004
23.
Flora, D.B., & Curran, P.J. ( 2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491. doi:10.1037/1082-989X.9.4.466
24.
Floyd, F.J., & Widaman, K.F. ( 1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment , 7, 286-299. doi:10.1037/1040-3590.7.3.286
25.
Fox, K. ( 2004). Jamaica youth activity survey, 2002. Kingston, Jamaica: The Statistical Institute of Jamaica .
26.
Fraley, C., & Roberts B.W. ( 2005). Patterns of continuity: A dynamic model for conceptualizing the stability of individual differences in psychological constructs across the life course. Psychological Review, 112, 60-74. doi:10.1037/0033-295X.112.1.60
27.
Haan, N., Millsap, R., & Hartka, E. ( 1986). As time goes by: Change and stability in personality over fifty years. Psychology and Aging, 1, 220-232. doi:10.1037/0882-7974.1.3.220
28.
Hamilton, M., & Leo-Rhynie, E. (1979). Sex-role stereotyping and education: The Jamaican perspective. Interchange, 10(2), 46-56. doi:10.1007/BF01191439
29.
Helson, R., & Moane, G. ( 1987). Personality change in women from college to midlife. Journal of Personality and Social Psychology, 53, 176-186. doi:10.1037/0022-3514.53.1.176
30.
Henson, R.K. ( 2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.
31.
Holden, R.R., & Fekken, G.C. ( 1994). The NEO Five-Factor Inventory in a Canadian context: Psychometric properties for a sample of university women. Personality and Individual Differences, 17, 441-444. doi:10.1016/0191-8869(94)90291-7
32.
Holden, R.R., Wasylkiw, L., Starzyk, K.B., Book, A.S., & Edwards, M.J. ( 2006). Inferential structure of the NEO Five-Factor Inventory: Construct validity of the big four personality clusters. Canadian Journal of Behavioural Science/Revue Canadienne des Sciences du Comportement , 38, 24-40.
33.
Hong, R.Y., Paunonen, S.V., & Slade, H.P. ( 2008). Big five personality factors and the prediction of behavior: A multitrait-multimethod approach. Personality and Individual Differences, 45, 160-166. doi:10.1016/j.paid.2008.03.015
34.
Hrebícková, M., Urbánek, T., Cermák, I., Szarota, P., Ficková, E., & Orlická L. (2002). The NEO-Five Factor Inventory in Czech, Polish, and Slovak contexts. In R. R. McCrae & J. Allik (Eds.), The five-factor model of personality across cultures (pp. 53-78). New York, NY: Kluwer Academic/Plenum.
35.
Huang, C.D., Church, A.T., & Katigbak, M.S. (1997). Identifying cultural differences in items and traits: Differential item functioning in the NEO Personality Inventory. Journal of Cross-Cultural Psychology, 28, 192. doi:10.1177/0022022197282004
36.
Hutchinson, G., Simeon, D.T., Bain, B.C., Wyatt, G.E., Tucker, M.B., & Lefranc, E. ( 2004). Social and health determinants of well being and life satisfaction in Jamaica. International Journal of Social Psychiatry , 50, 43-53.
37.
John, O.P., & Srivastava, S. (1999). The big five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 102-138). New York, NY: Guilford Press.
38.
Kamata, A., & Bauer, D.J. ( 2008). A note on the relation between factor analytic and item response theory models. Structural Equation Modeling, 15, 136-153.
39.
Kay, C.A. ( 2004). A comparison of traditional and IRT factor analysis. Unpublished doctoral dissertation, University of North Texas, Denton.
40.
Kline, P. ( 1998). The new psychometrics: Science, psychology, and measurement . London, England: Routledge.
41.
Kline, P. ( 2000). The handbook of psychological testing (2nd ed.). London, England: Routledge.
42.
Little, R.J.A., & Rubin, D.B. ( 2002). Statistical analysis with missing data (2nd ed.). Hobo-ken, NJ: Wiley.
43.
McCrae, R.R. ( 2002). NEO-PI-R data from 36 cultures: Further intercultural comparisons. In R. R. McCrae & J. Allik (Eds.), The five-factor model of personality across cultures (pp. 105-125). New York, NY: Kluwer.
44.
McCrae, R. R., & Allik, J. (Eds.). (2002). The five-factor model of personality across cultures. New York, NY: Kluwer.
45.
McCrae, R.R., & Costa, P.T., Jr. (1989). Rotation to maximize the construct validity of factors in the NEO Personality Inventory. Multivariate Behavioral Research, 24, 107-124. doi:10.1207/s15327906mbr2401_7
46.
McCrae, R.R., & Costa, P.T., Jr. (1997). Personality trait structure as a human universal. American Psychologist, 52, 509-516. doi:10.1037/0003-066X.52.5.509
47.
McCrae, R.R., & Costa, P.T., Jr. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences , 36, 587-596. doi:10.1016/S0191-8869(03)00118-1
48.
McCrae, R.R., & Costa, P.T., Jr. (2007). Brief versions of the NEO-PI-3 . Journal of Individual Differences, 28, 116-128. doi:10.1027/1614-0001.28.3.116
49.
McCrae, R.R., Terracciano, A., & Khoury, B. ( 2007). Dolce far niente: The positive psychology of personality stability and invariance. In A. Ong & M. Van Dulmen (Eds.), Oxford handbook of methods in positive psychology (pp. 176-188). New York, NY: Oxford University Press.
50.
McCrae, R.R., Zonderman, A.B., Costa, P.T., Jr., Bond, M.H., & Paunonen, S.V. (1996). Evaluating replicability of factors in the Revised NEO Personality Inventory: Confirmatory factor analysis versus Procrustes rotation. Journal of Personality and Social Psychology, 70, 552-566. doi:10.1037/0022-3514.70.3.552
51.
McDonald, R.P. ( 1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
52.
Miller, E. ( 1999). Out-of-school youth: A review of Jamaican studies. In A. G. Richardson (Ed.), Caribbean adolescents and youth: Contemporary issues in personality development and behavior (pp. 189-229). Brooklyn, NY: Caribbean Diaspora Press.
53.
Morizot, J., Ainsworth, A.T., & Reise, S.P. ( 2007). Toward modern psychometrics: Application of item response theory models in personality research. In R. W. Robins, R. C. Frale, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 407-423). New York, NY: Guilford Press.
54.
Murray, G., Rawlings, D., Allen, N.B., & Trinder, J. ( 2003). NEO Five-Factor Inventory scores: Psychometric properties in a community sample. Measurement and Evaluation in Counseling and Development, 36, 140-150.
55.
Musek, J. ( 2007). A general factor of personality: Evidence for the Big One in the five factor model. Journal of Research in Personality , 41, 1213-1233. doi:10.1016/j.jrp.2007.02.003
56.
Muthén, B.O. ( 1979). A structural probit model with latent variables. Journal of the American Statistical Association, 74, 807-811. doi:10.2307/2286403
57.
Muthén, B.O., Kao, C., & Burstein, L. ( 1991). Instructionally sensitive psychometrics: Application of a new IRT-based detection technique to mathematics achievement test items . Journal of Educational Measurement, 28, 1-22. doi:10.1111/j.1745-3984.1991.tb00340.x
58.
Muthén, B.O., & Kaplan, D. ( 1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38, 171-189.
Parker, W.D., & Stumpf, H. ( 1998). A validation of the five-factor model of personality in academically talented youth across observers and instruments. Personality and Individual Differences, 25, 1005-1025. doi:10.1016/S0191-8869(98)00016-6
63.
Planning Institute of Jamaica. (2006). The transition of Jamaican youth to the world of work. Kingston, Jamaica: Author.
64.
Pytlik Zillig, L.M., Hemenover, S.H., & Dienstbier, R.A. (2002). What do we assess when we assess a Big 5 trait? A content analysis of the affective, behavioral, and cognitive processes represented in Big 5 personality inventories. Personality and Social Psychology Bulletin, 28, 847-858. doi:10.1177/0146167202289013
65.
R Development Core Team. (2006). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing . Retrieved from http://www.R-project.org
Richardson, A.G. ( 1999a). Adolescent self-esteem: Differences across cultures . In A. G. Richardson (Ed.), Caribbean adolescents and youth: Contemporary issues in personality development and behaviour (pp. 5-8). New York, NY: Caribbean Diaspora Press.
69.
Richardson, A.G. ( 1999b). Personality priorities of Caribbean adolescents. In A. G. Richardson (Ed.), Caribbean adolescents and youth: Contemporary issues in personality development and behaviour (pp. 1-4). New York, NY: Caribbean Diaspora Press.
70.
Roberts B.W., & DelVecchio, W.F. (2000). The rank order consistency of personality traits from childhood to old age: A quantitative review of longitudinal studies. Psychological Bulletin, 126, 3-25. doi:10.1037/0033-2909.126.1.3
71.
Roberts, B.W., Kuncel, N.R., Shiner, R., Caspi, A., & Goldberg, L.R. (2007). The power of personality: The comparative validity of personality traits, socioeconomic status, and cognitive ability for predicting important life outcomes. Perspectives on Psychological Science, 2, 313-345. doi:10.1111/j.1745-6916.2007.00047.x
72.
Robins, R.W., Fraley, R.C., Roberts, B.W., & Trzesniewski, K.H. (2001). A longitudinal study of personality change in young adulthood. Journal of Personality , 69, 617-640. doi:10.1111/1467-6494.694157
73.
Rolland, J.P. ( 2002). The cross-cultural generalizability of the five-factor model of personality. In R. R. McCrae & J. Allik (Eds.), The five-factor model of personality across cultures (pp. 7-28). New York, NY: Kluwer Academic/Plenum.
74.
Rolland, J.P., Parker, W.D., & Stumpf, H. ( 1998). A psychometric examination of the French translation of the NEO-PI-R and NEO-FFI. Journal of Personality Assessment , 7, 269-291. doi:10.1207/s15327752jpa7102_13
75.
Roth, M., & Herzberg, P.Y. (2004). A validation and psychometric examination of the Arnett Inventory of Sensation Seeking (AISS) in German adolescents. European Journal of Psychological Assessment , 20, 205-215. doi:10.1027/1015-5759.20.3.205
76.
Rushton, J.P., & Irwing, P. ( 2008). A general factor of personality (GFP) from two meta-analyses of the Big Five: Digman (1997) and Mount, Barrick, Scullen, and Rounds (2005) . Personality and Individual Differences, 45, 679-683. doi:10.1016/j.paid.2008.07.015
77.
Scandell, D.J. ( 2000). Development and initial validation of validity scales for the NEO-Five Factor Inventory. Personality and Individual Differences, 29, 1153-1162. doi:10.1016/ S0191-8869(99)00262-7
78.
Sherry, A., Henson, R.K., & Lewis, J.G. ( 2003). Evaluating the appropriateness of college-age norms for use with adolescents on the NEO Personality Inventory-Revised. Assessment, 10, 71-78. doi:10.1177/1073191102250184
79.
Waller, N.G., Tellegen, A., McDonald, R.P., & Lykken, D.T. ( 1996). Exploring nonlinear models in personality assessment: Development and preliminary validation of a negative emotionality scale. Journal of Personality, 64, 545-576. doi:10.1111/j.1467-6494.1996. tb00521.x
80.
Weems, G.H., & Onwuegbuzie, A.J. (2001). The impact of midpoint responses and reverse coding on survey data. Measurement and Evaluation in Counseling and Development, 34, 166-176.
81.
Widaman, K.F. ( 2007). Common factors versus components: Principals and principles, errors and misconceptions. In R. Cudeck & R. C. MacCallum (Eds.), Factor analysis at 100: Historical developments and future directions (pp. 177-203). Mahwah, NJ: Erlbaum.
82.
Yoshimura, K., Ono, Y., Nakamura, K., Nathan, J.H., & Suzuki, K. ( 2001). Validation of the Japanese version of the NEO Five-Factor Inventory in a large community sample. Psychological Reports , 88, 443-449. doi:10.2466/PR0.88.2.443-449
