The severity of bias in respondents’ self-reports due to acquiescence response style (ARS) and extreme response style (ERS) depends strongly on how consistent these response styles are over the course of a questionnaire. In the literature, different alternative hypotheses on response style (in)consistency circulate. Therefore, nine alternative models are derived and fitted to secondary and primary data. It is found that response styles are best modeled as a tau-equivalent factor complemented with a time-invariant autoregressive effect. This means that ARS and ERS are largely but not completely consistent over the course of a questionnaire, a finding that has important implications for response style measurement and correction.
Anderson, J.C., & Gerbing, D.W. ( 1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411-423.
2.
Bachman, J.G., & O’Malley, P.M. (1984). Yea-saying, nay-saying, and going to extremes: Black-White differences in response styles. Public Opinion Quarterly, 48, 491-509.
3.
Bauer, D.J., & Curran, P.J. ( 2004). The integration of continuous and discrete latent variable models: Potential problems and promising opportunities. Psychological Methods, 9(1), 3-29.
4.
Baumgartner, H., & Steenkamp, J.-B.E.M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38(May), 143-156.
5.
Billiet, J.B., & McClendon, M.J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling, 7(4), 608-628.
6.
Browne, M.W., & Cudeck, R. ( 1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230-258.
7.
Bruner, G.C., James, K.E., & Hensel, P.J. ( 2001). Marketing scales handbook, A compilation of multi-item measures (Vol. 3). Chicago: American Marketing Association.
8.
Cheung, G.W., & Rensvold, R.B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling . Journal of Cross-Cultural Psychology, 31(2), 187-212.
9.
Curran, P.J., & Bollen, K.A. ( 2001). The best of both worlds: Combining autoregressive and latent curve models. In L. M. Collins & A. G. Sayer (Eds.), New methods for the analysis of change. Washington, DC: American Psychological Association.
10.
Davison, M.L., & Srichantra, N. (1988). Acquiescence in components analysis and multidimensional scaling of self-rating items. Applied Psychological Measurement, 12(4), 339-351.
11.
Fornell, C., & Larcker, D.F. ( 1981). Evaluating structural equation models with unobservable variables. Journal of Marketing Research, 18, 39-50.
12.
Gagné, P. ( 2006). Mean and covariance structure mixture models. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course. Greenwich, CT: Information Age Publishing.
13.
Geiser, C., Eid, M., & Nussbeck, F. ( 2008). On the meaning of the latent variables in the CT-C(M-1) model: A comment on Maydeu-Olivares and Coffman (2006). Psychological Methods, 13(1), 49-57.
14.
Green, S.B., & Hershberger, S.L. (2000). Correlated errors in true score models and their effect on coefficient alpha. Structural Equation Modeling, 7(2), 251-270.
15.
Greenleaf, E.A. ( 1992a). Improving rating scale measures by detecting and correcting bias components in some response styles. Journal of Marketing Research, 29(2), 176-188.
Hui, C.H., & Triandis, H.C. (1985). The instability of response sets. Public Opinion Quarterly, 49, 253-260.
18.
Johnson, T., Kulesa, P., Cho, Y.I., & Shavitt, S. ( 2005). The relation between culture and response styles. Journal of Cross-Cultural Psychology, 36(2), 264-277.
19.
Kahle, L.R., Beatty, S.E., & Homer, P. ( 1986). Alternative measurement approaches to consumer values: The List of Values (LOV) and Values and Life Style (VALS). Journal of Consumer Research, 13(1), 405-409.
20.
Kim, S.-K., Davison, M.L., & Frisby, C.L. ( 2007). Confirmatory factor analysis and profile analysis via multidimensional scaling. Multivariate Behavioral Research , 42(1), 1-32.
21.
Marsh, H.W. ( 1986). Negative item bias in ratings scales for preadolescent children: A cognitive-developmental phenomenon. Developmental Psychology, 22(1), 37-49.
22.
Marsh, H.W. ( 1993). Stability of individual differences in multiwave panel studies: Comparison of simplex models and one-factor models. Journal of Educational Measurement, 30(2), 157-183.
23.
Maydeu-Olivares, A., & Coffman, D.L. ( 2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362.
24.
Mirowsky, J., & Ross, C.E. ( 1991). Eliminating defense and agreement bias from measures of the sense of control: A 2x2 index. Social Psychology Quarterly , 54(2), 127-145.
25.
Muthén, L.K., & Muthén, B. (2006). Mplus user’s guide (4th ed.). Los Angeles: Muthén & Muthén.
26.
Nylund, K.L., Asparouhov, T., & Muthén, B.O. (2006). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Retrieved June 12, 2006, from www.statmodel.com
27.
Paulhus, D.L. ( 1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes. New York: Academic Press.
28.
Podsakoff, P.M., MacKenzie, S.B., Lee, J.-Y., & Podsakoff, N.P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies . Journal of Applied Psychology, 88(5), 879-903.
Ray, J.J. ( 1979). Is the acquiescent response style problem not so mythical after all? Some results from a successful balanced F scale. Journal of Personality Assessment, 43(6), 638-643.
31.
Robinson, J.P., Shaver, P.R., & Wrightsman, L.S. (1991). Measures of personality and social psychological attitudes of social psychological attitudes (Vol. 1). New York: Academic Press.
32.
Rorer, L.G. ( 1965). The great response-style myth. Psychological Bulletin, 63(3), 129-156.
33.
Schimmack, U., Böckenholt, U., & Reisenzein, R. (2002). Response styles in affect ratings: Making a mountain out of a molehill. Journal of Personality Assessment, 78(3), 461-483.
34.
Schwarz, G. ( 1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461-464.
35.
Steiger, J.H. ( 1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25(2), 173-180.
36.
Traub, R.E. ( 1994). Reliability for the social sciences: Theory and applications . Thousand Oaks, CA: Sage.
37.
Van Herk, H., Poortinga, Y.H., & Verhallen, T.M.M. (2004). Response styles in rating scales: Evidence of method bias in data from six EU countries. Journal of Cross-Cultural Psychology, 35(3), 346-360.
38.
Weijters, B., Geuens, M., & Schillewaert, N. (2009). The proximity effect: The role of interitem distance on reverse-item bias. International Journal of Research in Marketing, 26(1), 2-12.
39.
Weijters, B., Schillewaert, N., & Geuens, M. ( 2008). Assessing response styles across modes of data collection . Journal of the Academy of Marketing Science, 36(3), 409-422.
