This paper assesses the performance of a vocabulary test designed to measure second language productive vocabulary knowledge.The test, Lex30, uses a word association task to elicit vocabulary, and uses word frequency data to measure the vocabulary produced. Here we report firstly on the reliability of the test as measured by a test-retest study, a parallel test forms experiment and an internal consistency measure. We then investigate the construct validity of the test by looking at changes in test performance over time, analyses of correlations with scores on similar tests, and comparison of spoken and written test performance. Last, we examine the theoretical bases of the two main test components: eliciting vocabulary and measuring vocabulary. Interpretations of our findings are discussed in the context of test validation research literature. We conclude that the findings reported here present a robust argument for the validity of the test as a research tool, and encourage further investigation of its validity in an instructional context.
Aitchison, J. ( 2003). Words in the mind. Oxford: Blackwell.
2.
Aizawa, K. ( 2006). Rethinking frequency markers for English-Japanese dictionaries . In M. Murata, K. Minamiide, Y. Tono, & S. Ishikawa (Eds.), English lexicography in Japan (pp. 108-19). Tokyo: Taishukan .
3.
Baba, K. ( 2002). Test review: Lex30. Language Testing Update, 32, 68-71.
4.
Bachman, L.F. ( 1990). Fundamental considerations in language testing. Oxford: Oxford University Press.
5.
Bachman, L.F., & Palmer, A.S. ( 1996). Language Testing in Practice: Designing and developing useful language tests. Oxford: Oxford University Press.
6.
Chapelle, C.A. ( 1998). Construct definition and validity inquiry in SLA research . In L. F. Bachman & A. D. Cohen, (Eds.), Interfaces between second language acquisition and language testing research (pp. 32-70). Cambridge : Cambridge University Press.
7.
Chapelle, C.A. ( 1999). Validity in language assessment. Annual Review of Applied Linguistics, 19, 254-72.
8.
Cronbach, L.J. ( 1984). Essentials of psychological testing. New York: Harper & Row.
9.
Davies, A., & Elder, C. ( 2005). Validity and validation in language testing. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp. 715-814). London: Routledge.
10.
Fitzpatrick, T. ( 2006). Habits and rabbits: Word associations and the L2 lexicon . EUROSLA Yearbook2006, 6, 121-145.
11.
Fitzpatrick, T. ( 2007a). Productive vocabulary tests and the search for concurrent validity. In H. Daller, J. Milton, & J. Treffers-Daller (Eds.), Modelling and assessing vocabulary knowledge (pp. 116-132). Cambridge: Cambridge University Press.
12.
Fitzpatrick, T. ( 2007b). Word association patterns: Unpacking the assumptions . International Journal of Applied Linguistics, 17(3), 319-331.
13.
Fitzpatrick, T. ( 2007c). Tracking the changes: Vocabulary acquisition in the study abroad context. Paper presented at Estudios de Lingüística Inglesa Aplicada (ELIA) Conference, Seville, March 2007.
14.
Fitzpatrick, T., & Meara, P.M. ( 2004). Exploring the validity of a test of productive vocabulary . Vigo International Journal of Applied Linguistics, 1, 55-74.
15.
Fulcher, G., & Davidson, F. ( 2007). Language testing and assessment: An advanced resource book. Abingdon: Routledge.
16.
Grotjahn, R. ( 1986). Test validation and cognitive psychology: Some methodological considerations. Language Testing, 3(2), 159-185.
17.
Hatch, E., & Lazaraton, A. ( 1991). The research manual: Design and statistics for applied linguistics. New York: Newbury House .
18.
Heatley, A., & Nation, I.S.P. (1998). VocabProfile and range . Wellington: School of Linguistics and Applied Language Studies, Victoria University of Wellington.
19.
Hughes, A. ( 1989). Testing for language teachers. Cambridge : Cambridge University Press.
20.
Jacet (2003). JACET list of 8000 basic words. Tokyo: Japan Association of College English Teachers.
21.
Jiménez Catalán, R., & Moreno Espinosa , S. (2005). Using Lex30 to measure the L2 productive vocabulary of Spanish primary learners of EFL. Vigo International Journal of Applied Linguistics , 2, 27-44.
22.
Kiss, G.R., Armstrong, C., Milroy, R., & Piper, J. ( 1973 ). An associative thesaurus of English and its computer analysis. In A. J. Aitken, R. W. Bailey, & N. Hamilton-Smith, (Eds.), The computer and literary studies (pp. 153-165). Edinburgh: Edinburgh University Press.
23.
Koizumi, R. ( 2004). Validating a productive vocabulary knowledge test for novice Japanese learners of English. JACET summer seminar proceedings, 4: Facilitating Vocabulary Acquisition , 64-67.
24.
Kruse, H., Pankhurst, J., & Sharwood Smith, M. (1987). A multiple word association probe in second language acquisition research. Studies in Second Language Acquisition, 9(2), 141-154.
25.
Laufer, B., & Nation, I.S.P. (1995). Vocabulary size and use: lexical richness in L2 written production. Applied Linguistics , 16(3), 307-322.
26.
Laufer, B., & Nation, I.S.P. (1999). A vocabulary-size test of controlled productive ability. Language Testing, 16, 33-51.
27.
Meara, P.M. ( 1978). Learners’ word associations in French. Interlanguage Studies Bulletin, 3, 192-211.
Nation, I.S.P. ( 1984). Vocabulary lists. Victoria University of Wellington, English Language Institute, Wellington , New Zealand.
37.
Nation, I.S.P. ( 2001). Learning vocabulary in another language. Cambridge: Cambridge University Press.
38.
Palmberg, R. ( 1987). Patterns of vocabulary development in foreign language learners. Studies in Second Language Acquisition, 9, 201-220.
39.
Read, J. ( 2000). Assessing vocabulary. Cambridge: Cambridge University Press.
40.
Read, J., & Chapelle, C.A. (2001). A framework for second language vocabulary assessment. Language Testing, 18(1), 1-32.
41.
Schmitt, N., Schmitt, D., & Clapham, C. ( 2001). Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test. Language Testing, 18(1), 55-88.
42.
Shepard, L.A. ( 1993). Evaluating test validity. In L. Darling-Hammon (Ed.), Review of research in education, vol. 19 (pp. 405-450). Washington, DC: AERA.
43.
West, M. ( 1953). A general service list of English words. London: Longman.
