This article considers the problem of measurement error in data collected from textual sources (for example, newspapers, police records, medical records). The article discusses several levels in the strategy of both detection and correction of errors, on-line and off-line, during and after data collection. It introduces social scientists to useful concepts and tools such as performance-shaping factors and acceptance sampling, which have been developed in the field of engineering. It proposes the use of semantic text grammars in lieu of traditional content analysis schemes for the collection of textual data. Linguistics-based coding schemes yield much richer data. The article shows that these data are also more reliable, because they retain the semantic coherence of the original text.
References
1.
AGAR, M.
and J. HOBBS (1982) “Interpreting discourse: coherence and the analysis of ethnographic interviews.”Discourse Processes5: 1-32.
2.
ALWIN, D.
(1977) “Making errors in surveys.”Soc. Methods and Research6(2): 131-150.
3.
BARNETT, V.
and T. LEWIS (1984) Outliers in Statistical Data. New York: John Wiley.
4.
BELSLEY, D.
, E. KUH, and R. WELSCH (1980) Regression Diagnostics, Identifying Influential Data and Sources of Collinearity. New York: John Wiley.
5.
BIERWISCH, M.
(1970) “Semantics,” pp. 166-184 in J. Lyons (ed.), New Horizons in Linguistics. Harmonsworth: Penguin.
6.
BUDD, R.
, R. THORP and L. DONOHEW (1966) Content Analysis of Communications. New York: Macmillan.
7.
COOK, R. D.
and S. WEISBERG (1982) Residuals and Influence in Regression. New York: Chapman and Hall.
8.
CRITTENDEN, K. S.
and R. J. HILL (1971) “Coding reliability and validity of interview data.”Amer. Soc. Rev.36: 1073-1080.
9.
CUSHMAN, W. H.
and B. CRIST (1987) “Illumination,” pp. 670-695 in G. Salvendy (ed.), The Handbook of Human Factors. New York: John Wiley.
10.
FELLEGI, I. P.
and D. HOLT (1976) “A systematic approach to automatic edit and imputation.”J. of the Amer. Stat. Ass.71: 17-35.
11.
FRANZOSI, R.
(1987) “The press as a source of socio-historical data: issues in the methodology of data collection from newspapers.”Historical Methods20(1): 5-16.
12.
FRANZOSI, R.
(1990) “From words to numbers: a generalized and linguistics-based coding procedure for collecting textual data.”Soc. Methodology: 263-298.
13.
FRANZOSI, R.
(1990) “Computer-assisted coding of textual data: an application to semantic grammars.”Soc. Methods and Research.
14.
FREEMAN, H. A.
, M. FRIEDMAN, F. MOSTELLER, and W. A. WALLIS (eds.) (1948) Sampling Inspection. New York: McGraw-Hill.
15.
GRUDIN, J. T.
(1983) “Error patterns in novice and skilled transcription typing,” pp. 121-143 in W. E. Cooper (ed.), Cognitive Aspects of Skilled Typewriting. New York: Springer-Verlag.
16.
HOAGLIN, D.
, F. MOSTELLER, and J. TUKEY (eds.) (1983) Understanding Robust and Exploratory Data Analysis. New York: John Wiley.
17.
HOFSTETTER, C. R.
(1976) Bias in the News. Columbus: Ohio State Univ. Press.
18.
HOYOS, C. G.
(1987) “Motivation,” pp. 108-123 in G. Salvendy (ed.), The Handbook of Human Factors. New York: John Wiley.
19.
KAMMEYER, K.
and ROTH J. (1971) “Coding responses to open-ended questions.”Soc. Methodology60-78.
20.
KINTSCH, W.
(1974) The Representation of Meaning in Memory. Hillsdale, NJ: Lawrence Erlbaum.
21.
KINTSCH, W.
and T. VAN DIJK (1978) “Toward a model of text comprehension and production”Psych. Rev.85(5): 363-394.
22.
KRESS, G.
and R. HODGE (1979) Language as Ideology. London: Routledge & Kegan Paul.
23.
KRIPPENDORFF, K.
(1980) Content Analysis: An Introduction to Its Methodology. Beverly Hills, CA: Sage.
24.
LABOV, W.
and J. WALETZKY (1967) “Narrative analysis,” pp. 12-44 in Helm (ed.), Essays on the Verbal and Visual Arts. Seattle: Univ. of Washington Press.
25.
LOFTUS, E.
(1979) Eyewitness Testimony. Cambridge, MA: Harvard Univ. Press.
26.
Mc INTYRE, D. A.
(1980) Indoor Climate. London: Applied Science.
27.
MILLER, D. P.
and A. D. SWAIN (1987). “Human error and human reliability,” pp. 219-250 in G. Salvendy (ed.), The Handbook of Human Factors. New York: John Wiley.
28.
MISHLER, E.
(1986) Research Interviewing, Context and Narrative. Cambridge, MA: Harvard Univ. Press.
29.
MORRISSEY, E.
(1974) “Sources of error in the coding of questionnaire data.”Soc. Methods and Research3(2): 209-232.
30.
NAUS, J. I.
(1975) Data Quality Control and Editing. New York: Marcel Dekker.
31.
PERROT, M.
(1974) Les Ouvriers en Grève. Paris: Mouton.
32.
SALVENDY, G.
(ed.) (1987) The Handbook of Human Factors. New York: John Wiley.
33.
SHAFFER, L. H.
and J. HARDWICK (1969) “Errors and error detection in typing.”Q. J. of Experimental Psychology21(3): 209-213.
34.
SMITH, M. J.
(1987) “Occupational stress,” pp. 844-860 in G. Salvendy (ed.), The Handbook of Human Factors. New York: John Wiley.
35.
SMITH, M. J.
and D. B. BERINGER (1987) “Human factors in occupational injury evaluation and control,” pp. 767-789 in G. Salvendy (ed.), The Handbook of Human Factors. New York: John Wiley.
36.
STANHAGEN, J. F.
and J. G. CARLSON, Jr. (1979) “Identifying and controlling coding errors in information systems.”Ergonomics22(4) 441-452.
37.
TREW, T.
(1979) “Theory and Ideology at Work,” pp. 94-116 in R. Fowler, R. Hodge, G. Kress, and T. Trew (eds.), Language and Control. London: Routledge & Kegan Paul.
38.
TUKEY, J.
(1977) Exploratory Data Analysis, Reading, MA: Addison-Wesley.
39.
VAN DIJK T.
(1972). Some Aspects of Text Grammars. Paris: Mouton.
40.
VAN DIJK T.
(1977) Text and Context. London: Longman.
41.
VAN DIJK T.
(1980) “Story comprehension: an introduction.”Poetics9: 1-21.
42.
VAN DIJK, T.
(1983) “Discourse analysis: its development and application to the structure of news.”J. of CommunicationSpring: 20-43.
43.
VAN NES, F. L.
(1976) “Analysis of keying errors.”Ergonomics19(2): 165-174.
