The elephant in the living room: or extending the conversation about the politics of evidence

Abstract

The controversies surrounding the evidence-based research movement are reviewed from a critical pedagogy framework. Standards for assessing quality are forms of interpretive practice that enact a politics of evidence and truth. Moral and ethical criteria for judging qualitative research are reviewed.

Keywords

ethics evidence politics standards policy praxis

References

American Association of University Professors, Committee A (2006) `Report on Human Subjects: Academic Freedom and the Institutional Review Boards', URL: http//www.aaup.org/AAUP/About/committees/committee+repts/CommA/

American Education Research Association (2006 ) `Standards for Reporting on Empirical Social Science Research in AERA publications', URL (consulted 6 February 2007): http://www.:aera.net/opportunities/?id=1480

Atkinson, Paul and Sara Delamont (2006) `In the Roiling Smoke: Qualitative Inquiry and Contested Fields', International Journal of Qualitative Studies in Education 19(6): 747-55.

Becker, Howard S. (1966) `Introduction', in Clifford Shaw, The Jack-Rolle', pp. v-xviii. Chicago, IL: University of Chicago Press.

Bell, Vicki (2006) `The Cochrane Qualitative Methods Group', URL: http://www.lancs.ac.uk/fass/ihr/research/publich/cochrane.htm

Bishop, Russell. 1998. "Freeing ourselves from neo-colonial domination in research: A maori approach to creating knowledge." International Journal of Qualitative Studies in Education II: 199-219.

Bourdieu, Pierre (1998) Practical Reason. Cambridge : Polity.

Briggs, Joanna (2006) `Cochrane Qualitative Research Methods Group', The Cochrane Collaboration, URL: http://www.joannabriggs.eduau/cqrmg/role.html

Cannella, Gaile S. and Lincoln, Yvonna S. (2004) `Dangerous Discourses II: Comprehending and Countering the Redeployment of Discourses (and Resources) in the Generation of Liberatory Inquiry', Qualitative Inquiry 10(2): 165-74.

10.

Charmaz, Kathy. 2005. Constructing grounded theory: A practical guide through qualitative analysis (Introducing Qualitative methods series). Thousand Oaks, CA: Sage.

11.

Cheek, Julianne (2005) `The Practice and Politics of Funded Qualitative Research', in N.K. Denzin and Y.S. Lincoln (eds), Handbook of Qualitative Research (3rd Edition), pp. 387-410. Thousand Oaks, CA: Sage.

12.

Cheek, Julianne (2006) `"What's in a Number": Issues in Providing Evidence of Impact and Quality of Research (ers)', Qualitative Health Research 16(3): 423-35.

13.

Chenail, Ronald J. (2007) `Qualitative Research Sites', The Qualitative Report: An Online Journal, URL: htpp://www.nova.edu/sss/QR/web.html

14.

Christians, Clifford (2005) `Ethics and Politics in Qualitative Research', in N.K. Denzin and Y. S. Lincoln (Eds.), Handbook of Qualitative Research (3rd Edition), pp. 139-164. Thousand Oaks, CA: Sage.

15.

Cochrane Library (2007) `What Are Systematic Reviews and Protocols?', The Cochrane Library 1(1), URL: http://www.3.Interscience.wiley.com/cgi-bin/mrwhome/106568753/WhatAreSystematicReviews.html

16.

Creswell, John W. (2007) Qualitative Inquiry & Research Design: Choosing Among Five Approaches (2nd Edition). Thousand Oaks, CA: Sage.

17.

Davies, Philip (2004) `Systematic Reviews and the Campbell Collaboration' , in Gary Thomas and Richard Pring (eds), Evidence-Based Practice in Education, pp. 21-33. New York: Open University Press.

18.

Denzin, Norman K. (1997) Interpretive Ethnography. Thousand Oaks, CA: Sage.

19.

Denzin, Norman K. (2003) Performance Ethnography: Critical Pedagogy and the Politics of Culture. Thousand Oaks, CA: Sage.

20.

Denzin, Norman K. (2007) `The Secret Downing Street Memo and the Politics of Truth: A Performance Text', Symbolic Interaction 30(2): 4474-61.

21.

Denzin, Norman K. and Giardina, Michael D. (2006) `Qualitative Inquiry and the Conservative Challenge', in N. Denzin and M. Giardina (eds), Qualitative Inquiry and the Conservative Challenge, pp. ix-xxxi. Walnut Creek, CA: Left Coast Press.

22.

Denzin, Norman K. , Lincoln, Yvonna S. and Giardina, Michael D. (2006) `Disciplining Qualitative Research', International Journal of Qualitative Studies in Education 19(6): 769-82.

23.

Dixon-Woods, Mary , Bonas,, Shelia, Booth , Andrew, Jones , David R. , Miller, Tina , Sutton, Alex J. , Shaw, Rachel L. , Smith, Jonathan A. and Young, Bridget (2006) `How Can Systematic Reviews Incorporate Qualitative Research? A Critical Perspective', Qualitative Research 6(1): 27-44.

24.

Dixon-Woods, M. , Shaw, R.L. , Agarwal, S. and Smith, J.A. (2004) `The Problem of Appraising Qualitative Research' , Qual Saf Health Care 13: 223-5.

25.

Eisenhart, Margaret (2006) `Qualitative Science in Experimental Time', International Journal of Qualitative Studies in Education 19(6): 697-708.

26.

Eisner, Elliot W. (1991) The Enlightened Eye. New York : Macmillian.

27.

Erickson, Frederick , and Gutierrez, Kris (2002) `Culture, Rigor, and Science in Educational Research' , Educational Researcher 31(8): 21-4.

28.

Feuer, Michael J. (2006) `Response to Bettie St. Pierre's "Scientifically Based Research in Education: Epistemology and Ethics"', Adult Education Quarterly 56(3): 267-72.

29.

Feuer, Michael J. , Towne, Lisa and Shavelson , Richard J. (2002) `Science, Culture, and Educational Research', Educational Researcher 31(8): 4-14.

30.

Freeman, Mellisa , deMarrais, Kathleen , Preissle, Judith , Roulston, Kathryn , and St. Pierre, Elizabeth A. 2007. "Standards of evidence in qualitative research: An incitement to discourse." Educational Researcher 36(1): 25-32

31.

Gilgun, Jane F. (2006) `The Four Cornerstones of Qualitative Research' , Qualitative Health Research 16(3): 436-43.

32.

Guba, Egon and Lincoln, Yvonna S. (1989) Fourth Generation Evaluation . Newbury Park, CA: Sage.

33.

Guba, Egon , and Lincoln, Yvonna S. (2005) `Paradigmatic Controversies, and Emerging Confluences', in N.K. Denzin and Y.S. Lincoln (eds), Handbook of Qualitative Research (3rd Edition), pp. 191-216. Thousand Oaks, CA: Sage.

34.

Habermas, Jurgen (1972) Knowledge and Human Interests (2nd Edition). London: Heinemann.

35.

Habermas, Jurgen (2006) The Divided West. Cambridge : Polity.

36.

Hammersley, Martyn (2004) `Some Questions About Evidence-Based Practice in Education', in Gary Thomas and Richard Pring (eds), Evidence-Based Practice in Education, pp. 133-49. New York: Open University Press.

37.

Hammersley, Martyn (2005a) `Close Encounters of a Political Kind: The Threat from the Evidence-Based Policy-Making and practice Movement', Qualitative Researcher 1: 2-4.

38.

Hammersley, Martyn (2005b) `Countering the `New Orthodoxy' in Educational Research: A Response to Phil Hodkinson', British Educational Research Journal 31(2): 139-56.

39.

Hodkinson, Philip (2004) `Research as a Form ofWork: Expertise, Community and Methodological Objectivity', British Educational Research Journal 30(1): 9-26.

40.

Jackson, N. and Waters, E. (2005) `Criteria for the Systematic Review of Health Promotion and Public Health Interventions', Health Promotion International 20(4): 367-74.

41.

Jefferson, T. , Rudin, M. , Brodney Folse, S. and Davidoff, F. (2006) `Editorial Peer Review for Improving the Quality of Reports of Biomedical Studies', Cochrane Database of Methodology Reviews 2006, Issue 1. Art. No.: MR000016. DOI: 10.1002/14651858. MR000016.pub2. The Cochrane Collaboration: http:/www.cochrane.org/reviews/ en/mr000016.html. (Date of last Substantial Update: 3 October 2005). The full text is available in The Cochrane Library (ISSN 1464-780X).

42.

Judson, Horace Freeland (2004) The Great Betrayal: Fraud in Science. New York: Harcourt Brace.

43.

Kaplan, Esther (2004) With God On Their Side: How the Christian Fundamentalists Trampled Science, Policy and Democracy in George W. Bush's White House. New York: New Press .

44.

Koukl, Greg (2007) `The Trouble with the Elephant', URL: http/www.str.org/site/News2?page=NewsArticle&id=6191

45.

Larner, G. (2004) `Family Therapy and the Politics of Evidence', Journal of Family Therapy 26: 17-39.

46.

Lather, Patti (1993a) Getting Lost: Feminist Efforts toward a Double(d) Science. Albany, NY: SUNY Press .

47.

Lather, Patti (1993b) Getting Smart: Feminist Research and Pedagogy With/in The Postmodern. New York: Routledge.

48.

Lather, Patti (2004a) `This Is Your Father's Paradigm: Government Intrusion and the Case of Qualitative Research in Education', Qualitative Inquiry 10(1): 15-34.

49.

Lather, Patti (2004b) `Scientific Research in Education: A Critical Perspective', British Educational Research Journal 30(6): 759-72.

50.

Lather, Patti (2006) `Foucauldian Scientificity: Rethinking the Nexus of Qualitative Research and Educational Policy Analysis', International Journal of Qualitative Studies in Education 19(6): 783-92.

51.

Lincoln, Yvonna S. and Cannella, Gaille S. (2004) `Dangerous Discourses: Methodological Conservatism and Governmental Regimes of Truth', Qualitative Inquiry 10(1): 5-10.

52.

Lincoln, Yvonna and Guba, Egon (1985) Naturalistic Inquiry. Beverly Hills, CA: Sage.

53.

Lundberg, George (1926) `Quantitative Methods in Sociology', Social Forces 39: 19-24.

54.

MacLure, Maggie (2006) `The Bone in the Throat: Some Uncertain Thoughts on Baroque Method', International Journal of Qualitative Studies in Education 19(6): 729-46.

55.

Madison, D. Soyini. (2005) Critical Ethnography: Methods, Ethics and Performance . Thousand Oaks, CA: Sage.

56.

Maxwell, Joseph A. (2004a) `Using Qualitative Methods for Causal Explanation' , Field Methods 16(3): 243-64.

57.

Maxwell, Joseph A. (2004b) `Causal Explanation, Qualitative Research, and Scientific Inquiry in Education', Educational Researcher 23(2): 3-11.

58.

Monastersky, Richard (2002) `Research Groups Accuse Education Department of Using Ideology in Descisions About Data', Chronicle of Higher Education 25(2), URL: http://chronical.com/dailyk/2002/22/200211250n.htm

59.

Moran-Ellis, Jo , Alexander, Victoria D. , Cronin, Ann , Dickenson, Mary , Fielding, Jane , Sleney, Judith and Thomas, Hilary (2006) `Triangulation and Integration: Proceses, Claims and Implications', Qualitative Research 6(1): 45-60.

60.

Morse, Janice M. (2006a) `The Politics of Evidence', Qualitative Health Research 16(3): 395-404.

61.

Morse, Janice M. (2006b) `Reconceptualizing Qualitative Inquiry', Qualitative Health Research 16(3): 415-22.

62.

National CASP Collaboration (2006) `10 Questions to Help You Make Sense of Qualitative Research, Critical Appraisal Skills Program (CASP)', Milton Keynes Primary Care Trust (The Cochrane Collaboration), URL: http://www.joannabriggs.eduau/cqrmg/role.html )

63.

National Center for Dissemination of Disability Research (2007) URL: http://www.ncddr.org/kt/products.focus.focus9/

64.

National Research Council (2002) Scientific Research in Education, Committee on Scientific Principles for Education Research (R.J. Shavelson and L. Towne, eds). Washington, DC: National Academy Press.

65.

National Research Council (2005) Advancing Scientific Research in Education, Committee on Scientific Principles for Education Research (L. Towne, L. Wise and T.M. Winters, eds). Washington, DC: National Academy Press.

66.

Popay, J. , Rogers, A. and Williams, G. (1998) `Rationale and Standards for the Systematic Review of Qualitative Literature in Health Services Research', Qualitative Health Research 8: 341-51.

67.

Preissle, Judith (2006) `Envisioning Qualitative Inquiry: A View Across Four Decades', International Journal of Qualitative Studies in Education 19(6): 685-96.

68.

Qualitative Research (2006) `Special Issue: Mixed Methods Research', 6(1): 5-115.

69.

Quigley, Lillian (1996) The Blind Men and the Elephant. New York: Charles Scribner's Sons.

70.

Rains, F.V. , Archibald, J.A. , and Deyhle, D. 2000. Introduction: Through our eyes and in our own words - The voices of indigenous scholars, International Journal of Qualitative Studies in Education 13: 337-342.

71.

Saukko, Paula (2003) Doing Research in Cultural Studies: An Introduction to Classical and New Methodological Approaches. London : Sage.

72.

Smith, L.T. 1999. Decolonizig methodologies: Research and indigenous peoples . Dunedin: University of Otago Press .

73.

Smith, John K. and Deemer, Deborah K. (2000) `The Problem of Criteria in the Age of Relativism', in N.K. Denzin and Y.S. Lincoln (eds), Handbook of Qualitative Research (3rd Edition), pp. 877-96. Thousand Oaks, CA: Sage.

74.

Smith, John K. and Hodkinson, Phil (2005) `Relativism, Criteria and Politics', in N.K. Denzin and Y.S. Lincoln (eds), Handbook of Qualitative Research (3rd Edition), pp. 915-32. Thousand Oaks, CA : Sage.

75.

Spencer, L. , Ritchie, J. , Lewis, L. and Dillion, L. (2003) Quality in Qualitative Evaluation: A Framework for Assessing Research Evidence. London: Government Chief Social Researcher's Office, Crown Copyright.

76.

Stanfield, John H. II. (2006) `The Possible Restorative Justice Functions of Qualitative Research', International Journal of Qualitative Studies in Education 19(6): 723-8.

77.

St. Pierre, Elizabeth Adams (2006) `Scientifically Based Research in Education: Epistemology and Ethics', Adult Education Quarterly 56(3): 239-66.

78.

St. Pierre, Elizabeth Adams and Roulston, Kathryn (2006) `The State of Qualitative Inquiry: A Contested Science', International Journal of Qualitative Studies in Education 19(6): 673-84.

79.

Stronach, Ian (2006) `Enlightenment and the "Heart of Darkness": (Neo)imperialism in the Congo, and Elsewhere', International Journal of Qualitative Studies in Education 19(6): 757-68.

80.

Stronach, Ian , Garratt, Dean , Pearce, Cathie and Piper, Heather (2007) `Reflexivity, the Picturing of Selves, the Forging of Method', Qualitative Inquiry 13(2): 179-203.

81.

Teddlie, C. and Tashakkori, A. (2003) `Major Issues and Controversies in the Use of Mixed Methods in the Social and behavioural Sciences', in A. Tashakkori and C. Teddlie (eds), Handbook of Mixed-Methods in Social and Behavioral Research , pp. 3-50. Thousand Oaks, CA: Sage.

82.

Thomas, Gary (2004) `Introduction: Evidence: Practice', pp. 1-20 in Gary Thomas and Richard Pring (eds), Evidence-Based Practice in Education. New York: Open University Press.

83.

Timmermans, Stefan and Berg, Marc (2003) The Gold Standard: The Challenge of Evidence-Based Medicine and Standardization in Health Care. Philadelphia , PA: Temple University Press.

84.

Torrance, Harry (2006) `Research Quality and Research Governance in the United Kingdom', pp. 127-48 in N. Denzin and M. Giardina (eds), Qualitative Inquiry and the Conservative Challenge. Walnut Creek, CA: Left Coast Press.

85.

Torrance, Harry (2007) `E-mail - 3rd International Congress', 8 March 2007.

86.

Viadero, D. (2006) `New Group of Researchers Focuses on Scientific Study', Education Week 25(21): 1 & 16.

87.

What Works Clearinghouse, URL: http://w-w-c.org/whoweare/overview.html#ies

88.

White, Caroline (2003) `Little Evidence for Effectiveness of Scientific Peer Review', British Medical Journal 326(7383) (1 February): 241.

89.

Wolcott, Harry F. (1999) Ethnography: A Way of Seeing. Walnut Creek, CA: AltaMira Press.