Abstract
Conceptual stances provide guidance to the mixed methods researcher as he or she makes decisions throughout the research process, including determining the dimensions of integration or levels at which mixing occurs. Only the dialectic conceptual stance specifically encourages mixing at the abstract paradigmatic level. This article outlines four characteristics of the dialectic stance and proposes a four-step analytic framework, Paradigm Parley. Each analytic step is illustrated with data from the author’s dissertation, a music education study investigating the teaching of middle school general music. The Paradigm Parley framework is one possibility for adopting the dialectic stance but requires additional testing by other scholars. Suggestions for implementing the framework or developing alternative analytic frameworks are offered to stimulate future scholarly dialogue.
Keywords
The possibility of mixing is a possibility engaged not just at the technical level of method but also at the broader level of methodology and at the highest (most abstract) level of paradigm, which commonly also invokes mixing at additional levels of theory and discipline. This possibility of mixing at multiple levels is integral to the character of mixed methods approaches to social inquiry, even though not all mixed methods studies do or even should mix at multiple levels. That is, in some contexts a mix of methods alone is most justifiable, while in others a limited methods mix may represent a missed opportunity for deeper insights. But, with the possibility of mixing at all levels, mixed methods approaches to social inquiry can intentionally incorporate quite different perspectives and assumptions about the phenomena being studied and thus offer important potential to meaningfully engage with difference, dissonance, and diversity. (Greene, 2015, pp. 607-608)
Wrestling With Paradigms
Imagine a cartoon in which the protagonist is being taunted by two versions of himself or herself, one dressed in a costume representing an angelic character and the other representing a devilish character. In these cartoons, the protagonist is typically being pulled in two different directions, one seen as socially “good” and the other as socially “bad.” Typically, the representations of the good-side and the bad-side pull the cartoon character in opposite directions until he or she makes the “right” decision and chooses to behave as the angelic character advocated from the beginning. Most readers are likely familiar with some variation of this cartoon morality play. However, this dichotomous representation of decision-making leaves no room for gray areas, no room for difference and diversity, and certainly no room for dialogue between the two perspectives on the issue. If the two personified points of view were given time to discuss their perspectives, each putting forth the valuable learning aspects of their perspective and valuing what the other had to offer, then the decisions of the protagonist would become more nuanced. Of course, this is where the subtleties of the cartoon would prove too challenging for small children, but imagine the possibilities: The devil and angel have shed their costumes and now represent not “good” and “bad,” but rather two different, equally defensible perspectives on an issue. The two perspectives are no longer dichotomous, but simply different understandings which must be reconciled, incorporated, and internally discussed through the reasoned cognition of the protagonist, a parley if you will.
Paradigms, in particular the “paradigm-wars” of the 1980s, feature prominently in the mixed methods literature (see Mertens, 2012). For example, a quick keyword search of the Journal of Mixed Methods Research yielded 176 results for the word “paradigm,” yet many authors do not clarify how they are specifically using the term. According to Mertens, “part of the reason for the multiplicity of viewpoints about the role of paradigms in mixed methods research emanates from the different uses of the term paradigm” (2012, p. 255). Mertens (2012) identifies two primary uses of the term paradigm in mixed methods: The first is associated with the philosophical assumptions that guide the decision-making process of a research project and the second argues for mixed methods as a third paradigm. This article is concerned with the former understanding of paradigms.
In the second Handbook of Mixed Methods in Social and Behavioral Research, Teddlie and Tashakkori (2010) move the mixed methods discussion forward from a discussion of “paradigmatic foundations” to what they call “conceptual stances” arguing that this change “reflects a transformation in MMR thought away from interlocking sets of philosophical assumptions and toward a more practical orientation that emphasizes individual components of philosophy and theory as guiding research activities” (p. 13). The term conceptual stance aligns with the first use of the term paradigm Mertens (2012) identifies above. Conceptual stances, variously called paradigms, worldviews (Creswell, 2013; Creswell & Plano Clark, 2007), or mental models (Greene, 2007) in the mixed methods literature, provide the researcher with a framework that guides him or her in the various decisions necessary for the completion of a mixed methods research project (Shannon-Baker, 2016).
Teddlie and Tashakkori (2010) identify the six conceptual stances most often appearing in the mixed methods literature (see also, Greene, 2007; Creswell & Plano Clark, 2007): the a-paradigmatic stance, the substantive theory stance, the complementary strengths stance, the multiple paradigms stance, the dialectic stance, and the single paradigm stance (Teddlie & Tashakkori, 2010; see also Bergman, 2010; Biesta, 2010; Denscombe, 2008; Feilzer, 2010; Florczak, 2014; Greene & Caracelli, 1997; Hesse-Biber, 2010; Johnson, 2008; Maxwell & Mittapalli, 2010; Mertens, Bledsoe, Sullivan, & Wilson, 2010; Morgan, 2007; Shannon-Baker, 2016). Each of these stances provides a highest level conceptual approach to mixed methods work that theoretically helps the researcher make all subsequent decisions in a research study. It is important to note that a researcher’s use of one conceptual stance does not commit the researcher to that stance for all future research inquiries; use of a particular conceptual stance can change based on the needs of a particular investigation.
A conceptual stance not only provides a framework that guides later data collection and analysis decisions made by the researcher but also serves an important secondary purpose for mixed methods: It guides the researcher in determining the level of mixing that occurs in the study. As Greene (2015) states above, the decision to mix at multiple levels, including the paradigmatic level, is an important consideration for mixed methods researchers. Not all research investigations require mixing at the paradigmatic level and thus not all conceptual stances advocate for this level of mixing. For example, the complementary strengths stance focuses on keeping methods separate, each within its own paradigmatic perspective, while the single paradigm stance argues for an alternative paradigm specifically encompassing all phases of a mixed methods investigation—most commonly, pragmatism (see, Feilzer, 2010; Florczak, 2014). In contrast, the value of differing paradigmatic perspectives which can and should be mixed is the focus of the dialectic conceptual stance.
For the sake of clarity, I will use the term conceptual stance or stance to mean the philosophical assumptions that guide a mixed methods researcher in the research decision-making process, particularly, the dimensions of integration within the study. In this article, these terms will specifically reference the dialectic stance. Use of paradigm, perspective, or paradigmatic perspective will refer to the viewpoints being mixed by a researcher using the dialectic stance.
The Dialectic Stance
The dialectic stance in mixed methods research originates with Greene and Caracelli (1997), but draws upon the philosophical concept of the dialectic, traceable to Dewey’s (1916) scholarship eschewing dichotomous thinking and indeed back even farther to Plato’s Dialogues (see, Johnson, 2008). Like Greene, I draw upon Dewey’s understanding of the dialectic, particularly that theory and practice are inseparable (McKeon, 1952). In addition, I support Greene’s (2007) understanding of the dialectic stance as democratic. In particular, my understanding of democracy focuses on empowering participants to give voice to their unique experiences and the co-construction of knowledge by the researcher and participant (Elbaz-Luwisch, 1997). I acknowledge that other understandings of the dialectic stance also exist (see, Baxter & Montgomery, 1996; Ollman, 2003); indeed, other mixed methods scholars have linked the dialectic stance to Bakhtin (Zhou & Hall, 2016) or Bourdieu (Jones, 2015). In his recent proposal of dialectical pluralism as a metaparadigm, Johnson (2017) carefully outlines epistemological, ontological, and axiological premises drawn from Greene’s dialectic stance. Published after the work presented here was conducted, Johnson’s (2017) work has not directly affected the framework proposed herein, but scholars interested in using the framework proposed below are encouraged to also consider Johnson’s philosophical framing.
Similarities exist between the pragmatic stance and the dialectic stance, particularly in the rejection of dualism and the foundation of democratic ideals (Greene & Hall, 2010). According to Denscombe (2008), pragmatism provides a set of assumptions about knowledge and inquiry that underpins the mixed methods approach and distinguishes the approach from purely quantitative approaches that are based on a philosophy of (post)positivism and from purely qualitative approaches that are based on a philosophy of interpretivism or constructivism. (p. 273; see also Howe, 1988)
However, a pragmatic understanding of knowledge rests on Dewey’s transactional constructivism, which “is able to offer philosophical support for explanatory research but not for interpretive research” (Biesta, 2010, pp. 112-113). While those advocating for pragmatism as the alternative paradigm draw upon Dewey’s pragmatic philosophy and advocate for the laudable goal that the research question should drive all study decisions (Creswell & Plano Clark, 2007), I agree with Biesta (2010) that pragmatism is incompatible with interpretivist research. This incompatibility makes the study of complex phenomenon difficult because interpretivist insights are necessary to fully understand the nuances and differing perspectives often present in a complex research setting. In addition, pragmatism does not seek to integrate two separate perspectives within one study; rather, pragmatism is the perspective used throughout an entire mixed methods study.
Greene (2007; see also Greene & Hall, 2010) likens the dialectic stance to a respectful conversation among colleagues (an analogy similar to Plato’s philosophical discussions in the Dialogues). In the dialectic stance, mixing or integration can occur at all levels or dimensions of a mixed methods study, including at the paradigmatic level or philosophical dimension (Fetters & Molina-Azorin, 2017) or the mixing of paradigmatic perspectives. The crux of the dialectic stance is respectful conversation between two differing perspectives and the learning or deeper understanding that occurs in the interaction between two differing viewpoints. In this, the dialectic stance moves beyond pragmatism because the two perspectives collide, not for an additive understanding (as in triangulation), but rather for a third, entirely new perspective (of which an additive understanding is just one possible outcome).
According to the understanding of the dialectic stance presented here, there are four characteristics that must be considered in order to engage in the dialectic stance (see Table 1). These four characteristics are not explicitly stated in any single existing work. Drawing from Greene’s work on the dialectic stance (Greene, 2007; Green & Caracelli, 1997; Greene & Hall 2010), I compiled these characteristics as the four I understand to be foundational in conducting research using the dialectic stance. Each characteristic will be explained in the following sections.
Defining Four Foundational Characteristics of the Dialectic Stance Used in the Paradigm Parley Framework.
Characteristic 1: Sustain a Data Dialogue
The first characteristic is that the researcher seeks and sustains a dialogue among data collected within differing paradigmatic perspectives (Greene & Hall, 2010). This conversational process occurs aloud and in written documents when conducted by a team of researchers able to dialogue together. However, when conducted by an independent researcher, the conversational process is an internal dialogue documented in a journal or in research memos (Greene & Hall, 2010). This conversational process requires a researcher adept at switching between two different paradigmatic perspectives and/or one competent in seeing the sum of disparate parts. The ability to make these transitions between perspectives is identified by Johnson (2015) as fundamental to the dialectic stance: Making Gestalt switches is at the heart of mixed methods research, when a single researcher hopes to conduct MMR at the paradigm level. If a single researcher has not obtained competence at this, it is readily obtained with a heterogeneous research team composed of reasonable, open-minded researchers whose primary paradigms are different. On a heterogeneous research team, the mixed researcher needs to facilitate, and emphasize, good communication and translation, listening, empathy, process, and openness to larger and more complex wholes than what is obtained via a single paradigm. (Johnson, 2015, p. 690)
Characteristic 2: Give Equal Voice
The respectful dialogue of Characteristic 1 leads directly to the second key characteristic: all paradigmatic perspectives used in the study are given equal voice in the dialogue. While the mixed methods literature uses the terms equal weight or equal status in identifying a mixed methods study where the quantitative and qualitative portions of the study are equal (QUANT/QUAL), the idea of equal voice discussed here furthers this idea of equality into the mixed methods analysis or integration phase. As a researcher seeks to integrate the quantitative and qualitative data, he or she must constantly monitor the source of the data being analyzed and be certain that cognitively he or she is interpreting these data within their original paradigmatic perspective. Finally, although a statistically significant result from a large sample might feel more “powerful” to some researchers than the voice of one participant, the researcher must allow both pieces of evidence an equal voice as he or she integrates the two phases of data. All forms of data must be contemplated for what they offer to an increased understanding of the researched phenomenon. An independent researcher cannot ignore the paradigmatic perspective with which he or she feels less competent, anymore than a team of researchers can negate the perspective of one member of the team. The equality of voice in the dialogue between collected data necessitates openness to complexity and to the possibility that deeper insights will occur as a result.
Characteristic 3: Preserve Data Integrity
By giving equal voice, no one paradigmatic perspective subsumes the other. Within this equality of voice is the third characteristic: preserve data integrity. In order to give all involved paradigmatic perspectives equal voice in the dialogue, the researcher cannot transform qualitative data into quantitative or vice versa. To transform data is to give more power, and thus, more voice to one perspective over the other. This is not to negate the work of mixed methods scholars who choose data transformation as a legitimate form of mixed methods analysis; rather, I suggest that transformation runs counter to the underlying democratic principles of Greene’s (2007) dialectic stance. Insights generated through the preservation of data integrity are typically complex, detailed, and potentially confounding, but data integrity is essential when all paradigms are given equal voice.
Characteristic 4: Value Consonance and Dissonance
The complexity generated by preserving data integrity leads to the fourth characteristic of the dialectic stance: Results that are dissonant must be valued as much as results that are consonant (see, Greene & Hall, 2010). A primary tenet of the dialectic stance is that difference resulting from the use of multiple paradigmatic perspectives “must be honored in ways that maintain the integrity of the disparate paradigms” (Greene & Caracelli, 1997, p. 8). The dialectic stance encourages the complexity and richness of understanding that occurs when multiple perspectives are brought together. In this way, a researcher adopting the dialectic stance seeks both convergence and divergence when mixing data from multiple methods. The researcher does not strive only for convergence or data triangulation but also seeks divergent data within the mix of methods. This divergence must be discussed openly and equally with the data that converges. According to Teddlie and Tashakkori (2010), “this emphasis on divergent results often provides greater insight into complex aspects of a phenomenon, which can then lead to more in-depth investigation of previously unexplored aspects of that phenomenon” (p. 9). The dialectic stance thrives on both the convergence and divergence that emerge when multiple views of the collected research are mixed.
The four characteristics of the dialectic stance return us to the cartoon description that opened this article. In dialectic analysis, the goal is a parley between the paradigms used in the research study. The paradigmatic perspectives used in data collection metaphorically sit on the shoulders of the researcher(s), each expressing his or her view of the phenomenon investigated. While the researcher may feel torn between these conflicting views, it is the researcher’s responsibility to allow these perspectives to dialogue, then equally account for each perspective in the data presentation. The dialogue generated by this form of mixed methods analysis is not straightforward and is often circular or iterative in nature. The subsequent discussion of the insights that emerge from the dialogue is a net gain in understanding, one that is much greater than if the two perspectives had not dialogued.
While Greene and Hall (2010) provide a hypothetical example in which the dialectic stance is used by a single researcher, I have found only a few mixed methods studies explicitly identifying the dialectic stance as the conceptual stance used. Mirchandani et al. (2016) and Leal et al. (2016) both use the dialectic stance with a team of researchers. Headley (2016) and Howes (2017) use this stance as independent researchers and provide the most practical discussions regarding the application of the dialectic stance. However, all four studies were published recently, long after the dissertation study upon which the framework proposed here was conceived. Additionally, none of these studies explicitly take into consideration all four of the characteristics identified above.
The purpose of this article is to put forward one possible framework for conducting mixed methods analysis using Greene’s dialectic stance. Given that the dialectic stance values multiple viewpoints, I put this framework forward as one possible approach to dialectic mixed methods analysis, not the framework. My goal is to provide a practical tool for individual researchers seeking to conduct independent mixed methods analysis using Greene’s dialectic stance (although research teams might also find this framework practical). Applying the four characteristics described above, I first outline the framework and then provide a brief example of how the framework was applied in the analysis I conducted during my dissertation. I conclude with recommendations drawn from lessons learned, potential applications, and a call for ongoing dialogue.
Proposed Dialectic Analysis Framework
The proposed framework, which I call “Paradigm Parley,” is drawn from the approach I used in my dissertation study (Cronenberg, 2016). A parley is a meeting or conference between opposing sides. Although typically associated with a cessation of conflict in combat, I use it here because integration within the philosophical dimension (Fetters & Molina-Azorin, 2017) requires a cessation of the conflict of understanding that can occur when multiple paradigmatic perspectives are used in a research study. In the Paradigm Parley framework, the “voices” or perspectives of multiple, typically conflicting paradigmatic perspectives parley (or dialogue to express their point of view) to enable deeper understanding of the phenomenon to emerge from the complexity. The paradigm parley does not result in a truce; rather, the researcher must interpret the opposing viewpoints as an opportunity to learn, deepen understanding, and potentially challenge the discipline with new insights.
Recently, Fetters and Molina-Azorin (2017) identified 15 dimensions of a mixed methods study that might be integrated. The focus of this article is on integration at the philosophical level, specifically through integration at the data analysis level, yet my dissertation study integrated at several other levels identified as well (Fetters & Molina-Azorin, 2017). In order to understand the framework I am suggesting, it is important for me to first provide a brief overview of my dissertation study during which I implemented this framework. My dissertation was an interdisciplinary investigation of the teaching of middle level general music (Grades 5-8, nonensemble music class) in the United States. Specifically, my study focused on how music teachers’ ideas about middle school general music were aligned with the principles stated in a middle level philosophical document, This We Believe: Keys to Educating Young Adolescents (National Middle School Association, 2010), thus, integrating music education and middle level education at the theoretical and literature review dimensions identified by Fetters and Molina-Azorin (2017). I also investigated where music educators learned their ideas about middle school general music and how these ideas influenced their teaching practice. I was drawn to mixed methods and the dialectic stance in particular because I sought a more complete understanding of the research phenomenon, one that I felt was absent in existing studies conducted within only a single paradigmatic perspective (Fetters and Molina-Azorin’s researcher dimension).
Integration at the research design and sampling dimensions (Fetters & Molina-Azorin, 2017) were also present in the design of my study. My mixed methods study was designed so that the two phases of data collection, the survey (N = 1,369) and the narratives of experience (N = 4), were of equal weight and the phases were completed sequentially (QUANT → QUAL) with a developmental purpose such that the analysis of the survey influenced the data collection and analysis of the narratives (see also Cronenberg, 2017, 2018). The researcher-designed survey measure (piloted previously) was distributed via e-mail through a national music education organization to those members identifying as middle school music teachers (N ≈ 15,000); however, national scope cannot be claimed because the organization controlled the e-mail list and thus prevented researcher follow-up with nonrespondents or list verification, resulting in a small response rate. Additionally, for the analysis discussed herein, only responses from respondents with experience teaching middle school general music (n = 832) were used. Of the survey respondents, 209 provided contact information and were screened through a multistep process involving coding of open-ended responses and select variables using a rubric aligned with the research questions. Later, screening interviews with the top 10 respondents led to the selection of the final 4 participants based on diversity of experiences and viewpoints. Survey analysis consisted of t-tests and cross-tabulations using scales while four narratives in short-story form (10-15 pages each) were crafted to elucidate the teaching experiences and beliefs of each narrative participant. The survey and narratives were designed to stand alone, independent of the mixed methods analysis that occurred after analysis and writing.
Following these two phases of the study, I then completed an additional phase of integrated mixed methods analysis using Greene’s dialectic perspective. This is what Fetters and Molina-Azorin (2017) identify as the data analysis dimension. In the understanding of equal weight or equal-status mixed methods designs, like the one described here, equality does not arise (although it does not preclude the possibility) from the number of respondents/participants in each phase, but rather from the manner in which data are valued by the researcher during integration, in this case, the final third phase of analysis. I agree with Johnson (2017) that equal-status mixed methods designs are ideally suited to the dialectic stance because one phase of the study does not take precedence over the other.
In the dialectic analysis I conducted, I placed realist insights (Danermark, Ekström, Jokobsen, & Karlsson, 1997; Maxwell & Mittapalli, 2010) from the survey phase in dialogue with the interpretivist insights (Denzin & Lincoln, 2005; Gadamer, 2004) from the narrative phase. I chose realism as the paradigmatic perspective guiding the survey phase because I sought to uncover and report on the “reality” of middle school general music teaching. While perhaps difficult to achieve, the survey was the first of its kind in this area of music education and was intended to report “what was out there” within the field. In contrast, I chose interpretivism as the guiding paradigmatic perspective for the narrative phase because this perspective is most in consort with narrative inquiry. Narrative inquiry seeks to understand experience, “is a collaboration between researcher and participants” (Clandinin & Connelly, 2000, p. 20), and is understood in the interpretive space or interpretive zone (Wasser & Bresler, 1996) between the researcher and participant and later between the researched text and the reader. In this way, I adopted the dialectic stance because I sought to mix at the paradigmatic level. A researcher might use the proposed dialectic framework to guide his or her analysis even if he or she conducted the quantitative and qualitative phases of the mixed methods study using other paradigmatic stances. Below, I discuss how realist and interpretivist insights were placed in dialogue, but other perspectives might also be used.
In mixing at the paradigmatic level, I used techniques of narrative analysis (Clandinin & Connelly, 2000) in combination with the analytic induction technique described by Erickson (1986) and later by Smith (1997). In this third phase of analysis, I returned to the descriptive statistics and data collected during the narrative phase and generated assertions. After several rounds of data review, I rejected any assertions not supported or contradicted by data from both phases of the study.
Analysis Techniques Used
The proposed framework is based on two analysis techniques. The first is a mixed methods approach described by Smith (1997). In her study, Smith and colleagues combined case study/focus group data and survey data in a mixed methods analysis she developed from Erikson’s (1986) analytic induction model. In this analysis, Smith returned to the original interview transcripts and field notes from her case study/focus group phases as well as the descriptive statistics from her survey phase in order to work with the least-processed level of data. Smith reread all pieces of data and tracked her thematic thinking using memos. After reading the data several times and attempting to view all forms of data as equally important, Smith developed assertions she believed that could be supported by the data. Finally, she organized the data into warrants that either confirmed or contradicted the assertions. When data from both the case studies/focus groups and the survey supported an assertion, this strengthened her mixed methods analysis. When the disconfirming evidence outweighed the confirming evidence, Smith rejected the assertion. It is important to note that Smith sought only convergence, not divergence, when she analyzed her data across the phases of her study, which violates one of the four characteristics of the dialectic stance as described above. Although Smith’s proposed technique involves mixed methods analysis and provides a partial template for the proposed method, Smith does not explicitly claim that she is mixing at the paradigmatic level, perhaps because Greene’s dialectic stance had not yet gained currency in the literature.
The second analysis technique used in the proposed framework is the cyclical reading, coding, rereading, and writing technique of analysis often used by narrative researchers and described by Clandinin and Connelly (2000). In narrative inquiry, analysis and text construction are intertwined in a cycle of writing and revision that requires researchers to continually return to the original data. According to Clandinin and Connelly (2000), “a narrative inquirer spends many hours reading and rereading field texts” along with other data sources (p. 131) in order to “search for patterns, narrative threads, tensions, and themes” (p. 133). This technique was modified for the proposed framework such that as the researcher moves through the framework he or she must continually return to the unprocessed data to reread, recode, and reprocess. There are two notable differences between narrative inquiry and what has been adapted for the approach to dialectic mixed methods analysis suggested here. First, Clandinin and Connelly do not suggest that narrative analysis is a series of steps, but rather an organic and lived process. The framework below is described in steps, though these are somewhat fluid and a researcher can move both forward and backward in the process as needed. The second difference is that writing and analysis are not intertwined as is common in narrative analysis. Although a researcher will document his or her analysis process, writing of complete sections or drafts is not required (nor prohibited) in the proposed dialectic analysis. Although the iterative process of returning to the data described here is drawn from Clandinin and Connelly’s (2000) narrative analysis, the focus is on the cyclical process of rereading, recoding, and reprocessing the data, not the coding technique used nor the crafting of a researched story (other aspects of narrative inquiry). Within this framework, a researcher might use qualitative coding techniques drawn from a variety of qualitative methods to code for themes or conduct other textual analysis. This decision is best left to individual researchers guided by their research questions and theoretical frameworks. Returning to the data in the ongoing manner described above enables the researcher using the dialectic stance to be continually reminded of the original forms of data collected and the paradigmatic perspectives used for data collection.
Applying the Four Characteristics of the Dialectic Stance
The proposed dialectic analysis framework is detailed in Figure 1. The two analysis techniques discussed above form the backbone of the proposed framework. Although both analysis techniques come from an interpretivist perspective, “whether data happen to be in the form of words or in the form of numbers should not materially affect the process of constructing meaning” across the two forms of data because “analysis of both quantitative and qualitative data involves construction and reduction at appropriate times” (Smith, 1997, p. 80).

The proposed framework.
Figure 1 provides a visual representation of how the four characteristics of Greene’s dialectic stance are used in this framework. First, the diagram has a solid background that is the foundation on which all the analysis occurs. The foundation of this analysis is the dialogue between different forms of data and requires that the researcher using the framework maintain an equal and ongoing dialogue among the paradigmatic perspectives used in the study. This foundational premise (denoted in the diagram by the gray background circle and the encircled text) combines Characteristics 1 and 2 of the dialectic stance into one overarching principle for the analytic framework. Second, the inner circle at the heart of the framework specifies that the integrity of the qualitative and quantitative data is maintained; words are not transformed into numbers nor are numbers converted into words at any point in the analysis. This circle represents the third characteristic of the dialectic stance as outlined above. These two components of Figure 1 represent the two guiding analytic principles that the researcher must constantly keep in mind as he or she moves through the analytic process. The researcher does not move into or out of these components of the diagram; rather, these two components are ever present throughout the analytic process.
The detailed middle arrow of Figure 1 represents Characteristic 4 of the dialectic stance. The researcher begins the analytic process by using the least processed form of all data collected and then begins a search for both consonant and dissonant findings across the data. After rereading the data, the researcher moves clockwise along the middle arrow of Figure 1 through four main analytic steps: first, generating assertions that he or she believes that are supported by the collected data; second, searching for data across the phases of the study to support/contradict the assertions; third, rejecting any assertions that are neither supported nor contradicted by both qualitative and quantitative data; and fourth, generating dialogic writing about each assertion supported by the findings. At each step along the analytic process, the researcher returns to the data to reread, recode, and reprocess the data before proceeding to the next step. Although this process is described here in four clockwise steps, a researcher may choose to move counterclockwise around the middle arrow as necessary during the process of analysis.
As the researcher moves through this analytic process, a reflective journal can be useful for noting any challenges or conflicted understandings that occur, particularly given that an individual researcher may often feel as though he or she is battling conflicting internal voices representing the two paradigms. Despite this battle, it is essential that the researcher maintain an ongoing dialogue between the two paradigmatic perspectives used, ensuring that each has an equal voice. Critical to the entire process is that the researcher must be careful to interpret each data form only within the paradigmatic perspective within which it was originally collected, thus, the inner circle of Figure 1. This is perhaps the most difficult part of the dialectic stance—the paradigmatic perspectives sitting on each shoulder must each be acknowledged, valued, and given equal weight in the analysis process—in essence, the paradigmatic perspectives must parley.
Application of the Proposed Dialectic Analysis Framework
To better understand the proposed framework, I will now break down the middle arrow of Figure 1 with an example of my own thought process while working on my dissertation. Figure 2 attempts to show my thought process as I reanalyzed the data, generated assertions, and searched for data that either confirmed or contradicted my assertions. For clarity, Figure 2 only shows the middle arrow from Figure 1 but remember that the researcher using this framework must maintain the quantitative and qualitative data in their original forms, give equal weight to each, and ensure that ongoing internal dialogue between the paradigms occurs. Although the steps below appear linear, the researcher can move backward through the process (counterclockwise along the arrow) when necessary as the process is iterative.

Application of the framework in analysis.
Step 1: Generate Assertions After Reviewing the Least Processed Form of All Data
When I combined all the data together for the first time, I began with the original data as collected, in my case, descriptive statistics, observation notes, and interview transcripts. Following Smith’s (1997) approach, I read through all pieces of data and thought about the statements or assertions I might be able to make about the data. In my notes, I generated nine assertions that I believed might be supported by the collected data.
For illustrative purposes, I will use only one assertion here to demonstrate the process. This assertion is “a music teacher’s knowledge of and confidence in young adolescent development comes from his/her teaching experience, not from undergraduate teacher education (preservice).” At this point in the process, it is not important whether or not this assertion is actually supportable by data as this occurs in subsequent steps. During this first step, it is only important for the researcher to write down any assertions he or she believes that might be supportable by the collected data. In the next two steps of the process, if no data to support or contradict the assertion exists within either the quantitative or qualitative data, the researcher is required to stop analysis and reject the assertion. It is important to note that because the dialectic stance encourages consonance and dissonance as stated in Characteristic 4 (above), dialectic researchers only stop the analytic process if no data exist within one phase of the study, not if the data from the phases contradict one another.
Step 2: Search the Data for Support/Contradiction of the Assertions
Next, the researcher moves clockwise along the arrow and returns to the data to reread, recode, and reprocess, always maintaining the data within their paradigmatic perspectives. It is at this stage of the process that the researcher needs to contemplate what new codes or statistical tests are needed in order to discover if there are data available to support or contradict the assertions put forward. In doing so, the researcher never transforms the data, but rather reanalyzes using techniques appropriate for the respective paradigm. For the assertion above, I needed to code the qualitative data for statements focused on knowledge regarding young adolescent development, statements related to confidence on this topic, as well as any identification by each participant regarding where he or she learned about young adolescent development. I also needed to run statistical tests on the quantitative data in order to compare the survey respondents’ reported influence of preservice to the reported influence of teaching experience specifically for the survey items focused on knowledge of young adolescent development. I identified items on the original survey instrument that would allow me to do so (see Table 2). Had I not been able to develop codes or identify appropriate items on the survey instrument, my dialectic analysis would cease for this particular assertion. In recoding and running additional statistical tests, I needed to maintain the paradigmatic perspectives of interpretivism and realism under which the narrative (QUAL) and survey (QUANT) data were originally collected. I could not, for example, count the number of times a narrative participant talked about his or her preservice and compare these textual codes with the number of times he or she referred to teaching experience. This violates two of the four characteristics established previously: First, it transforms qualitative data into quantitative; and second, the data transformation negates the meaning of the qualitative data within the interpretivist paradigm. Likewise, I could not pull out one individual survey respondent and discuss that data subset as it would violate fundamental principles of realism. While these examples are perhaps rudimentary, they are provided for illustrative purposes.
Influence of Teaching and Preservice Experiences on Confidence With Young Adolescent Development.
Composite additive variable created using data from nine previous variables.
Step 3: Reject Any Assertions Without Data Support/Contradiction From Both Phases
Moving along the arrow in Figure 2, I then returned to the data to reread, recode, and reprocess, in this step, specifically focusing on the pieces of data that were coded and the results of the statistical tests run (as described above). The researcher might compile all the appropriate codes and statistics in one place and examine them as a whole. From this new analysis, I discovered support for the assertion within both forms of data; however, there was a contradiction within the data that presented an interpretive puzzle for me to consider. Initial review of the composite variable comprising all nine dimensions of young adolescent development indicated that an overwhelming 81% of respondents’ confidence in young adolescent development was influenced to a great extent by their teaching experience while only 21% were influenced to a great extent by their preservice. After breaking down the composite variable into the original nine variables, the results were similar (see Table 2). In addition, all the cross-tabulations were statistically significant at the 99.99% confidence interval suggesting a potentially critical finding within a realist paradigmatic perspective that values statistical significance. Similarly, three of the narrative participants indicated that they gained most of their confidence working with young adolescents during teaching experience, not during preservice. For example, one participant, Michael said, “In undergrad . . . I think they kind of watered down what you can expect with teenagers.” He also said, “I try to follow-up with doing my own PD [professional development] and reading stuff online about what you can expect [of young adolescents] and why” (see also Table 3). However, one narrative participant disagreed. The fourth participant, Beth, completed an undergraduate degree in music therapy with a minor in psychology, rather than a bachelor’s degree in music education. She said, I did a heavy concentration in children and adolescents [and . . . ] it was helpful for me to have that book background. And then when you get out [in the classroom] and you start seeing things [ . . . ] you can identify the commonalities and figure out what’s going on and determine what’s appropriate for that person’s development stage.
Narrative Participants’ Sample Responses Regarding Preservice Preparation for Teaching Young Adolescents.
From an interpretivist paradigmatic perspective, Beth’s viewpoint, while potentially the minority voice in music education, is nonetheless valuable for its perspective. Within the interpretivist paradigm, a single voice is valuable and helps illuminate the nuances of a complex research phenomenon.
The researcher must interpret these new findings within the individual paradigms and connect the findings to the original assertion. There are two specific questions that the researcher should ask himself or herself at this point in the analytic process. First, the researcher ought to ask himself or herself: How should I interpret these findings within their respective paradigms? For the analysis described above, I wonder, is Beth an individual who only represents her own experiences, but does not speak for the field as a whole? This is certainly one interpretation of this finding and one appropriate to the interpretivist paradigm within which the narrative data were collected. Yet her voice is still valued within this paradigm. However, from the perspective of the realist paradigm, the 99.9% confidence interval suggests a significant finding regarding the insignificance of preservice on the preparation of music teachers for working with young adolescents. Analyzing all the existing data within their own paradigm suggests that preservice is far less influential than teaching experience on a teacher’s reported confidence in young adolescent development, but that there are some exceptions which are valuable for the individual perspective they provide. Here, the paradigmatic perspectives are dialoging with one another and set an empirical puzzle with which the researcher must contend.
Second, the researcher must also ask himself or herself: Is there additional data to support or contradict this assertion? Beth’s experience and the resulting contradictory evidence between data collected in the two phases of the study led me to wonder if there was a difference between those survey respondents who reported holding a bachelor’s degree in music education as compared with the 12% of survey respondents who reported not holding this degree. Given that these data were available in the survey (though the degrees held are unknown), independent group t-tests were run on the variables included in the analysis above (see Table 4). All tests were insignificant at the 99.5% confidence interval. Within the realist paradigmatic perspective, as I used it, these insignificant findings mean that no statistical difference exists between these two groups of respondents and thus no relationship can be claimed. A scholar working exclusively within a realist paradigmatic perspective might conclude that Beth’s experience is an anomaly or outlier within the data set, yet the data about Beth’s experience were collected within an interpretivist perspective and thus her individual perspective remains a valid piece of data to support the assertion. Having now exhausted the analytic possibilities, I moved along the arrow in Figure 2 to interpretation and dialogic writing.
Independent Group t-Tests for Bachelors’ Degree in Music Education and Other Variables Under Consideration. a
Note. SD = standard deviation; CI = confidence interval; df = degree of freedom.
Unequal variances, Satterthwaite’s approximation calculated.
Step 4: Generate Dialogic Writing
Interpreting both confirmatory and contradictory evidence for an assertion is one of the major challenges of the dialectic stance. The scholar must strive to write up a dialogic discussion of the findings specifically referencing the original assertion and presenting the consonant and dissonant evidence for the reader to consider. At this point the dialogue moves from within the researcher’s head to a dialogue between the researcher and the reader. The dialectic scholar must be sure to give equivalent weight to the findings from both portions of the study in the final written report.
Although sometimes the qualitative and quantitative data will corroborate one another, contradictory evidence is equally valid evidence within the dialectic stance (Greene, 2007, 2015). Assertions supported with both convergent and divergent data often raise tensions that are foundational for the particular discipline within which the study was conducted. These tensions can lead to further questions rather than conclusions. For dialectic researchers committed to remaining open to the possibility of confirmatory and contradictory findings, these questions should be exalted rather than ignored, but researchers should also be prepared for these questions to evoke debate within the “home” discipline in which the study was conducted.
For my example analysis, it seemed that the most important thing to put forward from this particular assertion was that preservice teacher education provides most middle school music teachers with very little confidence in working with young adolescents whereas the hands-on experience of holding an actual middle school teaching position provides much greater confidence. This suggests that perhaps hands-on experience working with middle school students during preservice might improve this situation. However, Beth’s experience also suggests that learning about child and adolescent development in depth, as was done in her music therapy undergraduate, might provide an additional foundation on which to base one’s teaching practice. Perhaps music education would benefit from drawing upon some of the content present in music therapy programs. The tension between preservice education and on-the-job experience as an educator is a long-standing challenge in teacher education, not just within the discipline of music. An undergraduate education designed to prepare a student for teacher licensure is limited to 4 years of curricular work and by the maturity of undergraduate students. In any preservice program, topics, skills, and competencies must be selected, often at the neglect of others. Most university programs in music education prepare students for a certification that enables them to teach music to students from Kindergarten through 12th grade (Henry, 2005) and as such the developmental characteristics of young adolescents (or middle school students) is only one tiny component of the total undergraduate education. As a scholar, I can make some preliminary suggestions, carefully couched in the limited findings related to this assertion, for improvements to music educators’ undergraduate preparation as I write up my dialogic discussion, but I must be continually aware of each perspective provided by the phases of the study as well as the limits each paradigmatic perspective affords my claims.
Ongoing Dialogue
As proposed, this framework aligns with Greene’s original notions of the dialectic stance, primarily that it is democratic, that theory and practice are inseparable, and that dialectic thinking is a cognitive process undertaken by the researcher. Additionally, four characteristics of the dialectic stance must be upheld by the researcher who (1) sustains dialogue between collected data forms, (2) gives equal voice to all paradigmatic perspectives used, (3) preserves data as originally collected (no data transformation), and (4) values dissonant and consonant results equally. In putting forward assertions, the researcher initiates a conversation or dialogue between the paradigmatic stances shaping the quantitative and qualitative data phases as he or she searches the data for consonant and dissonant evidence through the analytic process described herein. It is in this dialogue that the paradigm parley, an analytic framework that values each piece of data equally within its original form, emerges. In writing up the data, the researcher must give equal voice to all forms of data and present to the readers a dialogic discussion and any accompanying interpretive puzzles left unwound.
In using the dialectic stance in my dissertation, I endeavored to bring Greene’s dialectic stance to practical reality for a single researcher. This was no easy task and I continually questioned whether my third phase of analysis was emulating the dialectic stance Greene described. However, I believe that this stance provided me with insights into the teaching of middle school general music beyond what I learned from the individual phases of the study. My mixed methods analysis raised some important tensions for the fields of music education and middle level education that will hopefully be considered in future research. This dialectic analysis also provided my own work with interesting new directions that I believe that would not have come to light had I not sought integration at the philosophical level.
For researchers seeking to use the proposed dialectic framework in a mixed methods study, I provide several recommendations. First, the framework I describe is best conducted as a third phase of analysis after the researcher is deeply familiar with the available data. I believe that generating assertions would be difficult without an intimate knowledge of the quantitative and qualitative data collected, knowledge best obtained through analysis within the individual paradigms. However, this recommendation has an inverse: that intimate knowledge of the data also can prevent a researcher from seeing the whole or seeing beyond those key pieces of data that shaped the analysis in one of the independent phases. Looking back, I know I should have spent more time generating the assertions and challenging myself to see other connections between the qualitative and quantitative data. Second, maintaining two paradigmatic perspectives simultaneously often made me feel as though there were voices in my head (or cartoons on my shoulders) shouting at one another. I recommend that researchers move slowly through the framework and carefully note each thought so that each can be critiqued for its relevance to the particular paradigm. Speaking aloud into an audio recording or taking notes using different colored pens or sticky notes might be useful techniques to use. Finally, be patient. The analysis described here is difficult and time consuming. It is indeed a deeply cognitive task to conduct mixed methods research using the dialectic stance. The more time available to think carefully about each assertion, the richer the mixed methods analysis that will result.
Extensions or modifications of the Paradigm Parley framework are welcome. Perhaps scholars conducting mixed methods studies using quantitative or qualitative methods beyond survey and narrative or mixing paradigms beyond realist and interpretivist will find that the framework needs modification. Those without experience in narrative analysis may choose alternative methods for returning iteratively to reanalyze the data within the framework outlined here. One potential extension of this framework is to apply it to a study framed by Johnson’s (2017) dialectical pluralism metaparadigm, a philosophical conception and extension of Greene’s (2007) dialectic stance as yet untested in practice. Doctoral students interested in dialectic mixed methods research are particularly encouraged to use, modify, or extend this framework in their research designs.
A major limitation of this work is that the proposed framework has been applied to the analysis of only one study. The framework is in need of future testing within other mixed methods studies and by other scholars. The use of this framework by other scholars would generate a much-needed dialogue on the application of the dialectic stance. This framework was developed within an interdisciplinary research investigation and is thus well suited to the interdisciplinary questions often investigated in mixed methods. It would benefit from testing by those investigating both interdisciplinary and intradisciplinary questions. The dialectic stance is dialogic; this is a framework that will thrive on dialogue within the field of mixed methods research.
I believe that the Paradigm Parley framework adds value to the mixed methods community because it provides a practical analytic tool for researchers interested in using Greene’s dialectic stance, a tool that did not previously exist. However, the framework outlined here provides one method of using Greene’s dialectic stance in practice. There are potentially many other approaches mixed methods researchers might take in applying the dialectic stance in practice and others are encouraged to put forward additional frameworks. The dialogue between these various frameworks would hopefully spark a meta-dialogue regarding the application of Greene’s dialectic stance.
Footnotes
Acknowledgements
I would like to thank Jennifer C. Greene for her encouragement to expand my application of the dialectic stance into article form.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
