Abstract
Response to intervention (RTI) is a valuable framework for providing effective and equitable educational opportunities to all students; however, recent research indicates that RTI programs are not achieving their potential for promoting student learning. As schools develop, implement, and sustain RTI systems, they would benefit from the addition of collaborative support provided by professionals knowledgeable about the RTI framework, including specific elements of this model such as evidence-based practices and progress monitoring assessments. We describe the process and outcomes of a university–school partnership aimed at developing and implementing an RTI program for reading at the Tier 1 level.
Keywords
Response to intervention (RTI) is both an instructional and an evaluation framework designed to prevent challenges with academic content, support students who demonstrate academic challenges, and, if needed, determine the presence of a learning disability (Fletcher & Vaughn, 2009; Sugai & Horner, 2009). RTI utilizes evidence-based instructional practices beginning at the classroom level; the type and intensity of instructional practices are then adjusted as needed based on a student's response to specific interventions.
Typically, RTI is structured as a three-tier system (Fletcher & Vaughn, 2009). Tier 1 consists of classroom-level instruction provided to all students. It also incorporates universal screening early in the school year to identify students who might be at risk for academic challenges and benchmark assessments to periodically monitor performance. Tier 2 involves intensive small-group instruction provided to a small subset of students who are not making adequate progress (i.e., not responding) with Tier 1 instruction. Finally, Tier 3 involves intensive individualized support provided to an even smaller group of students who are not making progress with Tier 2 support. This may include another instructional practice or program and/or an increase in the amount of time the services are provided. Tiers 2 and 3 incorporate frequent progress monitoring to track individual student performance over time for the purpose of making instructional decisions that address student needs in a timely manner (i.e., data-based decision-making). Instructional decisions may include returning to a lower tier if the student's goal is met at a higher tier, continuing an intervention with which a student is making progress, changing instructional programs or practices, or increasing the amount of time an intervention is provided. The latter two options may be used separately or together when a student is not adequately responding to an intervention. If students persist in not responding to interventions, they are referred for special education at which point their progress-monitoring data become part of a comprehensive evaluation to determine the presence or absence of a specific learning disability (SLD).
RTI and Reading
RTI provides a valuable framework for the implementation of reading programs. The foundation of RTI is to provide evidence-based core instruction to all students. Not only does this emphasis facilitate reading development for the majority of students (Vellutino, 2003), it also provides an opportunity to consider what is likely to be effective reading instruction for a given school population. As Fuchs and Fuchs (2017) assert, “All RTI systems should reflect a balance between what is effective and what is doable, and the balancing of the two should occur at the local level” (p. 266).
Universal screening and progress-monitoring data at Tier 1 provide information on the effectiveness of core reading instruction programmatically in addition to supporting early identification of reading difficulties and data-based decisions regarding reading intervention (Fuchs & Fuchs, 2011). Early identification and provision of appropriate support through the advancing tiers in the RTI system is associated with significant improvements in reading achievement (Fletcher & Vaughn, 2009). For students who do not respond to intervention and are identified with an SLD in reading, prior instruction and interventions can guide the development of individualized educational programming (Gartland & Strosnider, 2020).
RTI in Practice
Despite the way RTI is commonly conceptualized and intended to function, recent research and commentary indicate that its effectiveness as an intervention framework and evaluation model for SLD may be falling short in practice (Berkeley et al., 2020; Fuchs & Fuchs, 2017; Gersten et al., 2017). State guidance and school-level implementation practices vary widely, often leading to the use of programs and systems that are not effective or sustainable (Berkeley et al., 2020; Savitz et al., 2018). The inclusion of students who are culturally and linguistically diverse within the RTI framework seems to add another layer of challenge that schools are unprepared to address (Cavendish et al., 2016; Gomez-Najarro, 2023; Orosco & Klingner, 2010; Robinson, 2016). Implications of this problem consistently point to the need to support teachers with the implementation of RTI, including responsiveness to their unique educational contexts (Cartledge et al., 2016; Cavendish et al., 2016; Gersten et al., 2017; Gomez-Najarro, 2023; Orosco & Klingner, 2010; Robinson, 2016).
State Guidance on RTI
Studies investigating state guidance on RTI and similar tiered models of support have found that most states provide some information, but there is considerable variation in the information shared (Berkeley et al., 2020; Savitz et al., 2018). Some states provide explicit models, others provide general guidance, and a few do not offer publicly accessible information. Other variations include whether RTI is related to or distinct from special education, the number of tiers, the level of alignment between core curricula and interventions, standardization or individualization of interventions, and who teaches interventions.
Expectations for using RTI data for the identification of SLD also vary in state guidance and in practice. For example, from a nationwide survey, Lockwood et al. (2022) found that 20% of school districts in the United States use RTI as the sole evaluation method, while 15% use a combination of RTI and ability-achievement discrepancy. Furthermore, their survey showed variability within states, with some districts reporting an evaluation method that differed from the one required by state policy. Berkeley et al. (2020) concluded that although states lack clarity and consistency in their communication about RTI, the revision and refinement in which states have engaged since the emergence of the framework indicate that states are committed to tiered systems of support but are unsure of what constitutes effective and feasible practice.
Effectiveness of RTI
Challenges surrounding effectiveness and feasibility also exist at the school level. Although several studies have demonstrated the effectiveness of RTI interventions under controlled conditions, a more recent large-scale study in typical school conditions yielded results that seem to indicate that RTI was not effective at improving student outcomes in reading (Gersten et al., 2017). However, leading scholars within the field contend that these findings should not be interpreted to mean that RTI is not an effective framework for supporting student learning, pointing instead to limitations in research methodology and issues with implementation to explain the less-than-favorable results (Berkeley et al., 2020; Fuchs & Fuchs, 2017; Gersten et al., 2017). For example, they note the narrow performance band from which the sample was drawn and acknowledge that some of the students who scored above the cut point on the universal screening nonetheless received Tier 2 intervention. Not only did this negate the comparison of reading improvement between students just below and just above the cut point as a measure of intervention efficacy, it demonstrates, they contend, that some schools are using their RTI systems in a way for which it was not intended by providing intervention to students who do not need it. Consequently, schools’ resources are spread more thinly, weakening the intensity of interventions that is a hallmark of the RTI model. Schools in the study used higher than recommended cut scores and Tier 2 intervention often supplanted Tier 1 instruction, both of which seem to indicate concerns with the effectiveness of classroom-level core instruction. Furthermore, many of the schools utilized intervention curricula that were built on evidence-based practices, but the programs had not undergone rigorous research themselves. Overall, Fuchs and Fuchs (2017) note that this large-scale study, in combination with other research on RTI, indicates that teachers are struggling to implement this framework given its complexity and the many other responsibilities placed on educators. Along this line, Gersten et al. (2017) assert that teachers need—but rarely receive—support to effectively implement RTI systems.
RTI and Students Who are Culturally and Linguistically Diverse
Recent research investigating the use of RTI with students who are culturally and linguistically diverse similarly indicates that RTI systems are not effective for these students in practice even though the framework has the potential to address their learning needs and reduce their disproportionate representation in special education (Robinson, 2016). In fact, data analyzed by Enrique et al. (2013) indicated that within the first 3 years of one state's implementation of RTI, the number of African American students referred for and identified with specific learning disabilities increased steadily, while referral and identification rates remained consistent for students with other disabilities. This implies that the increasing prevalence of African American students with SLD is associated with the state's RTI framework as other potential explanations for this trend would have impacted other disability areas as well.
One reason that RTI is not achieving its potential in promoting learning for culturally and linguistically diverse students is that teachers have limited awareness of the prospective association between RTI and education of culturally and linguistically diverse students, knowledge of valid assessments for these students, and familiarity with curricula or instructional strategies that have evidence of effectiveness for this population (Cavendish et al., 2016; Gomez-Najarro, 2023; Orosco & Klingner, 2010; Robinson, 2016). Some schools utilize counterproductive practices, including making programmatic recommendations for culturally and linguistically diverse students that remove them from their home schools (Cavendish et al., 2016), using standardized procedures and curricula that do not account for cultural and linguistic diversity (Gomez-Najarro, 2023), and providing interventions for diverse students outside of their RTI system (Cartledge et al., 2016).
Schools’ perspectives on diverse students also seem to impact the effectiveness of RTI. For example, the school in Orosco and Klingner's (2010) research demonstrated a negative school culture regarding the inclusion of linguistically diverse students. Teachers in Robinson's (2016) study knew little about the cultures of their students but did want to know more; whereas Gomez-Najarro (2023) found that teachers were not open to conversations about cultural identity and how it might impact students’ learning. Further, some schools associated the learning challenges of diverse students with perceived deficits in their parents (Cavendish et al., 2016; Robinson, 2016).
Given these challenges, scholars consistently acknowledge the need for additional support for teachers working with culturally and linguistically diverse students from school- and district-level administrators as well as educator preparation programs (Cartledge et al., 2016; Cavendish et al., 2016; Gomez-Najarro, 2023; Orosco & Klingner, 2010; Robinson, 2016).
Purpose of This Article
The purpose of this article is to describe one university–school partnership focused on initiating an RTI reading program at the Tier 1 level. The collaboration addressed some of the common concerns with RTI systems and led to positive effects for the participating school. Our collaborative process may be valuable to other university faculty engaging with school partners and teachers and administrators who are interested in RTI program development but who find themselves without available support.
We will begin by describing the context of the partnership, followed by detailing the components of our collaboration and the outcomes of our work.
Context for University–School Partnership
The State of New Mexico is reframing and reinvigorating schools’ focus on RTI and similar models under a new initiative known within the state as “Multi-Layered Systems of Support,” with the goal of providing more effective and equitable education for all students (New Mexico Public Education Department, 2021). However, the initiative launched with little guidance to schools on implementation, creating an opportunity for schools to engage in collaborative partnerships to support their work in creating, strengthening, or reconceptualizing their tiered programs in line with the recommendations of recent scholarship on RTI.
Our partnering school was located in a rural area of New Mexico, within a community that is low-income and culturally and linguistically diverse. The school district served 224 students who identified as Hispanic (75%), White (22%), and Native American (3%; National Center for Education Statistics, 2021). Only 25% of students were proficient readers compared to 29% proficiency statewide. The elementary school with which we partnered had enrolled 106 students from kindergarten through sixth grade, which included 63 females (59.43%), six students (5.66%) receiving special education services, and nine students (8.49%) identifying as emergent bilingual. The faculty included seven general education teachers (one each for grades K-6), two special educators/interventionists, and the school principal, all of whom engaged in the partnership.
The university faculty engaged in this partnership are experienced special educators with expertise in evidence-based practices for struggling learners, including those with learning disabilities, and RTI systems. The first author has additional expertise in mathematics instruction and intervention plus teacher education. The second author's additional areas of expertise include reading instruction and intervention, assessment systems, and serving diverse populations. Their university is located in an urban area of New Mexico. It is designated as a Hispanic-Serving Institution by the U.S. Department of Education and has recognition for very high research activity (R1) and community engagement from the Carnegie Classification of Institutions of Higher Education.
The university–school partnership originated at the request of the school principal, who was enrolled in one of the university's graduate certificate programs when New Mexico launched the Multi-Layered Systems of Support initiative. In addition to seeking support for compliance with the state's new initiative (the school had not used a tiered system up to that point), the principal expressed a need for teachers to understand and adopt evidence-based practices, noting that instructional decisions were currently made by individual teachers, which resulted in variability within and across classes as the teachers inconsistently used available curricula and external resources. As an RTI program would promote the consistent use of evidence-based practices and decision-making across grade levels, the principal also acknowledged the potential of this framework to reduce the number of students identified as at risk for SLD in reading—which, at the time, was approximately 50% of the school's population—and provide more effective interventions for students who were identified with learning disabilities.
After consultation with the school's teachers, we formalized the following goals for our partnership: (a) establish an RTI program, (b) identify and implement evidence-based practices, (c) decrease the number of students classified as at risk, and (d) improve educational programming for students with SLD. In the first year of our collaboration, we focused on developing and implementing a Tier 1 reading program. The subsequent year would address Tiers 2 and 3 for reading and Tier 1 for mathematics, with Tiers 2 and 3 for mathematics the following year.
Throughout our collaboration, the school faculty was primarily responsible for identifying specific needs aligned with our overarching collaboration goals; contextualizing student learning according to culture, language, and individual factors; determining if recommendations made by the university partners would be implemented; putting agreed upon practices into effect; and collecting implementation and outcome data. The primary responsibilities of the university faculty, in turn, were to provide foundational information on RTI programs and components, make informed recommendations to meet identified needs, offer feedback and support for practice implementation, and analyze and interpret student- and teacher-level data. We used a professional learning community (PLC) framework to integrate these responsibilities and promote shared understanding and decision-making.
Components of the University–School Partnership
Our collaborative model included five components: PLCs, instruction planning, pacing guides, fidelity checks, and assessment training. In the following, we provide foundational information on the practice and an explanation of how each component was utilized in our partnership. We conclude by sharing resources related to each of the components for teachers and administrators seeking to undertake similar work.
Professional Learning Communities
PLCs are groups “in which the teachers in a school and its administrators continuously seek and share learning, and act on their learning. The goal of their actions is to enhance their effectiveness as professionals for the students’ benefit” (Hord, 1997, p. 6). Stoll et al. (2006) highlight three essential aspects of PLCs based on this definition: (a) learning is focused on improving instructional practices, not maintaining the status quo; (b) practices need to be implemented with students; and (c) the primary function of PLCs is to enhance student learning. Although outside experts may be involved in PLCs to build teachers’ capacity for new practices, teachers retain the primary responsibility for establishing the group's goals and determining the utility of new practices for their teaching context (Stoll et al., 2006).
Research documents that PLCs contribute to the successful implementation of new instructional practices such that the implementation is sustainable and results in greater student learning (Andrews & Lewis, 2007; Cordingly et al., 2003; Little, 2002; Louis & Marks, 1998; Owen, 2016). For example, Cordingly and colleagues relate PLCs and student learning by reporting that PLCs increase teacher confidence, strengthen the belief that teachers can impact student learning, generate enthusiasm for collaboration, elicit a commitment to education change, and foster teachers’ willingness to try new practices.
Mundshcenk and Fuchs (2016) suggest that PLCs are well-suited for RTI program development for several reasons. PLCs and RTI are both whole-school activities aimed at improving student learning. Teachers can develop the knowledge and skills necessary for effective RTI implementation such as evidence-based intervention and assessment practices. PLCs afford teachers the opportunity to consider the unique needs of their school and determine which practices and programs are suitable in that context. Teachers are empowered by shared decision-making as they develop their RTI program. This process also serves as a valuable precursor to collaborative data-based decision-making, which is a key component of RTI in many schools.
During our university–school partnership, we engaged with the teachers and principal in a PLC for approximately one hour every other week using video conferencing for the duration of a school year. In our initial PLC meetings, the principal and teachers described existing school practices, student achievement, and other concerns that influenced their decision to pursue an RTI program. PLC meetings also provided a forum to engage the teachers in conversation about an array of evidence-based practices to determine which practices were most likely to be feasible and beneficial in their educational context and how we could support them in learning about and implementing those practices. All of the subsequent components of our RTI development process—instruction planning, pacing guides, fidelity checks, and assessment training—reflect the supports requested by the teachers and were addressed in the PLC.
Instruction Planning
One of the key expectations of the RTI model is the use of evidence-based instruction and interventions (Fletcher & Vaughn, 2009; Sugai & Horner, 2009). Evidence-based practices are those that high-quality research has consistently demonstrated lead to desirable outcomes for students (Cook & Odom, 2013). Although evidence-based practices are not guaranteed to be effective for all students, they are highly likely to be effective for most students. Consequently, the use of evidence-based practices helps to prevent academic challenges and to ensure that academic challenges that do occur are not the result of poor instruction (an important consideration if students are evaluated for a learning disability).
One caveat regarding evidence-based practices is that individual practices might not have an evidence base for all students, particularly students with existing disabilities or those who are culturally or linguistically diverse. This does not necessarily mean that the practice will be ineffective with these students, but it does mean that, particularly at the Tier 1/classroom/primary prevention level, we should carefully consider the evidence base and likelihood of effectiveness of instruction for all students.
When we began working with our partner school, the teachers had previous training in Fundations (Wilson Language Training Corporation, 2014) and had received some, but not all, of the materials associated with that program. They were also receiving training in Language Essentials for Teachers of Reading and Spelling (LETRS; Moats & Sedita, 2004) from the state. Teachers expressed concerns during PLC meetings that most of their students’ reading abilities had not improved sufficiently with current instruction.
In consultation with the teachers, we devised three strategies to address these concerns. First, the amount of instructional time for reading was increased from 4 to 6 h per week for all students. Because the school principal was engaged in the PLC, she was able to provide the administrative and logistical support necessary to implement this change. Second, in response to the teachers’ request for additional resources to supplement their existing programs specifically geared toward struggling readers, we guided them to the Florida Center for Reading Research (n.d.) for research-based activities organized by grade level and the component of reading addressed (e.g., phonological awareness, fluency). Finally, given the variety of student needs in each class, we provided professional development and individualized support in differentiating instruction (Levy, 2008).
Pacing Guides
While instruction is intended to be delivered using evidence-based practices, the content of instruction is largely driven by curriculum standards. All states are required to implement rigorous learning standards in core-content areas to ensure that students are college and career-ready when they finish high school (Cramer et al., 2021). Many states have adopted the Common Core State Standards (Porter et al., 2015), while others have opted to develop their own standards (Cramer et al., 2021). Although the goals of setting high expectations for educational attainment, promoting consistency in learning objectives, and pacing across districts and states seem beneficial for most students, Cramer et al. note that standards implementation is difficult and potentially detrimental for diverse learners, including students who are culturally and linguistically diverse and those with disabilities, who have unique educational needs. Not only are these students often not academically prepared for the grade-level standards, the pace that must be kept to address all of the standards conflicts with the learning needs of nontraditional students. Additional challenges with implementing curriculum standards include limited staff training to support understanding and implementation of the standards (Cramer et al., 2021) and weak alignment between standards and textbooks or other curricula (Polikoff, 2015).
Nevertheless, Polikoff (2015) acknowledges that curriculum standards do not all warrant the same level of attention; it is reasonable to prioritize some standards while minimizing others. Similarly, Cramer et al. (2021) emphasize the importance of flexible implementation and pacing of standards in response to student needs. In response to these challenges, Porter et al. (2015) suggest the use of PLCs for teachers to collaborate on understanding and implementing standards. Further, Cramer et al. (2021) suggest that university faculty should partner with schools to help teachers manage the complexity of utilizing curriculum standards while remaining responsive to students’ unique learning needs.
We recognized this support opportunity in our university–school partnership. The teachers noted that they did not know how to prioritize the distinct reading skills addressed in their reading programs and resources, including how much time to allocate for each skill. As a PLC, we approached this task first by considering the elementary Common Core State Standards for English Language Arts, which were adopted by our state. For each grade level, the university partners ensured that the teachers understood the standards and how they aligned with their curricula and resources, as recommended by Porter et al. (2015). We then collaboratively determined which standards address essential skills for reading development and which standards are necessary prerequisites for others. Next, we divided the standards across the four quarters of the school year, ensuring that all essential skills were represented and that prerequisite standards were addressed before, but in close proximity to, their related, subsequent standards. Finally, because standards do not require the same amount of attention (Polikoff, 2015), the university partners recommended time allocations for each standard for each week in the quarter based on our collective professional knowledge and experience.
Fidelity Checks
Selecting sound instructional practices and content foci is not enough to improve student achievement (Cook & Odom, 2013). Practices need to be implemented and content needs to be prioritized with fidelity; that is, they need to be used as intended. Sanetti et al. (2021) describe three dimensions of implementation fidelity: (a) content, the extent to which essential practice or program components are implemented as planned; (b) quantity, which refers to the frequency and duration of implementation; and (c) process or quality, meaning how well a given practice or program is implemented. With regard to the quality dimension, Harn et al. (2013) suggest that it includes not only teacher behaviors but also student factors such as engagement, performance accuracy, and behavior.
Although implementation fidelity is important, classroom realities (e.g., student needs, teacher capacity, time limitations) often impact teachers’ abilities to use practices and programs strictly as prescribed and to sustain implementation over time (Cook & Odom, 2013; Harn et al., 2013). Indeed, some deviation from prescribed implementation is appropriate and even valuable (Harn et al., 2013; Sanetti et al., 2021). These intentional, responsive changes are known as adaptations. As Harn et al. note, “Perhaps paradoxically, one of the best ways to match contextual and intervention characteristics to optimize implementation with fidelity over time may be to adapt the [evidence-based practices] to better match the context” (p. 184).
Practices and programs do not require complete fidelity to be beneficial, but essential components (those upon which effectiveness depends) of any program must be identified, maintained, and documented through the adaptation process (Harn et al., 2013; Sanetti et al., 2021). Other changes may be made to practices or programs unintentionally, resulting in detrimental differences in implementation. This process is known as “drift” and should be avoided (Sanetti et al., 2021).
Fidelity must be assessed when new practices or programs are implemented and continue regularly as they are sustained (Harn et al., 2013). Common assessment techniques include observation, self-report, and permanent product review. Regardless of the technique used, evaluations should consider all three dimensions of fidelity: content, quantity, and process/quality (Sanetti et al., 2021).
One of the key reasons to assess implementation fidelity is related to student achievement. Fidelity has a strong association with student outcomes (Harn et al., 2013) and, consequently, implementation fidelity should be considered when determining students’ responsiveness to intervention (Sanetti et al., 2021). For example, the lack of response may be due to implementation, not practices and programs themselves. Additionally, assessing implementation fidelity can reveal support needed by teachers (Harn et al., 2013; Sanetti et al., 2021), who may benefit from consultation or coaching related to practice or program implementation (Cook & Odom, 2013).
The teachers with whom we collaborated recognized the importance of fidelity as it related to the pacing guides that we developed. They acknowledged challenges with drift, in part because this is a new model for integrating reading programs and prioritizing curriculum standards. Because of the supportive climate of the school and single-class grade levels, teachers had considerable agency over the day-to-day functioning of their classrooms. This occasionally led to impromptu deviations from their lesson plans, more often resulting in decreases in the frequency and duration of reading program implementation than impacting content or process/quality.
In response, we developed an electronic fidelity checklist for teachers to complete weekly. Each week's checklist was prepopulated with the Common Core State Standards planned for that week and timing recommendations from the pacing guide. Teachers provided fidelity information in designated fields, noting the specific reading skill(s) addressed in alignment with the standard (i.e., oral language, background knowledge, literacy knowledge, phonemic awareness, phonics and spelling, sight word recognition, fluency, syntax, vocabulary, comprehension), the amount of time spent addressing the skill(s), and the program or resource used (i.e., Fundations, LETRS, Florida Center for Reading Research). Additionally, teachers documented their goals for mastery, method of assessing student performance, and number of students meeting the goal. Finally, teachers reflected on their implementation of reading instruction that week and considered the next steps.
We attempted to simplify this process as much as possible while still ensuring that useful information was being documented by prepopulating information, providing choices, and keeping checklists in a shared folder so that they did not have to be “submitted.” The fidelity checklists were reviewed periodically during PLC meetings to determine which aspects of instruction and pacing were working well, which needed support, and which had to be adapted.
Assessment Training
An essential component of any RTI program is monitoring student progress (Fletcher & Vaughn, 2009). At Tier 1, progress monitoring is typically conducted three times per year. The first assessment, known as universal screening, takes place early in the school year to identify students who might be at risk of learning challenges and in need of intervention. The second and third assessments, which may be called “benchmark assessments,” determine the progress made by students as a result of Tier 1 instruction and identify students who are not making adequate progress (Fuchs & Fuchs, 2006). If students progress to Tiers 2 or 3, progress monitoring occurs more frequently, usually weekly or biweekly (Fuchs & Fuchs, 2011). Progress-monitoring data will indicate if a student should maintain their current instructional program, change instruction and/or intensity, or return to Tier 1 (Fuchs & Fuchs, 2006). If students are referred for a special education evaluation for SLD, progress-monitoring data become part of their comprehensive evaluation, with multidisciplinary teams considering achievement and rate of improvement (Hunter et al., 2023).
Typically, student progress is monitored through the use of curriculum-based measures (CBMs), which are quick, skill-specific assessments in the areas of reading, writing, and mathematics (Fletcher & Vaughn, 2009). CBMs are valid and reliable, and they are developed with multiple versions of each measure for frequent assessment. Results from individual measures are graphed to track student performance and growth rates compared to a goal line. Progress monitoring has been shown to improve teacher decision-making and increase student achievement (Fuchs & Fuchs, 2011).
Our partner school was conducting benchmark assessments before our collaboration began using the online evaluation system required by their district. As we discussed this system, the teachers noted that their young students, students with disabilities, and English learners struggled to navigate the digital assessment platform, which, in turn, impacted their performance. Additionally, the system only assessed grade-level skills, but many of their students were reading below grade level and, as a result, teachers were not able to monitor the progress students were making from instruction in more foundational skills.
Given the challenges with their existing system, teachers requested recommendations for and training on a supplemental assessment that was more likely to meet the needs of their students and provide useful information to guide instruction. We selected easyCBM from the University of Oregon (Anderson et al., 2014), knowing that it addressed their concerns for benchmark testing and would continue to be useful as they extended their RTI program to Tiers 2 and 3 and SLD evaluation (Lockwood et al., 2022).
The teachers learned to administer each of the reading subtests (phonemic awareness, phonics, fluency, vocabulary and comprehension) and to determine which subtest was appropriate for each of their students. They conducted the easyCBM tests with each student 3 times during the course of the school year. Each PLC meeting after a testing session was allocated for reviewing all of the results and discussing implications as a group. We deliberately considered achievement and rate of improvement data at this stage in preparation for using comparable data in the SLD evaluation process (Hunter et al., 2023).
Resources
A brief description of each of the development and implementation components from our collaborative model is provided in Table 1 for at-a-glance reference. Additionally, we have recommended resources aligned with each of the components for teachers and administrators who may want to undertake a similar process without the support of university partners.
Components of tier 1 development and intervention.
Partnership Outcomes
The Tier 1 reading model resulting from our partnership involved instruction and assessment. Reading instruction occurred at each grade level for 6 h per week. Each week, pacing guides indicated which Common Core State Standards should be addressed at each grade level and for approximately how much time. Teachers determined which of the curricula and resources (i.e., Fundations, LETRS, Florida Center for Reading Research) to use for each lesson based on the collective needs of their students, including current reading performance, cultural and linguistic relevance, and engagement. While resources from the Florida Center for Reading Research could be used for whole-class activities, teachers also used them to differentiate instruction as needed.
In addition to instruction, the teachers conducted progress monitoring as part of their Tier 1 program. In the fall, winter, and spring, they administered the district-mandated assessment, and within 2–3 weeks of that evaluation, they conducted easyCBM assessments using the subtests deemed appropriate for each student. Assessment results were reviewed during PLC meetings to determine trends in learning for individual students as well as grade levels to support decision-making about future whole-class and differentiated instruction.
While our collaborative model for developing and implementing Tier 1 of an RTI reading program is based on current research about RTI, we conducted our own evaluation research to determine the effectiveness of this model in practice. As part of our program evaluation, we analyzed student achievement data, maintained running notes during PLC meetings, collected teacher records, and conducted a social validity focus group with the teachers. These data indicated student growth in reading, feasible implementation, and value in the collaborative process.
Progress-monitoring data documented that the instruction provided through our Tier 1 reading model improved students’ reading achievement on the whole (Shenoy et al., in press). Comparing means between the beginning of the year and the end of the year, we found a large effect for growth in reading scores across the following grade levels: Kindergarten (d = 3.22, p < .001), Grade 1 (d = 2.44, p < .001), Grade 3 (d = 0.78, p < .05) and Grade 4 (d = 2.25, p < .001). We found a moderate effect for growth in reading scores in Grade 6 (d = 0.52, p < .05) and a small and insignificant growth in reading scores for Grades 2 and 5. Although Grade 2 had insignificant growth, their mean scores at the beginning and end of the year were considerably higher than all of the other grade levels, at the 59th and 70th percentiles, respectively. Additionally, the proportion of students classified as clinically significant or at risk for reading difficulties (i.e., those scoring at or below the 25th percentile) decreased from 43% to 30%.
The use of both the district-mandated assessment and easyCBM indicated that the latter was more sensitive to the progress of students reading below grade level. This was a valuable step toward the best practice of progress monitoring in RTI (Stecker et al., 2008) that provided efficacy data on the instructional programs and practices used in our Tier 1 reading program. However, when students took comparable subtests across the two assessments, their performance was not significantly better on the paper-and-pencil test (easyCBM) compared to the digital test (district assessment) as the teachers had anticipated (see supplemental materials). While this trend indicates that our initial choice of supplemental progress-monitoring assessment did not optimally capture students’ performance in reading, it supports the value of a collaborative approach to RTI program development. Comparing reading scores across the two assessments during PLC meetings allowed the team to consider what characteristics of the students and assessments might have influenced performance other than test format (paper-and-pencil or digital) to strategically consider alternatives for the following school year.
Social validity focus-group data collected at the end of the first year of our collaboration coalesced around three themes: teacher investment, meeting diverse needs, and opportunities to reflect on practice. The school partners spoke of teacher investment as an indication of the value of using the PLC model to structure our partnership. Teachers reported that because we prioritized their goals and responded to their unique educational context, as recommended by Fuchs and Fuchs (2017) and Stoll et al. (2006), they were invested in the collaborative process and the transfer of practices from the PLC to the classroom. Implementation-fidelity data supported this assertion. The high level of investment teachers derived from the PLC, they noted, contrasted with much lower levels of engagement when initiatives were introduced in a top-down directive in the past. For the theme of meeting diverse needs, teachers reported that having instructional options was conducive to meeting the varying needs of their students, and their improving skills with differentiated instruction supported the use of multiple instructional practices within a class. Finally, teachers discussed the value of opportunities to reflect on practice. In addition to mentioning conversations about assessment practices described previously, they expressed that the accountability of the checklist reduced the occurrence of drift, while discussion about implementation in the PLC meetings reinforced their use of adaptations. One of the most common adaptations across classrooms was the use of students’ first languages and cultural experiences to facilitate reading instruction. Although we did not directly collect data on this practice, we were able to support its use by referencing existing literature (e.g., Guo, 2018; Krashen, 2002) and students’ increases in reading achievement documented through progress monitoring.
Looking Ahead
Our university–school partnership for RTI development and implementation has been productive to this point, but more work remains to create a complete and comprehensive system at this school for reading and mathematics. Additionally, we need to establish a seamless connection from RTI interventions and assessments to SLD evaluation and services. While our collaboration is having a positive effect on one school, research on RTI indicates a widespread need for support to schools and districts (Cartledge et al., 2016; Cavendish et al., 2016; Gersten et al., 2017; Gomez-Najarro, 2023; Orosco & Klingner, 2010; Robinson, 2016). Although the specific needs of schools will undoubtedly vary, the model we have used—PLCs, instruction planning, pacing guides, fidelity checks, and assessment training—seems to be a valuable structure that allows professionals knowledgeable about RTI to engage in several partnerships simultaneously. Then, as an increasing number of schools receive support and begin implementing high-quality RTI programs with fidelity, the effectiveness of the RTI framework broadly can be reevaluated in practice.
Conclusion
RTI is a valuable system for meeting the academic needs of all students; however, schools benefit from support to develop and implement an RTI program that is feasible and beneficial for their unique students and environments. This article described one university–school partnership that utilized a PLC framework to collaboratively initiate a Tier 1 program for reading with positive outcomes for teachers and students.
Supplemental Material
sj-docx-1-ldr-10.1177_09388982241240447 - Supplemental material for Developing and Implementing a Tier 1 Reading Program Within an RTI Framework: A University–School Partnership
Supplemental material, sj-docx-1-ldr-10.1177_09388982241240447 for Developing and Implementing a Tier 1 Reading Program Within an RTI Framework: A University–School Partnership by Allison Nannemann, PhD, Sunaina Shenoy, PhD, and Christopher Johnson, MA in Learning Disabilities Research & Practice
Footnotes
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
