System 44: Murrieta Valley Unified School District
At a glance
  • Strong Evidence
  • Program: System 44®
  • Subjects: Intervention, Literacy
  • Report Type: Efficacy Study, Study Conducted by Third Party
  • Grade Level: Elementary, Middle
  • Region: West
  • District Urbanicity: Suburban
  • District Size: Large
  • District: Murrieta Valley Unified School District, CA
  • Participants: N=293
  • Outcome Measure: California Standards Test of English Language Arts (CST ELA), Phonics Inventory
  • Implementation: 60 minutes daily (Stand-Alone)
  • Evaluation Period: 2010–2011
  • Study Conducted by: RMC Research
Overview
System 44 gold standard study reveals significant improvement on word reading fluency and comprehension.

Murrieta Valley Unified School District (MVUSD) is located in Murrieta, California, on the southwestern edge of Riverside County. MVUSD serves approximately 22,000 students across 18 schools from Grades K through 12. The majority of MVUSD students are either White (48%) or Hispanic (33%). Other ethnicities represented include African American (5%), Asian (4%), and Filipino (4%). Four percent are English learners (EL) and 11% are students with disabilities. Approximately one-quarter of all students in the district are eligible for free or reduced-price meals.

During the 2010–2011 school year, students from 11 schools in MVUSD were selected to participate in a randomized controlled trial study based on a two-tiered screening process. Tier 1 consisted of students who performed below the 50th percentile on the California Standards Test of English Language Arts (CST ELA) and who scored below 600 Lexile® (L) measures on the Reading Inventory®. Tier 2 consisted of students who met Tier 1 criteria and also demonstrated foundational reading deficiencies (Beginning or Developing Decoder) on the Phonics Inventory®. Students who met Tier 2 criteria were placed into System 44 classrooms where they were expected to receive 60 minutes of System 44 instruction daily.

Results

Phonics Inventory and CST ELA data were collected and analyzed for students who used the program during the 2010–2011 school year. Phonics Inventory results demonstrated that System 44 students significantly outperformed control group students in reading fluency (Graph 1). Results from the CST ELA showed a significant increase in the percentage of students who achieved proficiency for both the System 44 and control group students; however, System 44 students improved from 11% Proficient in 2010 to 41% Proficient in 2011, whereas control group students improved from 12% Proficient to 32% Proficient (Graph 2). 

Additional analyses indicated that software dosage was significantly related to reading outcomes (Graph 3). Specifically, students who completed 100 or more topics out of a total of 160 System 44 topics made significantly higher gains than students who completed fewer than 100 topics on Woodcock-Johnson® III (WJ III®) Word Identification (p < .05), Phonics Inventory Sight Word Fluency (p < .001), Phonics Inventory Nonword Fluency (p < .001), and Phonics Inventory Total Fluency (p < .001).

2.1 Murrieta Graph 1

GRAPH 1. Murrieta Valley USD System 44 and Control Group Students, Grades 4–8 (N=293)

Performance on Phonics Inventory Total Fluency, 2010–2011

2.1 Murrieta Graph 2

GRAPH 2. Murrieta Valley USD System 44 and Control Group Students, Grades 4–8 (N=287)

Percentage of Students Scoring Proficient on CST ELA, 2010 and 2011

2.1 Murrieta Graph 3

GRAPH 3. Murrieta Valley USD System 44 Students, Grades 4–8 (N=172)

Phonics Inventory Total Fluency Growth as a Function of System 44 Software Usage, 2010–2011

Note. The sample sizes are as follows: Fewer Than 100 Topics Completed (n=43); Between 100 and 159 Topics Completed (n=37); and All 160 Topics Completed (n=92).