Award Abstract # 1109595
Factors that Affect Implementation, Spread and Sustainability: An Implementation Study of Everyday Mathematics

NSF Org: DRL
Division of Research on Learning in Formal and Informal Settings (DRL)
Recipient: UNIVERSITY OF CHICAGO
Initial Amendment Date: September 9, 2011
Latest Amendment Date: October 6, 2014
Award Number: 1109595
Award Instrument: Continuing Grant
Program Manager: Finbarr Sloane
DRL
 Division of Research on Learning in Formal and Informal Settings (DRL)
EDU
 Directorate for STEM Education
Start Date: September 1, 2011
End Date: August 31, 2015 (Estimated)
Total Intended Award Amount: $886,117.00
Total Awarded Amount to Date: $886,117.00
Funds Obligated to Date: FY 2011 = $339,762.00
FY 2012 = $211,045.00

FY 2013 = $335,310.00
History of Investigator:
  • Amy Cassata (Principal Investigator)
    acassata@uchicago.edu
  • Jeanne Century (Co-Principal Investigator)
  • Jeanne Century (Former Principal Investigator)
  • Amy Cassata (Former Co-Principal Investigator)
Recipient Sponsored Research Office: University of Chicago
5801 S ELLIS AVE
CHICAGO
IL  US  60637-5418
(773)702-8669
Sponsor Congressional District: 01
Primary Place of Performance: University of Chicago
5801 S ELLIS AVE
CHICAGO
IL  US  60637-5418
Primary Place of Performance
Congressional District:
01
Unique Entity Identifier (UEI): ZUE9HKT2CLC9
Parent UEI: ZUE9HKT2CLC9
NSF Program(s): REAL
Primary Program Source: 04001112DB NSF Education & Human Resource
04001213DB NSF Education & Human Resource

04001314DB NSF Education & Human Resource
Program Reference Code(s): 9177, SMET
Program Element Code(s): 762500
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.076

ABSTRACT

This proposed project is to investigate how and why STEM innovations are implemented and sustained in schools. The PIs seek to identify factors at the district, school, and classroom levels that contribute to or inhibit implementation and sustainability of Everyday Mathematics (EM). It is designed to answer several important research questions, such as, (1) What factors contribute to and/or inhibit the implementation of EM in the study sites? (2) Do the factors that affect implementation and sustainability change with maturity of implementation and if so, how? (3) What are the relationships between the status of EM implementation, maturity of implementation, factors that affect implementation, and student demographics and achievement?

This project will use sophisticated quantitative methodologies and a Fidelity of Implementation instrument to answer the research questions. While it focuses on EM, it is likely to generate much-needed insights about the specific mechanisms and processes that underlie the adoption and use of any standards-based instructional materials.

Educational innovations are a constant fixture in school districts across the country. One of the most important goals for any educational innovation is to improve student learning. However, too often these innovations fail to improve student learning because they are not implemented with fidelity or are not sustainable. This project will contribute to emerging foundational understandings about how to enact and support lasting innovations.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Century, Jeanne; Cassata, Amy; Rudnick, Mollie; Freeman, Cassie "Measuring Enactment of Innovations and the Factors that Affect Implementation and Sustainability: Moving Toward Common Language and Shared Conceptual Understanding" JOURNAL OF BEHAVIORAL HEALTH SERVICES & RESEARCH , v.39 , 2012 , p.343-361

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Overview: The purpose of this study was to develop theory for understanding the different ways in which innovations are implemented (used), adapted, and sustained in schools. We define innovations as programs, interventions, technologies, approaches, practices, or policies that are perceived as new by the users (teachers) enacting them. This study focused on a particular type of STEM education innovation, Everyday Mathematics (EM), a widely-used elementary mathematics curriculum considered to be both standards-based and evidence-based. Driven by the knowledge that many innovations in education fail to endure the test of time (even if effective) the research team sought to create knowledge and tools to support meaningful, lasting educational change.

This mixed-method study took place within five school districts implementing the EM program. Districts varied in geographic region (Midwest, Northeast, West), locale (urban, suburban) and maturity of EM implementation (which at the study outset, ranged from 3 to 13 years of continuous use as the designated district curriculum).  The study had several goals: 1) to understand how teachers in each district were using and adapting the EM instructional materials; 2) to identify teacher, school and district influences that explained differences in EM use; 3) to understand factors that influenced EM use over time; and 4) to explore relationships between EM use, influential factors, and student mathematics achievement. In addition, the research team sought to develop mutually beneficial collaborative relationships with district leaders in the study sites.

Intellectual Merit: The research team from Outlier Research & Evaluation at the University of Chicago created a conceptual framework, or organizer, for categorizing the different components of EM (a tool that can be used to classify components not just for EM, but also for many other instructional materials programs as well). It was grounded on the basic understanding that all instructional materials are composed of structural features (aspects of organization and design) and interactional features (expectations for how students and teachers should behave and interact). With this framework as a foundation, the team created several instruments for measuring EM use, including a teacher questionnaire, a teacher log, and a classroom observation protocol. 

The team created a second set of instruments for measuring influences on instructional materials use, grounded in a comprehensive literature review that spanned education as well as several other fields (including health, prevention science, and psychology). This second set of instruments, including a teacher questionnaire, teacher interview protocol, and teacher focus group protocol, was based on a second conceptual framework that categorized influences into three main types: individual influences (like motivation, self-efficacy, and attitudes about the innovation); school influences (like leadership, collaboration, resource sufficiency); and environmental influences (like larger policies, political climate, and community attitudes).

Between 2012 and 2015, over 1000 teachers from three school year cohorts (2011-12, 2012-13, and 2014-15) participated in questionnaires, and a subset participated in observations, interviews, and focus groups. This allowed for comparing findings across sites and replicate findings in different contexts. The research team found substantial variation in EM use across districts. Teachers in all sites made adaptations from the way the program was written to meet their students’ needs. In all three teacher cohorts, individual teacher characteristics, in particular, their levels of innovativeness and resourcefulness, were more influential than school-level factors in supporting teachers in using EM-related instructional pract...

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page