Skip to feedback

Award Abstract # 0822388
R&D: Cumulative Learning using Embedded Assessment Results (CLEAR)

NSF Org: DRL
Division of Research on Learning in Formal and Informal Settings (DRL)
Recipient: REGENTS OF THE UNIVERSITY OF CALIFORNIA, THE
Initial Amendment Date: September 22, 2008
Latest Amendment Date: August 6, 2012
Award Number: 0822388
Award Instrument: Continuing Grant
Program Manager: Elizabeth VanderPutten
DRL
 Division of Research on Learning in Formal and Informal Settings (DRL)
EDU
 Directorate for STEM Education
Start Date: September 15, 2008
End Date: August 31, 2014 (Estimated)
Total Intended Award Amount: $3,599,772.00
Total Awarded Amount to Date: $3,599,772.00
Funds Obligated to Date: FY 2008 = $2,977,965.00
FY 2012 = $621,807.00
History of Investigator:
  • Marcia Linn (Principal Investigator)
    mclinn@berkeley.edu
Recipient Sponsored Research Office: University of California-Berkeley
1608 4TH ST STE 201
BERKELEY
CA  US  94710-1749
(510)643-3891
Sponsor Congressional District: 12
Primary Place of Performance: University of California-Berkeley
1608 4TH ST STE 201
BERKELEY
CA  US  94710-1749
Primary Place of Performance
Congressional District:
12
Unique Entity Identifier (UEI): GS3YEVSS12N6
Parent UEI:
NSF Program(s): Discovery Research K-12
Primary Program Source: 04000809DB NSF Education & Human Resource
04001213DB NSF Education & Human Resource
Program Reference Code(s): 9177, SMET
Program Element Code(s): 764500
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.076

ABSTRACT

Cumulative Learning using Embedded Assessment Results (CLEAR) focuses on the challenge of using assessment of relevant STEM content to improve K-12 teaching and learning. CLEAR takes advantage of new technologies and research findings to investigate ways that science assessments can both capture and contribute to cumulative, integrated learning of standards-based concepts in middle school courses. The project will research new forms of assessment that document students' accumulation of knowledge and also serve as learning events. CLEAR will use cohort and randomized classroom comparisons to determine what combinations of instruction and assessment enable middle school students to gain cumulative understanding of energy concepts in science. CLEAR will study whether the project's approach when used in one course impacts progress in the next. The project will put design principles from across the field to the test by determining which instruction and assessment strategies encourage cumulative understanding and help learners develop integrated ideas about science.

Intellectual Merit. There is an urgent need to develop accurate student assessments that measure cumulative knowledge while eliminating the disruptions caused by tests. By measuring students' developing understanding and ongoing efforts to make sense of new materials, the project will be able to foster coherent understanding. The project will do this by making assessment an integral part of computer-based curricula.

Broader Impacts. By aligning assessment and instruction around the goal of promoting understanding, the project will demonstrate how to improve learning outcomes for any STEM course. The project will also make courses more effective and efficient by converting assessment from a time-wasting, curriculum-limiting chore into an integral part of learning that fosters the accumulation of concepts across topics and grades. The results of the proposed research will have an important bearing on the design of effective electronic media on promoting student learnig.

The project is designed to have a major impact by undertaking the kind of careful, statistically valid research design that leads to reproducible results that can support policy. The project will be able to tailor instruction to specific learners, increasing the impact on students at risk for failure. The partners will continue their practice of widely dissemi-nating findings, materials, and open source software through reviewed papers, popular articles, talks, workshops, a website, and newsletters.

The project is led by Marcia C. Linn, Robert Tinker, Kathy Benemann, Hee Sun Lee, Ou Lydia Liu, & James Slotta

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 75)
Gerard, L. F., Spitulnik, M., Linn, M. C. "Teacher use of evidence to customize inquiry science instruction" Journal of Research in Science Teaching , v.47 , 2010 , p.1037 10.1002/tea.20367
Gerard, L.F., Spitulnik, M., & Linn, M.C. "Teacher use of evidence to customize inquiry science instruction" Journal of Research in Science Teaching , v.47 , 2010 , p.1037
Ã?zdemir, G.;Clark, D. B.; "Coherence of Turkish students' understanding of force" Journal of Research on Science Teaching , v.46 , 2009 , p.570-596
Chang, H.-Y. & Linn, M. C. . "Scaffolding learning from molecular visualizations" Journal of Research in Science Teaching , v.50 , 2013 10.1002/tea.21089
Chiu, J. & Linn, M. C. "Knowledge Integration and WISE Engineering" Journal of Pre-College Engineering Education Research , v.1(1) , 2011 , p.1-14
Chiu, J.;Linn, M. C.; "Self-Assessment and Self-Explanation for Learning Chemistry Using Dynamic Molecular Visualizations" International Perspectives in the Learning Sciences: Cre8ting a Learning World. Proceedings of the 8th International Conference of the Learning Sciences , v.3 , 2008 , p.16-17
Clark, D. B.;Dâ??Angelo, C. M.;Menekse, M.; "Initial structuring of online discussions to improve learning and argumentation: Incorporating students" Journal of Science Education and Technology , v.18 , 2009 , p.321-333
Clark, D. B.;DAngelo, C.M.;Menekse, M.; "Initial structuring of online discussions to improve learning and argumentation: Incorporating students" Journal of Science Education and Technology , v.18 , 2009 , p.321-333
Clark, D. B.,;Linn, M. C.; "Designing for Knowledge Integration: The Impact of Instructional Time" Journal of Education , v.189 , 2009 , p.139-158
Clark, D. B.,Touchman, S.,Skjerping, C. "Bilingual language supports in online science inquiry environments" Computers and Education , v.58 , 2012 , p.1207
de Jong, T., Linn, M. C., & Zacharia, Z. C. "Physical and Virtual Laboratories in Science and Engineering Education" Science , v.340 , 2013 , p.305-308
(Showing: 1 - 10 of 75)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Cumulative Learning using Embedded Assessment Results (CLEAR) focused on the challenge of improving K-12 teaching and learning of energy concepts. CLEAR leveraged new curriculum, technologies, and research findings to investigate ways that science assessments can both capture and contribute to cumulative, integrated learning of standards-based concepts in middle school courses. CLEAR has conducted synergistic activities and studies that can be described in four main themes:

  • Improvement and refinement of curriculum materials and new forms of assessment,

  • Longitudinal progress of diverse students on cumulative learning goals concerning energy concepts in middle school,

  • Fidelity of implementation of curriculum materials promoting cumulative learning in middle school classrooms, and

  • Identification of specific strategies for promoting cumulative learning.


CLEAR has created technology-enhanced middle school science curricula that integrate core energy ideas across the relatively incoherent state standards using the Web-based Inquiry Science Environment (WISE: wise.berkeley.edu). Informed by the knowledge integration framework, the curriculum guides students to explore standards-based energy topics. Instructional materials implement research-based strategies for promoting coherence. The materials provide a foundation that allows students to continue developing cumulative knowledge of energy in science in later grades. The core energy concepts are provided across four curricular units in grades six and seven. These units serve three main goals: a) they connect energy concepts such as energy conservation, energy transfer and energy transformation across science topics such as photosynthesis and plate tectonics ; b) they introduce and scaffold student use of essays, diagrams, visualizations, and experiments involving probes and sensors to explain their ideas; and c) they engage students in exploring energy concepts appropriate for each grade level.


CLEAR researched two new forms of assessment: MySystem diagrams that allow students to show energy flow using icons and links; and Energy Stories that require narrative explanations about energy processes. These assessments document progress and also promote cumulative learning of energy concepts across CLEAR curricula. In particular, MySystem has been shown to help English Language Learners overcome language barriers to better represent their understanding of energy concepts. Using automated scoring to assign guidance on MySystem demonstrated that knowledge integration guidance is more effective than typical specific guidance for promoting cumulative learning. Knowledge integration guidance does not provide the correct answer but rather encourages students to revisit the visualizations in the curriculum to improve their response.


CLEAR conducted two longitudinal studies to measure cumulative learning. In both the two- and three-year longitudinal study tracking sixth-grade students, results from item response modeling analyses revealed that: (a) the assessments demonstrated satisfactory psychometric properties in terms of reliability and validity; (b) both the cross-sectional and longitudinal cohorts made progress on integrating their understanding of energy concepts; and (c) among many factors (e.g., gender, grade, school, home language) associated with students’ science performance, unit implementation was the strongest predictor.


CLEAR also investigated how fidelity of implementa...

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page