Award Abstract # 2101669
Using Natural Language Processing to Inform Science Instruction

NSF Org: DRL
Division of Research on Learning in Formal and Informal Settings (DRL)
Recipient: REGENTS OF THE UNIVERSITY OF CALIFORNIA, THE
Initial Amendment Date: June 3, 2021
Latest Amendment Date: August 21, 2023
Award Number: 2101669
Award Instrument: Continuing Grant
Program Manager: Lin Lipsmeyer
llipsmey@nsf.gov
 (703)292-7076
DRL
 Division of Research on Learning in Formal and Informal Settings (DRL)
EDU
 Directorate for STEM Education
Start Date: July 1, 2021
End Date: June 30, 2026 (Estimated)
Total Intended Award Amount: $2,247,500.00
Total Awarded Amount to Date: $2,259,500.00
Funds Obligated to Date: FY 2021 = $1,093,057.00
FY 2023 = $1,166,443.00
History of Investigator:
  • Marcia Linn (Principal Investigator)
    mclinn@berkeley.edu
  • Elizabeth Gerard (Co-Principal Investigator)
Recipient Sponsored Research Office: University of California-Berkeley
1608 4TH ST STE 201
BERKELEY
CA  US  94710-1749
(510)643-3891
Sponsor Congressional District: 12
Primary Place of Performance: Graduate School of Education - UC Berkeley
2121 Berkeley Way
BERKELEY
CA  US  94720-1670
Primary Place of Performance
Congressional District:
12
Unique Entity Identifier (UEI): GS3YEVSS12N6
Parent UEI:
NSF Program(s): Discovery Research K-12
Primary Program Source: 04002122DB NSF Education & Human Resource
04002324DB NSF STEM Education

04002425DB NSF STEM Education
Program Reference Code(s):
Program Element Code(s): 764500
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.076

ABSTRACT

Often, middle school science classes do not benefit from participation of underrepresented students because of language and cultural barriers. This project takes advantage of language to help students form their own ideas and pursue deeper understanding in the science classroom. This work continues a partnership among the University of California, Berkeley, Educational Testing Service, and science teachers and paraprofessionals from six middle schools enrolling students from diverse racial, ethnic, and language groups whose cultural experiences may be neglected in science instruction. The partnership will conduct a comprehensive research program to develop and test technology that will empower students to use their ideas as a starting point for deepening science understanding. Researchers will use a technology that detects student ideas that go beyond a student's general knowledge level to adapt to a student's cultural and linguistic understandings of a science topic. The partnership leverages a web-based platform to implement adaptive guidance designed by teachers that feature dialog and peer interaction. Further, the platform features teacher tools that can detect when a student needs additional help and alert the teacher. Teachers using the technology will be able to track and respond to individual student ideas, especially from students who would not often participate because of language and cultural barriers.

This project develops AI-based technology to help science teachers increase their impact on student science learning. The technology is aimed to provide accurate analysis of students' initial ideas and adaptive guidance that gets each student started on reconsidering their ideas and pursuing deeper understanding. Current methods in automated scoring primarily focus on detecting incorrect responses on test questions and estimating the overall knowledge level in a student explanation. This project leverages advances in natural language processing (NLP) to identify the specific ideas in student explanations for open-ended science questions. The investigators will conduct a comprehensive research program that pairs new NLP-based AI methods for analyzing student ideas with adaptive guidance that, in combination, will empower students to use their ideas as starting points for improving science understanding. To evaluate the idea detection process, the researchers will conduct studies that investigate the accuracy and impact of idea detection in classrooms. To evaluate the guidance, the researchers will conduct comparison studies that randomly assign students to conditions to identify the most promising adaptive guidance designs for detected ideas. All materials are customizable using open platform authoring tools.

The Discovery Research PreK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Billings, Kelly and Chang, Hsin-Yi and Lim-Breitbart, Jonathan M and Linn, Marcia C "Using Artificial Intelligence to Support Peer-to-Peer Discussions in Science Classrooms" Education Sciences , v.14 , 2024 https://doi.org/10.3390/educsci14121411 Citation Details
Bradford, Allison and Li, Weiying and Gerard, Libby and Linn, Marcia C "Comparing Expert and ChatGPT-authored Guidance Prompts" , 2024 https://doi.org/10.1145/3657604.3664669 Citation Details
Bradford, Allison and Li, Weiying and Riordan, Brian and Steimel, Kenneth and Linn, Marcia C "Adaptive Dialog to Support Student Understanding of Climate Change Mechanism and Who is Most Impacted" , 2023 https://doi.org/10.22318/icls2023.681776 Citation Details
Gerard, L. and Bichler, S. and Bradford, A. and Linn, M. C. and Steimel, K. and Riordan, B. "Designing an Adaptive Dialogue to Promote Science Understanding" Proceedings of the 16th International Conference of the Learning Sciences - ICLS 2022 , 2022 Citation Details
Gerard, Libby and Holtman, Marlen and Riordan, Brian and Linn, Marcia C "Impact of an adaptive dialog that uses natural language processing to detect students ideas and guide knowledge integration." Journal of Educational Psychology , v.117 , 2025 https://doi.org/10.1037/edu0000902 Citation Details
Gerard, Libby and Linn, Marcia C and Holtmann, Marlen "A Comparison of Responsive and General Guidance to Promote Learning in an Online Science Dialog" Education Sciences , v.14 , 2024 https://doi.org/10.3390/educsci14121383 Citation Details
Holtmann, Marlen and Gerard, Libby and Li, Weiying and Linn, Marcia C and Riordan, Brian and Steimel, Ken "How Does an Adaptive Dialog Based on Natural Language Processing Impact Students From Distinct Language Backgrounds?" , 2023 https://doi.org/10.22318/icls2023.921177 Citation Details
Li, Weiying and Chang, Hsin-Yi and Bradford, Allison and Gerard, Libby and Linn, Marcia_C "Combining Natural Language Processing with Epistemic Network Analysis to Investigate Student Knowledge Integration within an AI Dialog" Journal of Science Education and Technology , 2024 https://doi.org/10.1007/s10956-024-10176-y Citation Details
Li, Weiying and Gerard, Libby and Lim-Breitbart, Jonathan and Bradford, Allison and Linn, Marcia C and Riordan, Brian and Steimel, Kenneth "Explaining Thermodynamics: Impact of an Adaptive Dialog Based on a Natural Language Processing Idea Detection Model" , 2023 https://doi.org/10.22318/icls2023.199424 Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page