Award Abstract # 1324807
DIP: EMBRACEing English Language Learners with Technology

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: ARIZONA STATE UNIVERSITY
Initial Amendment Date: September 3, 2013
Latest Amendment Date: July 17, 2014
Award Number: 1324807
Award Instrument: Standard Grant
Program Manager: Tatiana Korelsky
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: September 15, 2013
End Date: August 31, 2018 (Estimated)
Total Intended Award Amount: $1,349,915.00
Total Awarded Amount to Date: $1,365,915.00
Funds Obligated to Date: FY 2013 = $1,349,915.00
FY 2014 = $16,000.00
History of Investigator:
  • Arthur Glenberg (Principal Investigator)
    glenberg@asu.edu
  • Erin Walker (Co-Principal Investigator)
  • M. Adelaida Restrepo (Co-Principal Investigator)
Recipient Sponsored Research Office: Arizona State University
660 S MILL AVENUE STE 204
TEMPE
AZ  US  85281-3670
(480)965-5479
Sponsor Congressional District: 04
Primary Place of Performance: Arizona State University
Box 876011
Tempe
AZ  US  85287-6011
Primary Place of Performance
Congressional District:
04
Unique Entity Identifier (UEI): NTLHJXM55KZ6
Parent UEI:
NSF Program(s): Cyberlearn & Future Learn Tech
Primary Program Source: 01001314DB NSF RESEARCH & RELATED ACTIVIT
01001415DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 9251, 8842, 8045
Program Element Code(s): 802000
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

In this Cyberlearning: Transforming Education DIP (Development and Implementation) Project, the PIs focus on how to address the English-language learning needs of young English-language learners (ELLs). They are enhancing the Moved by Reading (MbR) computer program that has been used to increase the reading comprehension of native English speakers. In MbR, a child actively simulates a sentence or a set of sentences being read by moving pictures on a computer screen to illustrate what he or she understands. When they become competent at that, learners transition to imagining moving pictures as they are reading so that they become independent and accomplished readers. In this project, the PIs are enhancing MbR in several ways to help ELLs learn English and learn to read in English. The new approach, called EMBRACE (Enhanced Moved by Reading to Accelerate Comprehension in English), includes MbR as well as facilities for vocabulary support in learners' first language (in this case, Spanish), personalizing choice of next texts to read based on learners' syntax and vocabulary capabilities and needs, game-like facilities for sustaining engagement, and support for collaboration. Research is addressing the roles and effects of each of these supports for learning so as to identify good practices for promoting English-language literacy in ELLs, how to use technology to support those practices, and trajectories of development of English-language competencies in such learners.

Because reading serves as a gateway to academic success, graduation, and employment, there is a great national need to address the English-language learning and reading needs of those whose first language is something other than English. This project addresses this issue through the development of an approach called EMBRACE -- Enhanced Moved by Reading to Accelerate Comprehension in English, an interactive software system to be used in elementary school classrooms, supplementary programs, and at home. Using EMBRACE, children learn English vocabulary, syntax, and reading through manipulating pictures representing the content of what they are reading. Choice of next texts to read is personalized to individual learners. Learners also are supported in working on language issues with peers.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Adams, A "How Language is Embodied in Bilinguals and Children With Specific Language Impairment" Frontiers in Psychology , 2016
Adams, A., Restrepo, M.A., & Glenberg, A. M "Moved by reading in a DLL Spanish-speaking population" Language, Speech, and Hearing Services in Schools , 2018 , p.10.1044/2
Aghajari, Z. and Sonmez Unal, D. and Erhan Unal, M. and Gomez, L. and Walker, E. "Decomposition of Response Time to Give Better Prediction of Childrens Reading Comprehension." International Conference on Educational Data Mining , 2020 Citation Details
Walker, E., Adams, A. M., Restrepo, M. A., Fialko, S., & Glenberg, A. M. "When (and how) interacting with technology-enhanced storybooks helps disadvantaged readers" Translational Issues in Psychology Science , 2017
Walker, E., Adams, A., Restrepo, M. A., Fialko, S., & Glenberg, A. M. "When (and how) interacting with technology-enhanced storybooks helps dual language learners" Translational Issues in Psychological Science , v.3 , 2017
Walker, E., Wong, A., Fialko, S., Restrepo, M. A., & Glenberg, A. M "EMBRACE: Applying Cognitive Tutor Principles to Reading Comprehension" Proceeding of the Artificial Intelligence in Education , 2017

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

EMBRACE (Enhanced Moved By Reading to Accelerate Comprehension in English) is an iPad application designed to improve the reading comprehension skills of Latino children who are English Language Learners (ELLs).  The application is based on Simulation theory: Comprehension requires simulating (i.e., imagining) the situation being described using neural systems of action, perception, and emotion.  Children use the iPad to read texts that are accompanied by pictures (see Figures 1-3 for examples). When they read a sentence printed in blue font, the child engages in one of two activities. In the physical manipulation (PM) stage, the child moves the pictures to physically simulate the meaning of the sentence.  For example, after reading ?The cow walks to the corral,? the child uses her finger to literally move the image of the cow to the corral. Thus, the child uses her perceptual system to map words to images, and she uses her motor system to simulate the syntax, that is, the who does what to whom. In the imagine manipulation stage (IM), upon reading a sentence in blue font the child imagines moving the images.

EMBRACE incorporates several other features to additionally help ELL children. Spanish support helps the child by having a) key vocabulary words defined in both Spanish and English before each chapter, b) the iPad pronounce the word in English and Spanish (without definition) whenever the child taps on the word, and c) the iPad read aloud the first chapter of each multi-chapter text in Spanish to introduce the child to many of the important themes in the child?s native language.  The intelligent tutoring system (ITS) further supports reading by providing the child with immediate feedback on their manipulation (i.e., is it right or wrong?). The ITS also adjusts features depending on the child?s reading performance.  If a child moves the wrong image (in PM), then that item is added to the pre-chapter vocabulary list. If the child moves the correct images but is otherwise incorrect, then the syntax of the sentence is simplified.

The intellectual merit of the project was conceived as three research questions.  First, will EMBRACE help Latino ELLs comprehend better than when reading on an iPad with non-moveable text and pictures? We report those improvements in published research.  We found that the improvements were mainly for narrative (story-like) texts. For expository (informational texts), EMBRACE mainly helped children who were good decoders, that is, good at pronouncing written words.  We also found that Spanish support helped when children were deficient either in decoding or in English competency. Second, will the ITS improve comprehension? We were able to design and build a simulation-based ITS for early reading comprehension, and that had never been done before. Although we did find some positive benefits (e.g., children with the poorest comprehension tended to use features like tapping on a word to hear the pronunciation), we did not find overall improvement due to the ITS.  Third, will dyadic collaboration using EMBRACE improve comprehension?  We had originally conceived dyadic cooperation as two children reading together, but decided that it would be more valuable to consider a child reading with a parent. We collected pilot data which indicated that parents found EMBRACE a) to be very valuable, b) improved the children?s motivation to read, and c) improved their skill at reading.

The broader impact can be measured at several levels.  First, a total of 14 undergraduates participated in the research through the Research Experience for Undergraduates supplement.  The majority of these students were underrepresented minorities. In addition, seven graduate students were supported at some point during their careers. Second, we had an impact on literally hundreds of Latino ELL children who participated in the studies. Finally, we hope to commercialize the EMBRACE system so that it might have a positive impact on many more children and their families.


Last Modified: 11/19/2018
Modified by: Arthur M Glenberg

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page