Award Abstract # 2202108
Research on the Use of Real-Time Tracking and Eye-Tracking Technology for Integrating Metacognition and Augmented Reality into Undergraduate Engineering Laboratories

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: UNIVERSITY OF MISSOURI SYSTEM
Initial Amendment Date: June 22, 2022
Latest Amendment Date: June 22, 2022
Award Number: 2202108
Award Instrument: Standard Grant
Program Manager: Matthew A. Verleger
mverlege@nsf.gov
 (703)292-2961
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: July 1, 2022
End Date: June 30, 2025 (Estimated)
Total Intended Award Amount: $850,000.00
Total Awarded Amount to Date: $850,000.00
Funds Obligated to Date: FY 2022 = $850,000.00
History of Investigator:
  • Jung Hyup Kim (Principal Investigator)
    kijung@missouri.edu
  • Danielle Oprean (Co-Principal Investigator)
  • Kangwon Seo (Co-Principal Investigator)
Recipient Sponsored Research Office: University of Missouri-Columbia
121 UNIVERSITY HALL
COLUMBIA
MO  US  65211-3020
(573)882-7560
Sponsor Congressional District: 03
Primary Place of Performance: The Curators of the University of Missouri
115 Business Loop 70 W
Columbia
MO  US  65211-0001
Primary Place of Performance
Congressional District:
03
Unique Entity Identifier (UEI): SZPJL5ZRCLF4
Parent UEI:
NSF Program(s): ECR-EDU Core Research,
Cyberlearn & Future Learn Tech
Primary Program Source: 01002223DB NSF RESEARCH & RELATED ACTIVIT
04002223DB NSF Education & Human Resource
Program Reference Code(s): 110E, 8045, 1340
Program Element Code(s): 798000, 802000
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070, 47.076

ABSTRACT

This project aims to innovate Augmented Reality (AR) learning platforms in an undergraduate engineering laboratory. Recently, due to the COVID-19 pandemic, in-person engineering laboratories faced significant challenges in providing hands-on exercise. AR technology might be a solution to the current challenge. Unlike virtual reality, AR does not cover a physical world but mixes 3D virtual objects into physical objects to improve students? laboratory experiences and spatial awareness. However, students faced difficulties navigating the AR device and have experienced a mismatch between computer-generated 3D images and physical objects while learning in an AR environment. To transform AR learning from a static and isolated experience into a dynamic self-study, this project includes research on using a real-time tracking sensor with a 3D full-body motion capture system to improve AR usability and detect student?s premature termination of learning using metacognitive monitoring feedback and eye-tracking technology.

The primary goal of this project is to integrate real-time 3D motion and location tracking systems to meet a series of objectives to gain insight into scientific development and technological innovation in a location-based AR environment. The first objective is to create the next generation of an AR learning platform by integrating state-of-the-art indoor real-time location technology and a 3D full-body motion capture system. The second objective is to detect the early termination of learning by using metacognitive monitoring feedback and eye movement data. The researchers will apply advanced gaze behavior metrics, such as fractal analysis of pupil dilation and eye inter-fixation duration, to identify significant eye gaze behavior representing student?s premature termination of learning. The last objective is to implement the research findings to promote instructional improvement in an engineering laboratory on the impact of receiving metacognitive feedback on learning performance. The current project will address integrated research and education activities to enhance our knowledge of effective undergraduate engineering laboratory education using real-time 3D motion and location tracking capabilities.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Kim, Jung Hyup and Yu, Ching-Yun and Seo, Kangwon and Wang, Fang and Oprean, Danielle "The Effect of Virtual Instructor and Metacognition on Workload in a Location-Based Augmented Reality Learning Environment" Proceedings of the Human Factors and Ergonomics Society Annual Meeting , v.67 , 2023 https://doi.org/10.1177/21695067231192938 Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page