Skip to feedback

Award Abstract # 1725554
Simulated Practice: Using Socially-Responsive Avatars to Prepare STEM Graduate Teaching Assistants for Student-Centered Instruction

NSF Org: DUE
Division Of Undergraduate Education
Recipient: THE UNIVERSITY OF CENTRAL FLORIDA BOARD OF TRUSTEES
Initial Amendment Date: November 29, 2017
Latest Amendment Date: August 18, 2021
Award Number: 1725554
Award Instrument: Standard Grant
Program Manager: Jennifer Lewis
jenlewis@nsf.gov
 (703)292-7340
DUE
 Division Of Undergraduate Education
EDU
 Directorate for STEM Education
Start Date: November 15, 2017
End Date: October 31, 2024 (Estimated)
Total Intended Award Amount: $599,999.00
Total Awarded Amount to Date: $700,009.00
Funds Obligated to Date: FY 2018 = $599,999.00
FY 2021 = $100,010.00
History of Investigator:
  • Jacquelyn Chini (Principal Investigator)
    chini.3@osu.edu
  • Charles Hughes (Co-Principal Investigator)
  • Erin Saitta (Co-Principal Investigator)
Recipient Sponsored Research Office: The University of Central Florida Board of Trustees
4000 CENTRAL FLORIDA BLVD
ORLANDO
FL  US  32816-8005
(407)823-0387
Sponsor Congressional District: 10
Primary Place of Performance: University of Central Florida
4000 Central Florida Blvd
Orlando
FL  US  32816-2385
Primary Place of Performance
Congressional District:
10
Unique Entity Identifier (UEI): RD7MXJV7DKT9
Parent UEI:
NSF Program(s): IUSE
Primary Program Source: 04001819DB NSF Education & Human Resource
04002122DB NSF Education & Human Resource
Program Reference Code(s): 102Z, 8209, 8244, 9178
Program Element Code(s): 199800
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.076

ABSTRACT

"TeachLive" is a mixed-reality classroom simulator through which teacher trainees practice interacting with small groups of virtual students who take on different, realistic roles as learners. The teacher trainees in this project are Graduate Teaching Assistants (GTAs), who increasingly provide the instruction for introductory undergraduate courses in large enrollment institutions. The extent of current GTA training varies by institution and most typically entails learning about generalized pedagogical best practices with little or no actual practice with feedback from a master teacher. GTAs are often hired to teach students while they themselves are still learning to teach. Most STEM GTAs and their undergraduate students would benefit from more intentional instruction on how to engage students using high-impact practices and pedagogical content knowledge within their disciplines. The TeachLive simulator provides a promising technology-based solution to the problem of providing GTAs with high quality training. TeachLive training provides a real-time response mechanism to practice teaching and has the promise of being more effective than other TA training strategies (workshops, short-courses, etc.), which do not provide enough feedback (real-time or otherwise) to be effective. The curricular materials for which GTAs will safely practice evidence-based teaching will utilize concept inventories that have been developed in four different STEM fields, Chemistry, Math, Physics, and Computer Science.

In the past the TeachLive platform has been developed and used successfully to train K-12 teachers to describe and explain problems more effectively and to better recognize students' misconceptions. This project is motivated by two deficiencies in current practice. First, most GTAs get basic training in pedagogy, but not specific training in their discipline. Second, GTAs' fidelity of utilization of pedagogical training is highly variable, and many of them don't succeed in providing strong engaged student learning experiences. The TeachLive Simulator has the promise of tailoring practice to each specific GTA depending on their needs.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 12)
Doty, Constance M. and Geraets, Ashley A. and Wan, Tong and Nix, Christopher A. and Saitta, Erin K. and Chini, Jacquelyn J. "Impact of high-intensity training with a mixed-reality simulator on graduate teaching assistants use of questioning" Physical Review Physics Education Research , v.19 , 2023 https://doi.org/10.1103/PhysRevPhysEducRes.19.020101 Citation Details
Doty, Constance M. and Geraets, Ashley A. and Wan, Tong K. and Saitta, Erin J. and Chini, Jacquelyn "Student perspective of GTA strategies to reduce feelings of anxiousness with cold-calling" 2019 Physics Education Research Conference Proceedings , 2020 10.1119/perc.2019.pr.Doty Citation Details
Doty, Constance M. and Wan, Tong and Geraets, Ashley A. and Nix, Christopher A. and Saitta, Erin K. and Chini, Jacquelyn J. "Impact of changing physical learning space on GTA and student behaviors" Physics Education Research Conference 2020 , 2020 https://doi.org/10.1119/perc.2020.pr.Doty Citation Details
Geraets, Ashley A. and Nottolini, Isadore L. and Doty, Constance M. and Wan, Tong and Chini, Jacquelyn J. and Saitta, Erin K. "Preparing GTAs for Active Learning in the General Chemistry Lab: Development of an Evidence-Based Rehearsal Module for a Mixed-Reality Teaching Simulator" Journal of Science Education and Technology , v.30 , 2021 https://doi.org/10.1007/s10956-021-09923-2 Citation Details
Hughes, Charles E. and Dieker, Lisa A. and Glavey, Eileen M. and Hines, Rebecca A. and Wilkins, Ilene and Ingraham, Kathleen and Bukaty, Caitlyn A. and Ali, Kamran and Shah, Sachin and Murphy, John and Taylor, Matthew S. "RAISE: Robotics & AI to improve STEM and social skills for elementary school students" Frontiers in Virtual Reality , v.3 , 2022 https://doi.org/10.3389/frvir.2022.968312 Citation Details
Jung, Sungchul and Bruder, Gerd and Wisniewski, Pamela J. and Sandor, Christian and Hughes, Charles E. "Over My Hand: Using a Personalized Hand in VR to Improve Object Size Estimation, Body Ownership, and Presence" . Proceedings of the 6th ACM Symposium on Spatial User Interaction (SUI 2018) , 2018 10.1145/3267782.3267920 Citation Details
Kent, Julie A and Hughes, Charles E "Law enforcement training using simulation for locally customized encounters" Frontiers in Virtual Reality , v.3 , 2022 https://doi.org/10.3389/frvir.2022.960146 Citation Details
Sharkey, Daniel and Doty, Constance M. and Wan, Tong and Saitta, Erin K. and Chini, Jacquelyn J. "Physics Graduate Teaching Assistant Use of Error Framing in Recitations and Laboratories" Proceedings of the Physics Education Research Conference , 2023 https://doi.org/10.1119/perc.2023.pr.Sharkey Citation Details
Wan, Tong and Doty, Constance M. and Geraets, Ashley A. and Nix, Christopher A. and Saitta, Erin K.H. and Chini, Jacquelyn J. "Evaluating the impact of a classroom simulator training on graduate teaching assistants instructional practices and undergraduate student learning" Physical Review Physics Education Research , v.17 , 2021 https://doi.org/10.1103/PhysRevPhysEducRes.17.010146 Citation Details
Wan, Tong and Doty, Constance M. and Geraets, Ashley A. and Saitta, Erin K. and Chini, Jacquelyn J. "Characterizing graduate teaching assistants teaching practices in physics mini-studios" 2019 Physics Education Research Conference Proceedings , 2020 10.1119/perc.2019.pr.Wan Citation Details
Wan, Tong and Doty, Constance M. and Geraets, Ashley A. and Saitta, Erin K. H. and Chini, Jacquelyn J. "Responding to incorrect ideas: science graduate teaching assistants operationalization of error framing and undergraduate students perception" International Journal of STEM Education , v.10 , 2023 https://doi.org/10.1186/s40594-023-00398-8 Citation Details
(Showing: 1 - 10 of 12)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

This project explored how rehearsal of pedagogical skills in a mixed-reality classroom simulator supported STEM GTAs’ teaching as well as learning and affective outcomes for undergraduate students taught by the trained GTAs. For this project, a new learning environment was developed for the mixed-reality classroom simulator TeachLivETM to resemble a physical science laboratory environment, as shown in Figures 1 and 2.

We created and published a model for creating professional development modules to be implemented in a mixed-reality classroom simulator. In this project, GTAs rehearsed four pedagogical skills across four modules. Module 1 featured cold-calling (i.e., calling on non-volunteering students by name) paired with error framing (i.e., acknowledging that a student shared an incorrect idea in a way that frames errors as natural and/or beneficial). Module 2 featured questioning strategies, and Module 3 featured group management strategies. Finally, Module 4 allowed GTAS to integrate all four skills or to focus on a single challenging skill. We created three discipline-specific lesson scenarios for introductory physics, chemistry, and calculus. During the projects, over 100 GTAs received pedagogical training, impacting at least 6,000 undergraduate students. Consent rates for research were low among the calculus GTA cohort, we can not meaningfully analyze some data for this cohort, such as classroom observations.

Analyzing observations of both the physics and chemistry GTAs, we identified distinct instructional styles than had previously been described in the literature. For chemistry GTAs, these instructional styles included: Responders; Active Lecturers; and Initiators. For physics GTAs, the styles included: Group-work Facilitators; Waiters; and Whole-class Facilitators. In contrast to prior work, our findings suggest a relationship between GTAs’ instructional styles and student behaviors, with more interactive instructional styles correlating with higher student engagement. This analysis suggested that both the nature of the laboratory activities and the GTAs’ amount of prior experience impacted GTA instructional style, with less experienced GTAs tending to be more interactive than experienced GTAs. Relatedly, analysis of physics GTA teaching behaviors showed that GTAs were less interactive when the classroom in which they were implementing the same active learning curriculum changed from one with tables that supported multiple students sitting together to one with individual desks.

We conducted observations of the physics and chemistry GTAs in semesters with various amounts of simulator rehearsal of the target skills (i.e., no training, one session of training, and four sessions of training). We found that both new and experienced GTAs who completed all four simulator modules in one semester demonstrated a shift towards actively implementing whole-class facilitation strategies rather than passively waiting for their students to ask for help. We also observed that these GTAs implemented questioning and cold calling techniques. Specifically, we found that simulator training increased the number of high-quality questions GTAs asked during a class session.

Additionally, we analyzed a particularly tricky aspect of active learning instruction– what an instructor should say when a student makes a mistake in front of other students. Overall, we found error framing is difficult for GTAs to implement. We analyzed the error framing statements GTAs made in the mixed-reality classroom simulator and found that GTAs used both explicit and implicit forms of error identification and a variety of error framing techniques, including framing errors as natural, framing errors as beneficial, and positively acknowledging the error. From interviews with undergraduate students about some of these exemplar GTA error framing statements, we found that the specific framing that a GTA implemented as well as the GTA’s tone impacted student’s comfort. Some GTAs and some undergraduate students suggested that GTAs should not explicitly identify student mistakes. We analyzed GTAs use of error framing statements in their actual classrooms and found that in the rare cases that GTAs made error framing statements, they tended to use implicit, indirect strategies, which aligned with those that would support student comfort.

Overall, this project demonstrated that rehearsal in a mixed-reality classroom simulator supported GTAs’ use of teaching skills that are associated with active learning curricula, which have become common in introductory STEM courses.

 


Last Modified: 02/28/2025
Modified by: Jacquelyn Chini

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page