Award Abstract # 1821521
Collaborative Research: Scaling the Early Research Scholars Program

NSF Org: DUE
Division Of Undergraduate Education
Recipient: UNIVERSITY OF CALIFORNIA, SAN DIEGO
Initial Amendment Date: August 30, 2018
Latest Amendment Date: November 24, 2021
Award Number: 1821521
Award Instrument: Standard Grant
Program Manager: Paul Tymann
ptymann@nsf.gov
 (703)292-2832
DUE
 Division Of Undergraduate Education
EDU
 Directorate for STEM Education
Start Date: October 1, 2018
End Date: September 30, 2024 (Estimated)
Total Intended Award Amount: $740,179.00
Total Awarded Amount to Date: $740,179.00
Funds Obligated to Date: FY 2018 = $740,179.00
History of Investigator:
  • Christine Alvarado (Principal Investigator)
    alvarado@cs.ucsd.edu
Recipient Sponsored Research Office: University of California-San Diego
9500 GILMAN DR
LA JOLLA
CA  US  92093-0021
(858)534-4896
Sponsor Congressional District: 50
Primary Place of Performance: University of California-San Diego
CA  US  92093-0934
Primary Place of Performance
Congressional District:
50
Unique Entity Identifier (UEI): UYTTZT6G9DT1
Parent UEI:
NSF Program(s): IUSE
Primary Program Source: 04001819DB NSF Education & Human Resource
Program Reference Code(s): 9178, 8209
Program Element Code(s): 199800
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.076

ABSTRACT

Enrollment in computer science (CS) programs across the nation is higher than ever, yet two critical problems persist. First, despite these high enrollments, relatively few U.S. students are continuing on to graduate school. Maintaining and improving the health of the domestic Ph.D. pipeline is a concern of universities, companies, and government agencies. Second, the population of students pursuing CS degrees is not representative of the diversity of people in the U.S., with women and other groups persistently underrepresented. The Early Research Scholars Program (ERSP) aims to address issues of increasing the Ph.D. pipeline and broadening participation in computer science fields. ERSP is an academic-year, team-based research apprenticeship program that places special emphasis on mentoring women and underrepresented groups in the second year of the CS major. ERSP's mentoring framework includes the research mentor and the ERSP central mentoring team, providing multifaceted support for each student. In addition, it is structured to engage a large number of early CS students in a productive, positive CS research experience without imposing undue work on individual research advisors. By engaging students in early research, ERSP aims to increase their retention at the undergraduate level and recruitment into graduate programs. The project has been running successfully at University of California San Diego for four years. This project will expand ERSP to other universities, including Stanford University, the University of California, Santa Barbara, and the University of Illinois at Chicago. The project will also study the outcomes of ERSP on the student and faculty participants at all institutions.

This project has two parts: expansion of ERSP and evaluation of the impact of ERSP on participants. Initially, ERSP will be implemented at three research-intensive schools with a range of undergraduate admission criteria. Each implementation will be tailored to the specific context of the institution, providing a range of implementation structures as models for how ERSP might be successfully implemented. After this initial expansion phase, the project plans to partner with two additional schools to explore how ERSP could be implemented at less research-intensive universities (e.g., masters institutions). The second part of this project is research on the long-term impact of ERSP on student participants. Specifically, the project seeks to assess whether ERSP promotes the following among participants: a sense of connection with the computing community, short-term and long-term engagement in research, CS knowledge, and persistence in computing. Evaluators at the Center for Evaluating the Research Pipeline will use their national survey infrastructure to collect experiential data from ERSP students vs. non-ERSP students, as the students progress through college and after they leave college. These evaluators will also conduct interviews with ERSP program leaders, faculty mentors, and students, and control faculty and students who are not participating in ERSP. These interviews will supplement the survey data, and help the ERSP team better understand ERSP impact, as well as identify new challenges and opportunities for program improvement.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Alvarado, Christine and Gray, Alistair and Mirza, Diba and Tjoa, Madeline "The Role of Mentoring in a Dual-Mentored Scalable CS Research Program" Proceedings of the 52nd ACM Technical Symposium on Computer Science Education , 2021 https://doi.org/10.1145/3408877.3432364 Citation Details
Alvarado, Christine and Hummel, Joe and Mirza, Diba and Revelo, Renata and Yan, Lisa "Scaling and Adapting a Program for Early Undergraduate Research in Computing" Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1 (SIGCSE 2022) , 2022 https://doi.org/10.1145/3478431.3499336 Citation Details
Alvarado, Christine and Mirza, Diba and Revelo, Renata A. and Thota, Neena "Scaling and Diversifying Undergraduate Research with the Early Research Scholars Program" , 2022 https://doi.org/10.1145/3545947.3569621 Citation Details
Alvarado, Christine and Villazon, Sergio and Tamer, Burcin "Evaluating a Scalable Program for Undergraduate CS Research" Proceedings of the 2019 ACM Conference on International Computing Education Research , 2019 10.1145/3291279.3339406 Citation Details
Izhikevich, Katherine and Ong, Kyeling and Alvarado, Christine "Exploring Group Dynamics in a Group-Structured Computing Undergraduate Research Experience" Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 1 , 2022 https://doi.org/10.1145/3501385.3543959 Citation Details
Redfield, Kamen and Sidhu, Sukham and Alvarado, Christine "The Early Research Scholars Program: Analyzing Correlation with Academic Outcomes in Computer Science Students" , 2022 https://doi.org/10.1145/3545947.3576360 Citation Details
Redfield, Kamen and Sidhu, Sukham and Glazewski, Zackary and Lee, Cynthia and Mirza, Diba and Alvarado, Christine "A Longitudinal Study of the Relationship Between Early Undergraduate Research and Academic Outcomes in Computer Science" , 2024 https://doi.org/10.1145/3626252.3630765 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The Early Research Scholars Program (ERSP) is a team-based research apprentice experience for early computer science and engineering undergraduate students.  Students in ERSP work in teams of four, and each team is matched with an active research project and technical mentor.  In addition, teams receive supplemental support through an introduction to research methods course, and a central mentor who supports teams with their communication, organization, goal setting and task planning, and basic research skills.  Throughout the program, students learn about research in computer science and then propose and carry out an independent research project over the course of an academic year.   ERSP's collaborative and supportive structure, as well as its inclusive selection criteria, was designed to engage students from groups underrepresented in computer science including women and gender marginalized students, and Black, Latino/a/e and Native American students.

ERSP began in 2014 at UC San Diego.  The goal of this project was to expand ERSP to other universities across the United States and to study its long-term impact on students.   The project produced the following outcomes:

  • Broad implementation of ERSP across a diverse range of institutions.  ERSP was launched at the following universities in the following years: UC Santa Barbara (2018), Stanford (2019), University of Illinois-Chicago (2019), UMass Amherst (2021), North Carolina State University (2021), Texas Southern University (TSU) (2022), Southern Connecticut State University (SCSU) (2022).  UC San Diego also launched a version of ERSP across the Engineering school called the Guided Engineering Apprenticeship in Research (GEAR). 
    Variations on the ERSP model were developed for different contexts.  For example, TSU and Stanford used a single-semester, in-course version of the program where students complete their research training and project in one semester.  TSU and SCSU focused on students later in their academic careers to better meet the needs of their programs. 

  • Comprehensive materials for running the program.  The team developed a complete guide and materials for teaching the undergraduate research methods course and launching and running the ERSP program.  These materials can be found here: https://ersp.ucsd.edu/resources/startup-course-materials

  • National expansion via the Computing Research Association  (CRA) UR2PhD program.  ERSP was used as the basis for the undergraduate research pillar in the CRA's new UR2PhD program, which serves hundreds of undergraduates at dozens of schools throughout North America.

  • National visibility and outreach were achieved through the National ERSP Conference (started in 2022), through workshops given virtually in 2024, and through the ACM Technical Symposium on Computer Science (SIGCSE) in 2022 & 2023.

  • ERSP brought a large and diverse set of students into research.  During the period of this grant, 780 students participated in ERSP.  50% of these students identified as women or non-binary, and 24% identified as belonging to a racial group that is underrepresented in computing.  

  • ERSP students had higher retention in the major.  A longitudinal study of outcomes at UC San Diego and UC Santa Barbara revealed that 98% of ERSP students were retained in their undergraduate CS major, compared to 90% of a matched control group.  This result was particularly strong for women and non-binary participants (97% of women/non-binary participants in ERSP were retained in the major, vs 83% in the control group).   

  • A better understanding of how the program's group-based and dual mentoring structure supports students.  Our research and experience found that the group-based structure of the program both allowed the program to scale, and provided a strong community for participants.  We also found that the two mentors in the program provided complementary support, with the technical mentor providing project-specific support and high-level context for the work, and the central mentor providing guidance on next steps and helping students communicate with their technical mentor.  This dual-mentoring structure provided an all-around positive mentoring experience for the students in the program.

ERSP has proven to be a successful way to scale undergraduate research while providing many of the same benefits (e.g. increased retention) as more traditional one-on-one research experiences.  Our work has provided a model and resources that can continue to be adopted widely to help diversity computing programs at the undergraduate level, and prepare a more diverse student body for graduate study. 

 


Last Modified: 01/27/2025
Modified by: Christine J Alvarado

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page