Projects by topic
EAC evaluations and studies span research areas ranging from STEM talent and development to assessing the very evaluation methods and tools used to support data-driven decisions at NSF.
Evaluation of NSF Grants to Broaden Participation in STEM: American Innovation and Competitiveness Act Section 305, May 2024 Under Section 305 of the American Innovation and Competitiveness Act (AICA), Public Law 114–329, NSF is required to report on NSF activities designed to broaden participation of underrepresented populations in science, technology, engineering, and mathematics (STEM) fields. Between fiscal years 2017 and 2022, NSF awarded over 3,200 grants through NSF programs focused on broadening participation in STEM. This report describes the geographic distribution of grants awarded under AICA, discusses the characteristics of lead principal investigators and institutions receiving awards, and reviews program-level evaluations.
Long-term Educational Outcomes of NSF Research Experiences for Undergraduates (REU) Site participants (2013 and 2014 Cohorts). This fact sheet summarizes postsecondary enrollment and graduation outcomes of 5,088 REU students who participated in an REU Site in either 2013 or 2014 and were matched to National Student Clearinghouse data 7-8 years after program participation.
Study of Anti-Harassment Policies, Guidelines, and Communications, June 2022 This study investigates and responds to questions in NSF's learning agenda related to recent anti-harassment policies to promote safe, harassment-free environments for the practice of science. | |
NSF International Research Experiences for Undergraduates: A Comparative Analysis of the IRES and REU Programs, April 2021 This report provides a portrait of participants in the International Research Experiences for Students and Research Experiences for Undergraduates programs, highlighting findings that inform NSF's strategic planning and program improvement efforts.
Evaluation of the International Research Experiences for Students (IRES) Program: Survey Analysis, September 2020 This report provides detailed descriptive information on the characteristics of IRES participants, their experiences and satisfaction with the program, and their educational and employment outcomes collected through a survey of former participants.
Evaluation of the NSF International Research Experiences for Students (IRES) Program: Portfolio Analysis, Dec. 2019 This report presents (1) an overview of key findings from the literature on international research experiences, (2) a summary of the IRES strategy, (3) a comparison of awarded and declined proposals, (4) a descriptive analysis of the portfolio of IRES awards, (5) a discussion of project implementation activities and outputs, and (6) a set of considerations for ongoing and future evaluation and monitoring efforts.
Study of the Established Program to Stimulate Competitive Research (EPSCoR), June 2022 This report presents an exploratory analysis of academic research excellence and competitiveness for EPSCoR using a variety of publicly available data sources. |
Evaluation of the Centers for Chemical Innovation (CCI) Program (2014 – 2016), Dec. 2019 This report presents evaluation findings on the contribution of the CCI program to increase knowledge, workforce development, commercialization, and public outreach; the role of the center structures and operations in achieving the program goals; and the effectiveness of the two-phase funding model. |
A Review of Funder Instructions and Grant Reviewer Practices for Assessing the Intellectual Merit and Other Impacts of Research This report reviews the existing literature on how reviewers at institutions outside of the U.S. National Science Foundation (NSF) assess nonmedical basic and use-inspired research and science, technology, engineering, and mathematics (STEM) education. It provides evidence about the criteria used to assess grants and factors having important, unimportant, or unstudied impacts on the evaluation of the intellectual merit and broader impacts of grant proposals.
2021 Merit Review Survey Report, October 2023 This report describes survey finding on PI's and Reviewers' satisfaction with the NSF merit review process, including their perceptions of quality, fairness, and burden; drawing information from over 17,000 individuals who shared their experiences submitting or reviewing proposals during Fiscal Year (FY) 2019 and 2020. EAC data snapshots: Written review quality by experience | Satisfaction by experience | Satisfaction by disability | Fairness among applicants
FY 2021 Merit Review Digest, June 2023 This report provides statistical information on proposals awarded and declined in fiscal year (FY) 2021 based on a snapshot of NSF’s transactional databases taken on October 1, 2021. |
NSF Rotator Study, June 2022 This report provides a descriptive portrait of Intergovernmental Personnel Act assignees and an assessment of IPA costs compared with federal employee costs.
Understanding the Use and Potential Effects of a No-Deadlines Approach, May 2022 This report presents an exploratory application of synthetic control methods to estimate the effect of no-deadlines for proposal submissions on NSF program outcomes, including proposal volume, requested award amount, and reviewer workload and ratings.
Convergence Accelerator Summary Report: Descriptive Characteristics from 2019 to 2021 This report provides descriptive statistics on applicants, grantees, and projects for the 2019, 2020, and 2021 cohorts in the Convergence Accelerator program using NSF administrative data.
No-Deadlines Synthetic Control and Exploratory Outcomes Analysis and Recommendations for Future Rigorous Evaluation, May 2022 This report showcases the use of synthetic control methods to examine the effects of no-deadlines using NSF administrative data.
NSF Capacity Assessment Report, March 2022 This report describes NSF's design, implementation and findings of an integrated assessment of data maturity and capacity for evidence generation and use; and an analysis of ongoing evidence-building activities.
