Award Abstract # 1854402
Reproducible Developmental Science: Why and How

NSF Org: BCS
Division of Behavioral and Cognitive Sciences
Recipient: THE REGENTS OF THE UNIVERSITY OF COLORADO
Initial Amendment Date: January 29, 2019
Latest Amendment Date: January 29, 2019
Award Number: 1854402
Award Instrument: Standard Grant
Program Manager: Peter Vishton
BCS
 Division of Behavioral and Cognitive Sciences
SBE
 Directorate for Social, Behavioral and Economic Sciences
Start Date: June 15, 2019
End Date: November 30, 2019 (Estimated)
Total Intended Award Amount: $6,418.00
Total Awarded Amount to Date: $6,418.00
Funds Obligated to Date: FY 2019 = $6,418.00
History of Investigator:
  • Sabine Doebel (Principal Investigator)
    sdoebel@gmu.edu
  • Michael Frank (Co-Principal Investigator)
Recipient Sponsored Research Office: University of Colorado at Boulder
3100 MARINE ST
Boulder
CO  US  80309-0001
(303)492-6221
Sponsor Congressional District: 02
Primary Place of Performance: University of Colorado at Boulder
Muenzinger D244, 345 UCB
Boulder
CO  US  80309-0345
Primary Place of Performance
Congressional District:
02
Unique Entity Identifier (UEI): SPVKK1RC2MZ3
Parent UEI:
NSF Program(s): DS -Developmental Sciences
Primary Program Source: 01001920DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 1698, 040Z, 7556
Program Element Code(s): 169800
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.075

ABSTRACT

Openness and transparency are foundational to a credible, reliable science. Openness and transparency allow for original research results to be reproduced (reproducibility) and replicated using new samples (replicability), which benefit science by making findings easier to verify. This award funds a day-long preconference preceding the 2019 Biennial Meeting of the Cognitive Development Society that will address this issue by helping cognitive development researchers adopt norms and practices at all stages of the research process that support reproducibility and replicability. This will enhance the robustness of the field and allow for the extension and translation of a more reliable basic research foundation.

Norms that are consistent with reproducibility and replicability, such as pre-registering hypotheses and analyses, sharing data and analytic code, and powering studies sufficiently to effectively test hypotheses will enhance confidence in the published scientific literature. Training that will aid in embedding these norms and practices will guide social and behavioral science towards greater reproducibility and replicability. This preconference will accomplish this goal for cognitive developmental science using presentations and tutorials on the 1) scientific evidence for the methodological and statistical challenges facing cognitive developmental science, 2) benefits of adopting tools such as the Open Science Framework for laboratory management, and 3) issues regarding multi-lab collaboration. The preconference will enhance the practical knowledge on ways in which reproducibility and replicability can be increased.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

This open developmental science preconference provided hands-on training on a variety of topics related to open science norms and practices (e.g., preregistration, multi-lab collaborations, R, Bayesian statistics, online data collection, version control). This training will improve the reliability and credibility of developmental research by improving transparency and rigor, and by making it easier for researchers to replicate, reproduce, and build on results. The preconference was particularly beneficial for early-career scientists who are still developing their research practices and workflows and may have had limited exposure to practices outside of their lab of training. Small travel awards were distributed to ensure representation from a diverse group of junior scholars. The preconference materials have been shared widely to maximize impact.

The preconference is positively impacting society in several ways. Over time, we expect that as a result of this preconference and others modeled on it, the public will place greater trust in and value on developmental science that is produced by researchers who are adopting open science practices. Translational research will be able to build on a more reliable basic knowledge foundation, and thus will have greater potential to yield positive societally relevant outcomes. For example, interventions and products to support cognitive development that are based on reliable, reproducible findings are more likely to aid cognitive development than interventions based on findings that have not been replicated or may not be reproducible.

 

 


Last Modified: 12/30/2019
Modified by: Sabine Doebel

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page