Award Abstract # 1734892
NCS-FO: Extracting Functional Cortical Network Dynamics at High Spatiotemporal Resolution

NSF Org: SMA
SBE Office of Multidisciplinary Activities
Recipient: UNIVERSITY OF MARYLAND, COLLEGE PARK
Initial Amendment Date: August 7, 2017
Latest Amendment Date: August 7, 2017
Award Number: 1734892
Award Instrument: Standard Grant
Program Manager: Betty Tuller
btuller@nsf.gov
 (703)292-7238
SMA
 SBE Office of Multidisciplinary Activities
SBE
 Directorate for Social, Behavioral and Economic Sciences
Start Date: August 1, 2017
End Date: July 31, 2023 (Estimated)
Total Intended Award Amount: $909,153.00
Total Awarded Amount to Date: $909,153.00
Funds Obligated to Date: FY 2017 = $909,153.00
History of Investigator:
  • Jonathan Simon (Principal Investigator)
    jzsimon@umd.edu
  • Behtash Babadi (Co-Principal Investigator)
Recipient Sponsored Research Office: University of Maryland, College Park
3112 LEE BUILDING
COLLEGE PARK
MD  US  20742-5100
(301)405-6269
Sponsor Congressional District: 04
Primary Place of Performance: University of Maryland College Park
2145 A.V. Williams Building
College Park
MD  US  20742-3285
Primary Place of Performance
Congressional District:
Unique Entity Identifier (UEI): NPU8ULVAAS23
Parent UEI: NPU8ULVAAS23
NSF Program(s): IntgStrat Undst Neurl&Cogn Sys
Primary Program Source: 01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 8089, 8091, 8551
Program Element Code(s): 862400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.075

ABSTRACT

This project is funded by Integrative Strategies for Understanding Neural and Cognitive Systems (NSF-NCS), a multidisciplinary program jointly supported by the Directorates for Computer and Information Science and Engineering (CISE), Education and Human Resources (EHR), Engineering (ENG), and Social, Behavioral, and Economic Sciences (SBE). Neuroscientists have been remarkably successful in understanding the function of numerous brain regions by studying them in isolation and characterizing their individual roles in behavior. Growing evidence in recent years, however, suggests that sophisticated brain function emerges from the co-activation of multiple brain regions that exhibit networked activity. These networks organize rapidly in order to allow the brain to adapt to changes in the environment, resulting in robust behavior. Deciphering the neural mechanisms underlying these network dynamics is therefore crucial in understanding how the brain carries out cognitive processes such as attention, decision-making and learning. Recent technological advances in noninvasive neuroimaging have largely addressed the experimental challenges in studying these dynamic networks in humans and have provided abundant neural data under countless clinical and experimental conditions. However, the sheer high-dimensionality of these data together with the complexity of these networks has created various bottlenecks in data analysis, modeling, and statistical inference. In order to exploit the unique window of opportunity provided by the abundance of noninvasive neural data, this project is (1) developing a unified methodology for inferring the dynamics and statistical characteristics of these cortical networks, in a computationally efficient fashion, and (2) applying this methodology to magnetoencephalography (MEG) data from behaving human subjects to address several fundamental questions about auditory processing. This work brings new insight as to the dynamic organization of brain networks at unprecedented spatiotemporal resolutions, and can thereby affect technology in the areas of brain-computer interfacing and neuromorphic engineering. It also allows for the creation of engineering solutions for early detection and monitoring of cognitive disorders involving auditory perception and attention. The outcome of this project will be disseminated to the broader scientific community in the form of publicly accessible data analysis toolboxes accompanied with tutorials and webinars. The research plan is complemented by educational activities at the K-12, undergraduate, and graduate levels, including workshops, undergraduate projects, and course development, with an emphasis on the involvement of women and underrepresented minorities.

The existing paradigm for extracting cortical functional network dynamics faces challenges, including loss of temporal resolution due to the common sliding window processing, loss of spatial resolution due to the constraints of noninvasive recording, and statistical bias due to the heavy usage of linear estimation techniques given that network properties are intrinsically non-linear. This project provides a unified research plan for addressing these challenges, by combining high temporal resolution non-invasive recordings with high spatial resolution in a statistically robust way, using modern signal processing techniques. This methodology will specifically be applied to MEG data acquired from behaving human subjects, and will be used to decipher the neural mechanisms of adaptive auditory processing.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 22)
Brodbeck, Christian and Bhattasali, Shohini and Cruz Heredia, Aura AL and Resnik, Philip and Simon, Jonathan Z and Lau, Ellen "Parallel processing in speech perception with local and global representations of linguistic context" eLife , v.11 , 2022 https://doi.org/10.7554/eLife.72056 Citation Details
Brodbeck, Christian and Das, Proloy and Gillis, Marlies and Kulasingham, Joshua P and Bhattasali, Shohini and Gaston, Phoebe and Resnik, Philip and Simon, Jonathan Z "Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions" eLife , v.12 , 2023 https://doi.org/10.7554/eLife.85012 Citation Details
Brodbeck, Christian and Simon, Jonathan Z "Continuous speech processing" Current Opinion in Physiology , v.18 , 2020 https://doi.org/10.1016/j.cophys.2020.07.014 Citation Details
Brodbeck, Christian M.. and Simon, Jonathan Z. "Cortical tracking of voice pitch in the presence of multiple speakers depends on selective attention" Frontiers in neuroscience , v.08 Jul , 2022 https://doi.org/10.1101/2021.12.03.471122 Citation Details
Commuri, Vrishab and Kulasingham, Joshua P. and Simon, Jonathan Z. "Cortical responses time-locked to continuous speech in the high-gamma band depend on selective attention" Frontiers in Neuroscience , v.17 , 2023 https://doi.org/10.3389/fnins.2023.1264453 Citation Details
Das, Proloy and Brodbeck, Christian and Simon, Jonathan Z. and Babadi, Behtash "Cortical Localization of the Auditory Temporal Response Function from MEG via Non-convex Optimization" 2018 52nd Asilomar Conference on Signals, Systems, and Computers , 2018 10.1109/ACSSC.2018.8645204 Citation Details
Das, Proloy and Brodbeck, Christian and Simon, Jonathan Z. and Babadi, Behtash "Neuro-current response functions: A unified approach to MEG source analysis under the continuous stimuli paradigm" NeuroImage , v.211 , 2020 10.1016/j.neuroimage.2020.116528 Citation Details
Johns, M. A. and Calloway, R. C. and Karunathilake, I. M. and Decruy, L. P. and Anderson, S. and Simon, J. Z. and Kuchinsky, S. E. "Attention Mobilization as a Modulator of Listening Effort: Evidence from Pupillometry" Trends in hearing , 2024 Citation Details
Karunathilake, I. M. and Kulasingham, Joshua P. and Simon, Jonathan Z. "Neural tracking measures of speech intelligibility: Manipulating intelligibility while keeping acoustics unchanged" Proceedings of the National Academy of Sciences , v.120 , 2023 https://doi.org/10.1073/pnas.2309166120 Citation Details
Kulasingham, Joshua P. and Brodbeck, Christian and Khan, Sheena and Marsh, Elisabeth B. and Simon, Jonathan Z. "Bilaterally Reduced Rolandic Beta Band Activity in Minor Stroke Patients" Frontiers in Neurology , v.13 , 2022 https://doi.org/10.3389/fneur.2022.819603 Citation Details
Kulasingham, Joshua P. and Brodbeck, Christian and Presacco, Alessandro and Kuchinsky, Stefanie E. and Anderson, Samira and Simon, Jonathan Z. "High gamma cortical processing of continuous speech in younger and older listeners" NeuroImage , v.222 , 2020 https://doi.org/10.1016/j.neuroimage.2020.117291 Citation Details
(Showing: 1 - 10 of 22)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The project "NCS-FO: Extracting Functional Cortical Network Dynamics at High Spatiotemporal Resolution" (NSF 1734892) succeeded in its goals to integrate theory, modeling, algorithm development, and application in order to address challenges in extracting functional cortical network dynamics. 

The first goal achieved was to show that the dynamics of rapid task-dependent processing in the brain can be seen and measured in non-invasive magnetoencephalography (MEG) recordings. 

The second goal achieved was of direct localization of neural processing dynamics (Temporal Response Functions) without source localization bias, in which we showed that the underlying cortical processing is distributed across multiple spatial, spectral, and temporal scales, without resorting to traditional biased source localization techniques.

The third goal achieved was of estimating network level causal cortical connectivity without source localization bias, in which we showed that the underlying cortical connectivity is distributed across multiple spatial, spectral, and temporal scales, without resorting to traditional biased source localization techniques.

This project also resulted in 24 published articles and three freely available datasets (and three additional not-yet-published articles).

Broader Impacts: Co-PI Babadi successfully designed a two-week course module for a freshman-level course called "ENEE101 Introduction to Electrical and Computer Engineering" at the University of Maryland, which provides exposure to neural data analysis and modeling, using 3 hands-on lab sessions involving EEG recording and analysis. He is in the process of translating this module to a high school-level workshop, with the aim of providing high school students with early exposure to brain research, and encouraging them to consider careers in STEM-related fields.

The results of the project on finding robust biomarkers of auditory attention and intelligibility are expected to impact the design of next-generation smart hearing aid devices, and thereby provide better technological solutions for the aging population in the US suffering from hearing disorders. 

The Granger causal inference framework from indirect and low-dimensional MEG observations allows to compensate for the lack of spatial resolution of MEG (as compared to fMRI), and thereby provide new insights into cortical functional connectivity at high spatiotemporal resolutions. These applications have now been demonstrated in the case of patients recovering from stroke and for older adults with difficulty understanding speech in noise.


Last Modified: 03/29/2024
Modified by: Jonathan Z Simon

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page