Award Abstract # 1908299
III: Small: Modeling Multi-Level Connectivity of Brain Dynamics

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: UNIVERSITY OF FLORIDA
Initial Amendment Date: September 8, 2019
Latest Amendment Date: July 21, 2024
Award Number: 1908299
Award Instrument: Standard Grant
Program Manager: Sylvia Spengler
sspengle@nsf.gov
 (703)292-7347
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: October 1, 2019
End Date: December 31, 2024 (Estimated)
Total Intended Award Amount: $500,000.00
Total Awarded Amount to Date: $823,000.00
Funds Obligated to Date: FY 2019 = $500,000.00
FY 2020 = $16,000.00

FY 2021 = $126,000.00

FY 2022 = $126,000.00

FY 2023 = $55,000.00
History of Investigator:
  • Ruogu Fang (Principal Investigator)
    ruogu.fang@bme.ufl.edu
  • Mingzhou Ding (Co-Principal Investigator)
Recipient Sponsored Research Office: University of Florida
1523 UNION RD RM 207
GAINESVILLE
FL  US  32611-1941
(352)392-3516
Sponsor Congressional District: 03
Primary Place of Performance: University of Florida
1 University of Florida
Gainesville
FL  US  32611-2002
Primary Place of Performance
Congressional District:
03
Unique Entity Identifier (UEI): NNFQH1JAPEP3
Parent UEI:
NSF Program(s): IntgStrat Undst Neurl&Cogn Sys,
Info Integration & Informatics
Primary Program Source: 01002021DB NSF RESEARCH & RELATED ACTIVIT
01002223RB NSF RESEARCH & RELATED ACTIVIT

01002223DB NSF RESEARCH & RELATED ACTIVIT

01002122RB NSF RESEARCH & RELATED ACTIVIT

01002324RB NSF RESEARCH & RELATED ACTIVIT

01002122DB NSF RESEARCH & RELATED ACTIVIT

01001920DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7923, 170E, 7364, 019Z, 8091, 8089, 1504, 9251
Program Element Code(s): 862400, 736400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.041, 47.070

ABSTRACT

The temporal dynamics of blood flows through the network of cerebral arteries and veins provides a window into the health of the human brain. Since the brain is vulnerable to disrupted blood supply, brain dynamics serves as a crucial indicator for many kinds of neurological diseases such as stroke, brain cancer, and Alzheimer's disease. Existing efforts at characterizing brain dynamics have predominantly centered on 'isolated' models in which data from single-voxel, single-modality, and single-subject are characterized. However, the brain is a vast network, naturally connected on structural and functional levels, and multimodal imaging provides complementary information on this natural connectivity. Thus, the current isolated models are deemed not capable of offering the platform necessary to enable many of the potential advancements in understanding, diagnosing, and treating neurological and cognitive diseases, leaving a critical gap between the current computational modeling capabilities and the needs in brain dynamics analysis. This project aims to bridge this gap by exploiting multi-scale structural (voxel, vasculature, tissue) connectivity and multi-modal (anatomical, angiography, perfusion) connectivity to develop an integrated connective computational paradigm for characterizing and understanding brain dynamics.

The approach consists of three thrusts: (1) multi-scale structural connectivity modeling to quantify brain dynamics beyond a single voxel; (2) multimodal dynamic dictionary learning for mining hidden complementary information; and (3) multicenter evaluation to assess the efficacy of the proposed models at three nationally renowned healthcare systems. Successful project completion would potentially transform the rapidly evolving field of brain dynamics modeling, facilitate basic neuroscience discovery and enable comprehensive identification of neurovascular diseases. Aiming to broaden its impact this project will also implement educational initiatives to expose students, middle school teachers, and medical professionals to 'CS for All,' to foster interests in STEM and cross-disciplinary careers, and to promote research on the convergence of computer science and computational thinking for brain health and neuromedicine.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 33)
Liu, Peng and Xu, Linsong and Fullerton, Garrett and Xiao, Yao and Nguyen, James-Bond and Li, Zhongyu and Barreto, Izabella and Olguin, Catherine and Fang, Ruogu "PIMA-CT: Physical Model-Aware Cyclic Simulation and Denoising for Ultra-Low-Dose CT Restoration" Frontiers in Radiology , v.2 , 2022 https://doi.org/10.3389/fradi.2022.904601 Citation Details
Liu, Peng and Bo, Ke and Ding, Mingzhou and Fang, Ruogu "Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects" PLOS Computational Biology , v.20 , 2024 https://doi.org/10.1371/journal.pcbi.1011943 Citation Details
Lin, Hely and Fang, Ruogu "Ensemble Machine Learning for Alzheimers disease Classification from Retinal Vasculature" Biomedical Engineering Society Annual Meeting , 2021 Citation Details
Gullett, Joseph M. and Albizu, Alejandro and Fang, Ruogu and Loewenstein, David A. and Duara, Ranjan and Rosselli, Monica and Armstrong, Melissa J. and Rundek, Tatjana and Hausman, Hanna K. and Dekosky, Steven T. and Woods, Adam J. and Cohen, Ronald A. "Baseline Neuroimaging Predicts Decline to Dementia From Amnestic Mild Cognitive Impairment" Frontiers in Aging Neuroscience , v.13 , 2021 https://doi.org/10.3389/fnagi.2021.758298 Citation Details
Fullerton, Garrett and Kato, Simon and Fang, Ruogu "MAGIC: Multitask Automated Generation of Inter-modal CT Perfusion Maps via Generative Adversarial Network" Biomedical Engineering Society Annual Meeting , 2021 Citation Details
Fang, Ruogu and Bai, Lijun and Li, Wen "Editorial: Frontiers of women in brain imaging and brain stimulation" Frontiers in Human Neuroscience , v.17 , 2023 https://doi.org/10.3389/fnhum.2023.1208253 Citation Details
Diaz, Maximillian and Tian, Jianqiao and Fang, Ruogu "Machine Learning for Parkinsons Disease Diagnosis Using Fundus Eye Images" Annual Meeting of Radiology Society of North America (RSNA) , 2020 Citation Details
Cox, Joseph and Liu, Peng and Stolte, Skylar E and Yang, Yunchao and Liu, Kang and See, Kyle B and Ju, Huiwen and Fang, Ruogu "BrainSegFounder: Towards 3D foundation models for neuroimage segmentation" Medical Image Analysis , v.97 , 2024 https://doi.org/10.1016/j.media.2024.103301 Citation Details
Albizu, Alejandro and Fang, Ruogu and Indahlastari, Aprinda and OShea, Andrew and Stolte, Skylar E. and See, Kyle B. and Boutzoukas, Emanuel M. and Kraft, Jessica N. and Nissim, Nicole R. and Woods, Adam J. "Machine learning and individual variability in electric field characteristics predict tDCS treatment response" Brain Stimulation , v.13 , 2020 https://doi.org/10.1016/j.brs.2020.10.001 Citation Details
Albizu, Alejandro and Indahlastari, Aprinda and Huang, Ziqian and Waner, Jori and Stolte, Skylar E. and Fang, Ruogu and Woods, Adam J. "Machine-learning defined precision tDCS for improving cognitive function" Brain Stimulation , v.16 , 2023 https://doi.org/10.1016/j.brs.2023.05.020 Citation Details
Liu, Peng and Tran, Charlie T. and Kong, Bin and Fang, Ruogu "CADA: Multi-scale Collaborative Adversarial Domain Adaptation for unsupervised optic disc and cup segmentation" Neurocomputing , v.469 , 2022 https://doi.org/10.1016/j.neucom.2021.10.076 Citation Details
(Showing: 1 - 10 of 33)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Over the course of this NSF-funded project, we have made substantial advancements in modeling multi-level brain connectivity using cutting-edge artificial intelligence (AI) and machine learning (ML) techniques. Our primary aim has been to develop a novel computational framework that captures brain dynamics through the integration of structural and modality-level neuroimaging data. Through this work, we have achieved notable intellectual merit in developing scalable, interpretable, and clinically relevant computational models for the study of the human brain.

We successfully developed a multi-scale structural connectivity framework that accounts for spatial similarity and temporal correlation across voxel, vasculature, and tissue levels. This has led to improvements in head tissue segmentation using deep neural networks, resulting in enhanced accuracy in the delineation of neuroanatomical structures, especially in aging populations. Our team introduced advanced segmentation models such as DOMINO and DOMINO++ and demonstrated their clinical applicability in neurodegenerative disease assessment.

On the multimodal front, we developed MAGIC, an AI-driven tool that generates contrast-free CT perfusion maps using non-contrast CT images. The tool has been trained on over 13,000 patient scans and evaluated through both quantitative metrics and physician-led subjective analysis. It represents a leap forward in reducing patient risk while maintaining diagnostic accuracy in stroke imaging. These efforts have resulted in multiple publications and ongoing collaborations with external research institutions.

We also made pioneering strides in neuroscience-inspired AI. Notably, we developed and validated models mimicking artificial neuron selectivity and affective conditioning, bridging biological and computational neuroscience. The Visual Cortex-Amygdala model has shown promising results in replicating Pavlovian emotional conditioning, enabling deeper exploration of emotion encoding in AI systems.

Broadening the scope, we developed a large-scale foundation model trained on over 80,000 MRI scans. Leveraging state-of-the-art transformer architectures, the model has outperformed baselines in multiple neuroimaging benchmarks such as BraTS and ADNI, offering a scalable solution for automated analysis of medical images across diverse applications.

Beyond algorithmic advancements, our project had significant broader impacts. We created and curated a multimodal stroke imaging database of over 13,000 de-identified subjects and developed open-source tools to support reproducible research. Our team mentored over 20 students, including undergraduates, master’s, and Ph.D. trainees, many of whom received national recognition, such as the NSF-GRFP, NIH F31, NIH T32, and IEEE NextGen Scholar Awards. Several students were supported through NSF INTERN supplements, promoting industry engagement and translational research experience.

Research outcomes were disseminated through more than 60 publications and presentations at top venues such as MICCAI, RSNA, SfN, BMES, and Brain Stimulation. These efforts have not only pushed the frontier of brain modeling research but also ensured meaningful impact across clinical, educational, and technological domains. As a result, the project has set a strong foundation for next-generation neuroimaging and AI applications in medicine.


Last Modified: 03/28/2025
Modified by: Ruogu Fang

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page