Skip to feedback

Award Abstract # 1854853
Data Mining for Large Data Sets of Shapes Deformations

NSF Org: DMS
Division Of Mathematical Sciences
Recipient: UNIVERSITY OF HOUSTON SYSTEM
Initial Amendment Date: July 16, 2019
Latest Amendment Date: August 25, 2021
Award Number: 1854853
Award Instrument: Continuing Grant
Program Manager: Yong Zeng
yzeng@nsf.gov
 (703)292-7299
DMS
 Division Of Mathematical Sciences
MPS
 Directorate for Mathematical and Physical Sciences
Start Date: August 1, 2019
End Date: July 31, 2023 (Estimated)
Total Intended Award Amount: $405,996.00
Total Awarded Amount to Date: $405,996.00
Funds Obligated to Date: FY 2019 = $133,895.00
FY 2020 = $135,521.00

FY 2021 = $136,580.00
History of Investigator:
  • Robert Azencott (Principal Investigator)
    razencot@math.uh.edu
  • Jiwen He (Co-Principal Investigator)
  • Andreas Mang (Co-Principal Investigator)
Recipient Sponsored Research Office: University of Houston
4300 MARTIN LUTHER KING BLVD
HOUSTON
TX  US  77204-3067
(713)743-5773
Sponsor Congressional District: 18
Primary Place of Performance: University of Houston
TX  US  77204-2015
Primary Place of Performance
Congressional District:
18
Unique Entity Identifier (UEI): QKWEF8XLMTT3
Parent UEI:
NSF Program(s): CDS&E-MSS
Primary Program Source: 01001920DB NSF RESEARCH & RELATED ACTIVIT
01002021DB NSF RESEARCH & RELATED ACTIVIT

01002122DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 9263
Program Element Code(s): 806900
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.049

ABSTRACT

This project aims to reconstruct and quantify the dynamic deformations of soft organ shapes which are routinely observed by clinicians or researchers in medical imaging data. Our mathematical and computational approaches can potentially impact many domains, ranging from computer aided medical diagnosis, to automatic shape recognition in computer vision, as well as automated clustering, classification, and fast retrieval of biomedical image sequences. We will study movies recording dynamics of three dimensional biomedical shapes, for instance in live echo-cardiographic imaging of patients beating hearts. We will quantify shape distortions by computing "elastic distances" between deformable shapes and by large numbers of "strain values" evaluating local deformation of tissues. In turn these deformations characteristics enable the use of artificial neural networks for automatic classification and clustering of deformable shapes.


Our work is motivated by the increasing availability of large databases of movies recording in 3D the dynamic deformations of "soft" shapes, such as human organs. We aim to generate quantified comparison between any pairs of movies recording the dynamic deformations of similar biomedical shapes, such as the mitral valves of cardiology patients. We will use one large seed set of actual echo-cardiographies of mitral valves dynamics to generate a large set of N = 1000 random diffeomorphic 3D surfaces deformations. In the spirit of computational anatomy, for each such movie, we will compute a time dependent diffeomorphic registration of successive frames, and extract an associated detailed strain map. For each pair of movies M1 and M2, after time registration, we will implement diffeomorphic registrations between corresponding key time frames of M1 and M2. This involves the numerical solving of a high dimensional variational calculus problems by innovative fast non-linear optimal control. From all these diffeomorphic registrations, we will extract multiple characteristics of each movie as well as quantitative "similarities" between pairs of movies. At this stage, powerful data mining techniques such as support vector machines and artificial neural networks will become implementable to generate multi-scale clustering as well as classification of shapes deformations. To handle the heavy computing challenges, we will implement highly parallelized computational schemes on remote high power computing resources.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Brunn, Malte and Himthani, Naveen and Biros, George and Mehl, Miriam and Mang, Andreas "Fast GPU 3D diffeomorphic image registration" Journal of Parallel and Distributed Computing , v.149 , 2021 https://doi.org/10.1016/j.jpdc.2020.11.006 Citation Details
Brunn, Malte and Himthani, Naveen and Biros, George and Mehl, Miriam and Mang, Andreas "Multi-Node Multi-GPU Diffeomorphic Image Registration for Large-Scale Imaging Problems" SC20: International Conference for High Performance Computing, Networking, Storage and Analysis , 2020 https://doi.org/10.1109/SC41405.2020.00042 Citation Details
El-Tallawi, K. Carlos and Zhang, Peng and Azencott, Robert and He, Jiwen and Herrera, Elizabeth L. and Xu, Jiaqiong and Chamsi-Pasha, Mohammed and Jacob, Jessen and Lawrie, Gerald M. and Zoghbi, William A. "Valve Strain Quantitation in Normal Mitral Valves and Mitral Prolapse With Variable Degrees of Regurgitation" JACC: Cardiovascular Imaging , v.14 , 2021 https://doi.org/10.1016/j.jcmg.2021.01.006 Citation Details
El-Tallawi, K. Carlos and Zhang, Peng and Azencott, Robert and He, Jiwen and Xu, Jiaqiong and Herrera, Elizabeth L. and Jacob, Jessen and Chamsi-Pasha, Mohammed and Lawrie, Gerald M. and Zoghbi, William A. "Mitral Valve Remodeling and Strain in Secondary Mitral Regurgitation" JACC: Cardiovascular Imaging , v.14 , 2021 https://doi.org/10.1016/j.jcmg.2021.02.004 Citation Details
Himthani, Naveen and Brunn, Malte and Kim, Jae-Youn and Schulte, Miriam and Mang, Andreas and Biros, George "CLAIREParallelized Diffeomorphic Image Registration for Large-Scale Biomedical Imaging Applications" Journal of Imaging , v.8 , 2022 https://doi.org/10.3390/jimaging8090251 Citation Details
Mang, Andreas and Bakas, Spyridon and Subramanian, Shashank and Davatzikos, Christos and Biros, George "Integrated Biophysical Modeling and Image Analysis: Application to Neuro-Oncology" Annual Review of Biomedical Engineering , v.22 , 2020 https://doi.org/10.1146/annurev-bioeng-062117-121105 Citation Details
Mang, Andreas and He, Jiwen and Azencott, Robert "An operator-splitting approach for variational optimal control formulations for diffeomorphic shape matching" Journal of Computational Physics , v.493 , 2023 https://doi.org/10.1016/j.jcp.2023.112463 Citation Details
Sarmadi, Sorena and Winkle, James J. and Alnahhas, Razan N. and Bennett, Matthew R. and Josi, Kreimir and Mang, Andreas and Azencott, Robert "Stochastic Neural Networks for Automatic Cell Tracking in Microscopy Image Sequences of Bacterial Colonies" Mathematical and Computational Applications , v.27 , 2022 https://doi.org/10.3390/mca27020022 Citation Details
Scheufele, Klaudius and Subramanian, Shashank and Mang, Andreas and Biros, George and Mehl, Miriam "Image-Driven Biophysical Tumor Growth Model Calibration" SIAM Journal on Scientific Computing , v.42 , 2020 https://doi.org/10.1137/19M1275280 Citation Details
Zhang, Peng and Mang, Andreas and He, Jiwen and Azencott, Robert and El-Tallawi, K. Carlos and Zoghbi, William A. "Diffeomorphic Shape Matching by Operator Splitting in 3D Cardiology Imaging" Journal of Optimization Theory and Applications , v.188 , 2021 https://doi.org/10.1007/s10957-020-01789-5 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.


This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The study, analysis, recognition, and classification of shapes and shape deformations have numerous applications in computer vision. This includes retrieval and classification of objects in large digital databases or the study of organs in biomedical image sequences. In this project, we focussed on the latter. This area of research is commonly referred to as computational anatomy. Our approaches build upon a rich mathematical framework that allows us to quantify and compare shapes in a Riemannian setting. Numerous research groups worldwide have been working on designing innovative methods to help clinicians diagnose diseases in a consistent way. Our main focus in this project was the automated clustering, classification, and fast retrieval of biomedical image sequences. We have designed and analyzed efficient mathematical methods and numerical approaches, as well as fast hardware-accelerated computational kernels to achieve these goals. This includes the design and implementation of fast algorithms to solve the underlying variational optimization problems. Aside from working on purely mathematical aspects, we have also pushed our methodology to the application. We have tested the discriminatory capabilities of our approach on different medical imaging data, including echo-cardiography of mitral valve dynamics.

Upon completion of the project, we would like to report the following concrete outcomes:

  • We have developed a mathematical framework to classify smooth deformable objects.
  • We have developed a mathematical framework to augment datasets by applying smooth, random diffeomorphic deformations.- We have designed mathematical methods for matching and tracking shapes and deformable objects in (time series) of medical images.
  • We have applied the developed methodology to medical imaging data. We demonstrated that the methodology allows us to discriminate data from healthy from diseased patients.
  • We have designed an operator-splitting algorithm for matching deformable shapes and tested it on clinical data.
  • We have designed fast computational kernels and parallel algorithms that scale on heterogeneous computing architectures.- We have organized several mini-symposia on mathematical and computational methods with application to diffeomorphic image registration, computational anatomy, and diffeomorphic shape matching.
  • We have disseminated this work through presentations and invited talks.
  • We have trained two graduate students and one postdoctoral researcher.

Last Modified: 02/29/2024
Modified by: Andreas Mang

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page