Award Abstract # 1720398
OP: Collaborative Research: Novel Feature-Based, Randomized Methods for Large-Scale Inversion

NSF Org: DMS
Division Of Mathematical Sciences
Recipient: NORTH CAROLINA STATE UNIVERSITY
Initial Amendment Date: May 15, 2017
Latest Amendment Date: May 15, 2017
Award Number: 1720398
Award Instrument: Standard Grant
Program Manager: Leland Jameson
DMS
 Division Of Mathematical Sciences
MPS
 Directorate for Mathematical and Physical Sciences
Start Date: September 1, 2017
End Date: August 31, 2021 (Estimated)
Total Intended Award Amount: $104,942.00
Total Awarded Amount to Date: $104,942.00
Funds Obligated to Date: FY 2017 = $104,942.00
History of Investigator:
  • Arvind Saibaba (Principal Investigator)
    asaibab@ncsu.edu
Recipient Sponsored Research Office: North Carolina State University
2601 WOLF VILLAGE WAY
RALEIGH
NC  US  27695-0001
(919)515-2444
Sponsor Congressional District: 02
Primary Place of Performance: North Carolina State University
2311 Stinson Dr, Campus Box 8205
Raleigh
NC  US  27695-8205
Primary Place of Performance
Congressional District:
02
Unique Entity Identifier (UEI): U3NVH931QJJ3
Parent UEI: U3NVH931QJJ3
NSF Program(s): COMPUTATIONAL MATHEMATICS
Primary Program Source: 01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 8990, 9263
Program Element Code(s): 127100
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.049

ABSTRACT

The desire to form an image of a region of space from externally collected data arises in applications ranging from detecting and characterizing cancers in the body, to quantifying the distribution of water, oil, or subsurface pollutants, and to the timely accurate identification of explosives in crowded venues. The physics associated with signal propagation and sensing in these problems creates substantial computational challenges for transforming raw data into useful information. The research team in this project aims to develop computational methods that greatly reduce the cost of real time imaging by providing improvements in statistical inverse theory, numerical inversion methods, simulation models, and hybrid imaging models. The main thrusts of the project will be tested on imaging applications in medical tomography, environmental remediation, and airport security imaging. The techniques form the basis for addressing analogous problems associated with inversion of optical signals across a wide range of spatial and temporal scales. As part of the project, a modular course will be developed to teach these new methods at the graduate level. The course materials will be made available over the internet.

The large-scale imaging, or inverse, problems addressed by this collaborative team require the minimization of a parameter-dependent function that expresses the misfit of predicted measurements for a candidate image and actual measurement data. The potentially large number of parameters must be minimized over an ever-increasing huge number of measurements, while concurrently some unknown set of the data may be redundant. Detailed images, however, are not always needed for addressing relevant, practical questions and decision making. A combination of computational techniques will be developed to make large-scale parameter-dependent minimization computationally feasible. Furthermore, novel efficient approaches for inferring critical image features will be developed, obviating need for complete reconstruction of an image. The research builds on recent methods that exploit randomization to compute accurate estimates of solutions at greatly reduced computational cost, and on the efficient construction of smaller, approximate, reduced order numerical models that are accurate for relevant sets of parameters, and thus reduce the cost of full simulation of the sensing physics. Probabilistic approaches for inference of critical image features that guide image interpretation and decision making will be developed. The mathematics associated with this approach requires these methods to capitalize on other new tools also under development in this project.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Miller, Scot M. and Saibaba, Arvind K. and Trudeau, Michael E. and Mountain, Marikate E. and Andrews, Arlyn E. "Geostatistical inverse modeling with very large datasets: an example from the Orbiting Carbon Observatory 2 (OCO-2) satellite" Geoscientific Model Development , v.13 , 2020 10.5194/gmd-13-1771-2020 Citation Details
Saibaba, Arvind K. "Randomized Discrete Empirical Interpolation Method for Nonlinear Model Reduction" SIAM Journal on Scientific Computing , v.42 , 2020 10.1137/19M1243270 Citation Details
Saibaba, Arvind K. "Randomized Subspace Iteration: Analysis of Canonical Angles and Unitarily Invariant Norms" SIAM Journal on Matrix Analysis and Applications , v.40 , 2019 10.1137/18M1179432 Citation Details
Saibaba, Arvind K. and Bardsley, Johnathan and Brown, D. Andrew and Alexanderian, Alen "Efficient Marginalization-Based MCMC Methods for Hierarchical Bayesian Inverse Problems" SIAM/ASA Journal on Uncertainty Quantification , v.7 , 2019 10.1137/18M1220625 Citation Details
Saibaba, Arvind K. and Chung, Julianne and Petroske, Katrina "Efficient Krylov subspace methods for uncertainty quantification in large Bayesian linear inverse problems" Numerical Linear Algebra with Applications , v.27 , 2020 https://doi.org/10.1002/nla.2325 Citation Details
Saibaba, Arvind K. and Prasad, Pranjal and de Sturler, Eric and Miller, Eric and Kilmer, Misha E. "Randomized approaches to accelerate MCMC algorithms for Bayesian inverse problems" Journal of Computational Physics , v.440 , 2021 https://doi.org/10.1016/j.jcp.2021.110391 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The desire to form an image of a region of space from externally collected data arises in applications ranging from detecting and characterizing cancers in the body, to quantifying the distribution of water, oil, or subsurface pollutants, and to the timely accurate identification of explosives in crowded venues. The physics associated with signal propagation and sensing in these problems creates substantial computational challenges for transforming raw data into useful information. Across all applications, these problems share a common structure: the availability of limited measurements collected on the boundary or outside of the medium and a physical, or forward, model mapping the unknown properties of the medium onto the data. Given the (often nonlinear) forward model, noisy data, and available computing resources, we need algorithms for the inverse problem that characterize the medium quickly and efficiently.           

In addition to recovering parameters of interest from noisy measurements, in these applications it is also important to quantify the uncertainties associated with the reconstruction of the parameters. To this end, we adopt a probabilistic (i.e. Bayesian) framework that enables this uncertainty quantification. Another important aspect of this project is that in many scenarios---such as identifying a tumor in a patient, a crack in a wing, or a pool of contaminant in the subsurface---detailed pixelwise images are not always needed for addressing relevant, practical questions. This motivated the use of shape-based approaches for estimation of location, size, and shape of objects of interest without the need to construct detailed images. However, computational algorithms for uncertainty quantification in inverse problems suffer from high computational costs that encumber their applicability to practical scenarios. The research in this project builds on recent methods that exploit randomization to compute accurate estimates of solutions at greatly reduced computational cost, and on the efficient construction of smaller, approximate, reduced order numerical models that are accurate for relevant sets of parameters, and thus reduce the cost of full simulation of the sensing physics.

In this project, we developed several efficient algorithms for uncertainty quantification in Bayesian inverse problems, with a particular emphasis on shape-based inverse problems. Our major contributions can be summarized as follows:

 1. Development of randomized methods to reduce the computational cost of likelihood evaluations in Markov Chain Monte Carlo methods (MCMC) for Partial Differential Equation-based Bayesian Inverse Problems.

2. Analysis of randomized algorithms for low-rank approximations. Development of algorithms for nonlinear model reduction in the Discrete Empirical Interpolation Method framework. These two developments are of interest to scientific computing beyond inverse problems. 

3. Development of low-order parametric approaches for shape-based inverse problems.

4. Development of a Bayesian approach for quantifying reconstruction uncertainty in shape-based inverse problems.

5. Development of Krylov subspace methods for uncertainty quantification in linear Bayesian inverse problems.

Additionally, we validated our approaches on model problems from a suite of applications that exemplify the breadth of the proposed approaches: diffuse optical tomography, photoacoustic tomography, atmospheric CO2 monitoring, etc. 

This project also supported several outreach and educational activities such as accessible talks on imaging and its applications to undergraduates and high school teachers, teaching material for a special topics course at North Carolina State University, tutorial on randomized methods at the SIAM CAIMS Joint Annual Meeting 2020. 

 


Last Modified: 12/29/2021
Modified by: Arvind K Saibaba

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page