Award Abstract # 1913039
Collaborative Research: Sparse Optimization in Large Scale Data Processing: A Multiscale Proximity Approach

NSF Org: DMS
Division Of Mathematical Sciences
Recipient: SYRACUSE UNIVERSITY
Initial Amendment Date: June 11, 2019
Latest Amendment Date: June 11, 2019
Award Number: 1913039
Award Instrument: Standard Grant
Program Manager: Yuliya Gorb
ygorb@nsf.gov
 (703)292-2113
DMS
 Division Of Mathematical Sciences
MPS
 Directorate for Mathematical and Physical Sciences
Start Date: July 1, 2019
End Date: June 30, 2023 (Estimated)
Total Intended Award Amount: $125,000.00
Total Awarded Amount to Date: $125,000.00
Funds Obligated to Date: FY 2019 = $125,000.00
History of Investigator:
  • Lixin Shen (Principal Investigator)
    lshen03@syr.edu
Recipient Sponsored Research Office: Syracuse University
900 S CROUSE AVE
SYRACUSE
NY  US  13244-4407
(315)443-2807
Sponsor Congressional District: 22
Primary Place of Performance: Syracuse University
215 Carnegie Hall, Department of
Syracuse
NY  US  13244-1200
Primary Place of Performance
Congressional District:
22
Unique Entity Identifier (UEI): C4BXLBC11LC6
Parent UEI:
NSF Program(s): COMPUTATIONAL MATHEMATICS
Primary Program Source: 01001920DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 9263
Program Element Code(s): 127100
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.049

ABSTRACT

There is an emergent demand in areas of national strategic interest such as information technology, nanotechnology, biotechnology, civil infrastructure and environment for abstracting useful knowledge for decision making or uncovering truth from large-scale data acquired via various means such as sensors and internet. A core issue of these areas is to develop accurate mathematical models, which govern the abstraction process, and to design efficient algorithms that solve the underlying optimization problems for the models. A challenge of the tasks comes from the large-scale nature of given data. This nature requires determining a large number of model parameters and it is computationally expensive. To address this challenge, this project will take advantage of certain intrinsic multiscale structure of given data in modeling so that the resulting models have significantly fewer parameters to be determined. It is also crucial to introduce efficient algorithms for solving the resulting optimization problems for the models, which have intrinsic multiscale structures. The second goal of this proposed research is to provide rigorous training of young mathematicians and computational scientists so that they have the skill sets needed to face the challenges of the big data era through this proposed research and its associated educational components. Outcomes of the proposed research and its educational component will certainly contribute to the Federal strategic interest areas.

This research project addresses several critical issues of processing large-scale data, such as high dimensionality and high noise, through properly choosing structured sparsity promoting non-convex functions in modeling and through synthesizing the multiscale representation of data and using fixed-point equations/inclusions involved the proximity operator in solving the resulting optimization problem. Structured non-convex sparsity promoting functions are proposed to overcome drawbacks of the existing modeling of large-scale data, leading to the design of efficient single-scale proximity algorithms. Multiscale analysis has been developed to efficiently represent data, while how multiscale representation of data is used to improve convergence of the fixed-point proximity algorithm remains unsolved. The proposed multiscale proximity method avoids iterations on the full large-scale of the fixed-point equation/inclusion. Instead, when data are represented in a multiscale analysis, iterations of the multiscale proximity algorithm are conducted only on a (small-scale) lower frequency component of the equation/inclusion (based on a single-scale algorithm), and only one functional evaluation on a (large-scale) high frequency component is required. The multiscale algorithm will preserve accuracy of the single-scale algorithm while accelerating its convergence significantly. This leads to a fast algorithm for solving the fixed-point equation/inclusion involved the proximity operator.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Li, Qia and Shen, Lixin and Zhang, Na and Zou, Junpeng "A proximal algorithm with backtracked extrapolation for a class of structured fractional programming" Applied and computational harmonic analysis , v.56 , 2022 https://doi.org/https://doi.org/10.1016/j.acha.2021.08.004 Citation Details
Li, Qiuwei and Ashley, Ashley and Shen, Lixin and Tang, Gongguo "A super-resolution framework for tensor decomposition" Information and inference , v.2022 , 2022 https://doi.org/https://doi.org/10.1093/imaiai/iaac002 Citation Details
Li, Qiuwei and Prater, Ashley and Shen, Lixin and Tamg, Gongguo "A super-resolution framework for tensor decomposition" Information and inference , v.2022 , 2022 https://doi.org/doi.org/10.1093/imaiai/iaac002 Citation Details
Li, Yan-Ran and Chan, Raymond H.F. and Shen, Lixin and Zhuang, Xiaosheng "Regularization with multilevel non-stationary tight framelets for image restoration" Applied and Computational Harmonic Analysis , v.53 , 2021 https://doi.org/10.1016/J.ACHA.2021.03.003 Citation Details
Li, Yan-ran and Shen, Lixin and Zhuang, Xiaosheng "A tailor-made 3-dimensional directional Haar semi-tight framelet for pMRI reconstruction" Applied and computational harmonic analysis , v.60 , 2022 https://doi.org/https://doi.org/10.1016/j.acha.2022.04.003 Citation Details
Prater-Bennette, Ashley and Shen, Lixin and Tripp, Erin E. "The Proximity Operator of the Log-Sum Penalty" Journal of Scientific Computing , v.93 , 2022 https://doi.org/10.1007/s10915-022-02021-4 Citation Details
Sharma, Pranay and Khanduri, Prashant and Shen, Lixin and Bucci, Donald J. and Varshney, Pramod K. "On Distributed Online Convex Optimization with Sublinear Dynamic Regret and Fit" 2021 55th Asilomar Conference on Signals, Systems, and Computers , 2022 https://doi.org/10.1109/IEEECONF53345.2021.9723285 Citation Details
Shen, Lixin and Suter, Bruce W. and Tripp, Erin E. "Algorithmic versatility of SPF-regularization methods" Analysis and Applications , v.19 , 2021 https://doi.org/10.1142/S0219530520400060 Citation Details
Wu, Tingting and Shen, Lixin and Xu, Yuesheng "Fixed-point proximity algorithms solving an incomplete Fourier transform model for seismic wavefield modeling" Journal of Computational and Applied Mathematics , v.385 , 2021 https://doi.org/10.1016/j.cam.2020.113208 Citation Details
Yang, Hanmei and Li, Jiachang and Shen, Lixin and Lu, Jian "A Convex Variational Model for Restoring SAR Images Corrupted by Multiplicative Noise" Mathematical Problems in Engineering , v.2020 , 2020 https://doi.org/10.1155/2020/1952782 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The outcomes of the project are as follows:

 

  1. A 3D directional Haar semi-tight framelet (3DHSTF) system is constructed and has been successfully used in the realms of medical imaging reconstruction and color image inpainting. The coil images from a parallel magnetic resonance imaging (pMRI) can be stacked as a 3D data matrix. Such matrix has specific properties like unbalanced dimensions, directionality, and embedded coil correlated information.  This 3DHSTF system efficiently capture crucial directional features within each coil image and effectively utilizes the correlated information among different coil images. Numerical experiments have confirmed the efficiency and effectiveness of this system, indicating its potential adoption by the medical imaging reconstruction community. Furthermore, the system has been used for color image inpainting with great success.   
  2. Sparse optimization problems often use a sparsity promoting function (SPF) as a part of their regularization terms. A simple and easily verifiable definition of SPFs was provided. Informally, a SPF must have a distinctive feature, such as a cusp or corner at the origin. A family of nonconvex SPFs are explicitly given. The versality of the SPFs in this family for algorithm design is demonstrated. Other types of SPFs are investigated as well. For example, the log-sum function, which is commonly used in compressive sensing and low-rank optimization, is fully investigated.
  3. The integration of the research proposal on academic progression at Syracuse University. The proposal influenced and enriched courses on sparse optimization, and benefited students directly by giving them the required background to participate in the research. The proposal also supported the advancement of students in their academic pursuits. One female Ph.D. student graduated in the May of 2023, and two others are planning to defend their Ph.D. thesis next year.

 

 


Last Modified: 09/29/2023
Modified by: Lixin Shen

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page