Skip to feedback

Award Abstract # 1527822
AF: Small: THEORETICAL AND ALGORITHMIC FOUNDATIONS OF CONSTRAINED PARTICLE FILTERING

NSF Org: CCF
Division of Computing and Communication Foundations
Recipient: ROWAN UNIVERSITY
Initial Amendment Date: August 4, 2015
Latest Amendment Date: August 4, 2015
Award Number: 1527822
Award Instrument: Standard Grant
Program Manager: A. Funda Ergun
CCF
 Division of Computing and Communication Foundations
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: September 1, 2015
End Date: August 31, 2020 (Estimated)
Total Intended Award Amount: $349,901.00
Total Awarded Amount to Date: $349,901.00
Funds Obligated to Date: FY 2015 = $349,901.00
History of Investigator:
  • Nidhal Bouaynaya (Principal Investigator)
    bouaynaya@rowan.edu
  • Roman Shterenberg (Co-Principal Investigator)
Recipient Sponsored Research Office: Rowan University
201 MULLICA HILL RD
GLASSBORO
NJ  US  08028-1702
(856)256-4057
Sponsor Congressional District: 01
Primary Place of Performance: Rowan University
201 Mullica Hill Road
Glassboro
NJ  US  08028-1701
Primary Place of Performance
Congressional District:
01
Unique Entity Identifier (UEI): DMDEQP66JL85
Parent UEI:
NSF Program(s): Algorithmic Foundations
Primary Program Source: 01001516DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7923, 7926, 9102
Program Element Code(s): 779600
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Many modern technologies (from image stabilizations in a camera, to chemical plants, from power grids to robot navigation) require computer algorithms to track the state of a dynamical system that is both modeled and measured with uncertainty. Particle filters are a technique that track many particles (candidate states) to arrive at a best estimate, which is the mean or average of tracked state. This project considers constraints on the best estimate (and not just individual particles) giving a new way to ensure correctness of the modeling, and safety of the underlying system. Handling constraints in dynamical systems in real time is challenging when either the systems or the constraints, or both, are nonlinear.

The new methods of this project incorporate the constraints into the estimation process itself, avoiding wasted time and guaranteeing convergence in ways that were not possible before. The project also includes integrated research and learning activities, and will serve as a crucial catalyst to the new Ph.D. program at Rowan University by providing its inaugurating class. This research (i) develops a sequential Monte Carlo method that iteratively constructs a set of particles that approximate the posterior density of the state and also satisfy the non-linear constraints; ii) establishes error bounds and convergence properties of this method; iii) derives necessary and sufficient conditions under which traditional approaches admit a bounded estimation error; iv) applies and assesses the theoretical results to solve real-world applications, with linear and non-linear constraints, including control of hand prostheses, estimation of time-varying sparse networks in communications and biology, and emerging applications in the electric power grid.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 21)
Dimah Dera, Ghulam Rasool and Nidhal Bouaynaya "Extended Variational Inference for Propagating Uncertainty in Convolutional Neural Networks" IEEE 29th International Workshop on Machine Learning for Signal Processing (MLSP) , 2019 , p.1 doi: 10.1109/MLSP.2019.8918747
Dimah Dera, Ghulam Rasool and Nidhal Bouaynaya "Extended Variational Inference for Propagating Uncertainty in Convolutional Neural Networks" IEEE International Workshop on Machine Learning For Signal Processing , 2019 , p.pp. 1-6 doi: 10.1109/MLSP.2019.8918747
Dimah Dera, Ghulam Rasool, Nidhal C. Bouaynaya, Adam Eicheny, Stephen Shankoy, Jeff Cammeratay and Sanipa Arnold "Bayes-SAR Net: Robust SAR Image Classification with Uncertainty Estimation Using Bayesian Convolutional Neural Network" IEEE International Radar Conference (RADAR) , 2020 , p.362 doi: 10.1109/RADAR42522.2020.9114737.
Giuseppina Carannante, Dimah Dera, Ghulam Rasool and Nidhal C. Bouaynaya "Self-Compression in Bayesian Neural Networks" IEEE 30th International Workshop on Machine Learning for Signal Processing (MLSP) , 2020 , p.1 doi: 10.1109/MLSP49062.2020.9231550.
Giuseppina Carannante, Dimah Dera, Ghulam Rasool, Nidhal C. Bouaynaya and Lyudmila Mihaylova "Robust Learning via Ensemble Density Propagation in Deep Neural Networks" IEEE 30th International Workshop on Machine Learning for Signal Processing (MLSP) , 2020 , p.1 doi: 10.1109/MLSP49062.2020.9231635.
Gregory Ditzler, Nidhal Carla Bouaynaya and Roman Shterenberg "AKRON: An Algorithm for Approximating Sparse Kernel Reconstructions" Signal Processing , v.144 , 2018 , p.265 https://doi.org/10.1016/j.sigpro.2017.10.020
Gregory Ditzler, Nidhal Carla Bouaynaya and Roman Shterenberg "AKRON: An Algorithm for Approximating Sparse Kernel Reconstructions" Signal Processing , v.144 , 2018 https://doi.org/10.1016/j.sigpro.2017.10.020
Gregory Ditzler, Nidhal Carla Bouaynaya, Roman Shterenberg and Hassan M. Fathallah-Shaykh "Approximate Kernel Reconstruction for Time-Varying Networks" BioData Mining , v.12 , 2019 https://doi.org/10.1186/s13040-019-0192-1
Gregory Ditzler, Nidhal Carla Bouaynaya, Roman Shterenberg and Hassan M. Fathallah-Shaykh "Approximate Kernel Reconstruction for Time-Varying Networks" BioData Mining , 2019 https://doi.org/10.1186/s13040-019-0192-1
Nesrine Amor, Ghulam Rasool, Nidhal Carla Bouaynaya and Roman Shterenberg "Hand Movement Discrimination Using ParticleFilters" The IEEE Signal Processing in Medicine and Biology Symposium , 2019 10.1109/SPMB.2018.8615592
Nesrine Amor, Ghulam Rasool, Nidhal C. Bouaynaya and Roman Shterenberg "Constrained Particle Filtering for Movement Identification in Forearm Prosthesis" Signal Processing , v.161 , 2019 , p.25-35 https://doi.org/10.1016/j.sigpro.2019.03.012
(Showing: 1 - 10 of 21)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Particle filter technology is state-of-the-art in tracking moving objects that follow complex dynamics in noisy and uncertain environments. The military uses it for radar tracking. It is used in video monitoring for surveillance, security and traffic control. It has also been used for global positioning of robots. The power and wide applicability of this technology stem from its simple implementation that enfolds a mathematical foundation with established optimal properties of convergence and locking into the target. However, these mathematical guarantees fail to hold when the moving target obeys additional constraints that are imposed by the environment or the underlying dynamics of the system. This research established the mathematics of the particle filter technology for tracking moving targets under additional (stress) constraints.

In addition, we collaborated with several institutions to evaluate this new technology in several applications, including prosthetic devices, brain source imaging, molecular networks and machine learning under uncertainty. Specifically, we collaborated with the Rehabilitation Institute of Chicago to address the problem of movement identification for the forearm prosthesis from Electromyogram (EMG) data. EMG provides an insight into the neural processes taking place in the central nervous system (CNS) for planning and execution of voluntary tasks. The CNS generates, coordinates, controls and executes voluntary movements in a highly complex manner, where the neural drive and muscle activations are intertwined in a highly nonlinear fashion. We took these nonlinearities and constraints into account, producing more realistic models of the neural drive-myoelectric map and leading to improved performance on neuromuscular models and actual prosthesis devices.

This project was integrated into the curriculum through the Engineering Clinic Program at Rowan University, which provides a unique mechanism for involving undergraduate students in research. An engineering clinic group of Juniors and Seniors participated in the Idea Challenge sponsored by Rowan Innovation Venture Fund & the Center for Innovation & Entrepreneurship. They won 2nd place for “Smart Bionics”, which aims at controlling prosthetic arms. This cross-disciplinary clinic became very popular with many engineering students (electrical, computer, biomedical and mechanical) requesting it for subsequent academic years. A total of 40 undergraduate students participated in this Clinic project; some of them joined the PhD Program in Engineering after graduation.

This research took an international dimension through a collaboration with The University of Aveiro, Portugal, and the University of Sheffield, UK, on the problem of dynamic Electroencephalography (EEG) brain source localization during execution of multisensory activities. In dynamic EEG source localization, the source brains, also called dipoles, are not stationary but move in the brain depending on the activity being performed. By constraining their movement to relevant areas in the brain, we showed that we can improve the tracking accuracy of brain dipoles during a continuum of activities.

With the University of Arizona, we introduced a new approach to tracking sparse molecular networks, which evolve over time in response to cellular development and environmental changes. Understanding the dynamical behavior of living cells from their complex genomic regulatory networks is a challenge posed in systems biology; yet it is one of critical importance (i.e., morphogenesis). While investigating the problem of tracking dynamic networks under sparsity constraints, we revisited the framework of compressive sensing, which aims at exact reconstruction of a signal from a limited number of measurements. The proposed technology yields significantly smaller errors than current methods. We inferred the wing muscle gene regulatory network of the Drosophila Melanogaster (fruit fly), during four developmental phases of its life cycle, and successfully identified all seven known interactions reported in Flybase.

This grant was instrumental in building our entrepreneurship activities. We applied to an NSF I-Corps supplement through this project to gain skills in entrepreneurship through training in customer discovery and guidance from established entrepreneurs. This I-Corps led to an NIH SBIR Phase I grant in September 2020.

This project funded some of the inaugurating PhD students to the new PhD in Engineering Program. Two women PhD students, Ms. Nesrine Amor and Ms. Dimah Dera, were directly funded by this grant.  Ms. Amor is an exchange student from the National Superior School of Engineers of Tunis, Tunisia. She graduated in May 2018 and is now a Research Fellow with the Technical University of Liberec in Czech Republic. Ms. Dera graduated in May 2020 and will be joining the Department of Electrical and Computer Engineering at the University of Texas Rio Grande Valley as a Tenure-Track Assistant Professor starting August 2021. A 3rd woman PhD student (Giuseppina Carannante) is currently working on the extension of this framework for propagating uncertainty in machine learning systems to enhance their reliability and trustworthiness.

The results were disseminated through 5 journal publications, 7 peer reviewed conference publication, including 1 Best Paper Award, as well as invited talks at international institutions, Government Labs, and industry, including The Federal Aviation Administration, Lockheed Martin, and the University of Sheffield, UK.

 


Last Modified: 05/13/2021
Modified by: Nidhal Bouaynaya

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page