Award Abstract # 1617640
CSR: Small: Energy-efficient Embedded Signal-processing Inference Systems

NSF Org: CNS
Division Of Computer and Network Systems
Recipient: THE TRUSTEES OF PRINCETON UNIVERSITY
Initial Amendment Date: August 8, 2016
Latest Amendment Date: March 26, 2019
Award Number: 1617640
Award Instrument: Standard Grant
Program Manager: Matt Mutka
CNS
 Division Of Computer and Network Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: October 1, 2016
End Date: September 30, 2020 (Estimated)
Total Intended Award Amount: $480,000.00
Total Awarded Amount to Date: $488,000.00
Funds Obligated to Date: FY 2016 = $480,000.00
FY 2019 = $8,000.00
History of Investigator:
  • Niraj Jha (Principal Investigator)
Recipient Sponsored Research Office: Princeton University
1 NASSAU HALL
PRINCETON
NJ  US  08544-2001
(609)258-3090
Sponsor Congressional District: 12
Primary Place of Performance: Princeton University
87 Prospect Avenue, 2nd floor
Princeton
NJ  US  08544-2020
Primary Place of Performance
Congressional District:
12
Unique Entity Identifier (UEI): NJ1YPQXQG7U5
Parent UEI:
NSF Program(s): Special Projects - CNS,
CSR-Computer Systems Research
Primary Program Source: 01001617DB NSF RESEARCH & RELATED ACTIVIT
01001920DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7923, 9251
Program Element Code(s): 171400, 735400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Machine-learning algorithms enable pattern recognition from data that are too complex to model analytically. This pattern recognition is of fundamental importance in diverse domains. These algorithms are becoming an essential part of embedded systems that find use in infrastructure, environmental monitoring, personal health monitoring, energy management, food supply chain, assembly lines, etc. This research has the potential to enable significant advances in such systems by enabling highly energy-efficient on-sensor inference to be performed. With its plans for involving students from underrepresented groups, industrial engagement, outreach to the broader public, and online distribution of tools, it is expected to have a broad impact.

The aim of the proposed work is to explore the energy savings achievable by embedded signal-processing inference systems through random projections. Random projections have previously been employed in the context of compressive sensing to reduce system energy. We have found that when random projections are used to compress Nyquist signals, the compression mechanism is far more robust, while offering the possibility of two orders of magnitude system energy savings. We term this mechanism compressed signal processing. We propose work on bringing this concept to fruition through new methodologies and signal-processing architectures. In addition, we propose the use of genetic programming and error-aware inference to tackle the nonlinear signal-processing problem. We plan extensive evaluations of the system-level energy-accuracy tradeoffs the proposed mechanisms offer.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

H. Yin, Z. Wang, and N. K. Jha "A hierarchical inference model for Internet-of-Things" IEEE Trans. on Multi-Scale Computing Systems , v.4 , 2018
J. Lu, H. Jia, N. Verma, and N. K. Jha "Genetic Programming for Energy-efficient andEnergy-scalable Approximate FeatureComputation in Embedded Inference Systems" IEEE Transactions on Computers , v.67 , 2018
X. Dai, H. Yin, and N. K. Jha "Grow and prune compact, fast, and accurate LSTMs" IEEE Transactions on Computers , v.69 , 2020 10.1109/TC.2019.2954495
X. Dai, H. Yin, and N. K. Jha "NeST: A neural network synthesis tool based on a grow-and-prune paradigm" IEEE Transactions on Computers , v.68 , 2019 10.1109/TC.2019.2914438

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Internet-of-Things (IoT) is beginning to have a wide impact across various sectors of the economy.  Traditionally, data are collected in an IoT system from various sensors and then transmitted to the edge devices and the cloud where machine learning models are trained and used to provide inference. This process, unfortunately, consumes too much energy and bandwidth.  Hence, it is not sustainable.  Recognizing this, researchers have begun to push intelligence downwards from the cloud to edge devices.  Since many edge devices are energy-constrained, this means new approaches to energy-efficient inference need to be developed.  This was the goal of this research project.

The project resulted in several new methodologies in this domain.  Some examples are: energy/memory/latency-efficient neural network synthesis, incremental training of neural networks, introducing hidden layers in the control gates of long short-term memories (LSTMs) to make them more accurate and energy/latency-efficient, augmenting feature space with semantic space data for improving classification accuracy, understanding the physical/mental/emotional states of an individual through wearable medical sensors (WMSs), using WMSs for diabetes diagnosis (both Type I and II) on an edge device, convolutional autoencoder based transfer learning, use of random projections for energy efficiency, using genetic programming for feature computation, etc. These methodologies significantly extend the state-of-the-art in the respective research areas.

Eight PhD students (four females) and nine undergraduate students (two females) were trained in this exciting area of research.  Their work resulted in several journal articles.  The results were disseminated to the wider public through various invited talks. Some of the results have been licensed to a company for commercialization.  The students also did technology transfer through their summer internships at various companies. 


Last Modified: 10/19/2020
Modified by: Niraj K Jha

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page