Award Abstract # 1724331
S&AS: FND: Cognitive and Reflective Monitoring Systems for Urban Environments

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: UNIVERSITY OF CALIFORNIA IRVINE
Initial Amendment Date: August 17, 2017
Latest Amendment Date: August 17, 2017
Award Number: 1724331
Award Instrument: Standard Grant
Program Manager: David Corman
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: January 1, 2018
End Date: December 31, 2021 (Estimated)
Total Intended Award Amount: $500,000.00
Total Awarded Amount to Date: $500,000.00
Funds Obligated to Date: FY 2017 = $500,000.00
History of Investigator:
  • Marco Levorato (Principal Investigator)
    levorato@uci.edu
  • Solmaz Kia (Co-Principal Investigator)
Recipient Sponsored Research Office: University of California-Irvine
160 ALDRICH HALL
IRVINE
CA  US  92697-0001
(949)824-7295
Sponsor Congressional District: 47
Primary Place of Performance: University of California-Irvine
3206 Bren Hall
Irvine
CA  US  92697-3425
Primary Place of Performance
Congressional District:
47
Unique Entity Identifier (UEI): MJC5FCYQTPE6
Parent UEI: MJC5FCYQTPE6
NSF Program(s): S&AS - Smart & Autonomous Syst
Primary Program Source: 01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 046Z
Program Element Code(s): 039Y00
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

As the urban population grows, a pressing need arises for technological solutions capable of making city systems more effective and efficient. Many of the envisioned Smart City systems, such as intelligent transportation, and vehicular and security networks, require having access to a wide spectrum of online/offline data that characterizes the state of operation and the events taking place throughout the city. However, the practical deployment of city-wide sensor and processing systems faces several challenges, including financial cost, availability of network resources to transport large amounts of data with stringent quality of service requirements, and coexistence with other existing services using the same resources. This project's objective is to develop a cognitive and reflective network of mobile sensors capable of minimizing their impact on critical city communication resources using a notion of intelligence permeating the layered communication, processing, and sensing infrastructure that characterizes urban environments. The successful realization of this project will contribute significantly to fulfilling the promise of real-time Urban Internet of Things (IoT) systems in the context of limitations imposed by technology and cost. The project also includes a multi-tiered education, mentoring, and outreach plan to train the next generation of IoT systems designer and professionals.


The proposed system enhances the ability of individual sensors to make navigation decisions with an intelligent layered architecture capable of providing real-time feedback on the usefulness of their produced data from the perspective of a global computational objective. The real-time adaptation process, then, is expressed over the layers of the architecture, where the agents dynamically learn utility models and control at different geographical and temporal scales. These utility models are used to orchestrate the mobile sensor's navigation within the city to enable detection and monitoring of events and dynamic processes. The outcome of this project is the first architecture of this kind where cognition and intelligence spread across scales of an urban sensing, communications, and processing infrastructure. Furthermore, the system envisioned in this project represents one of the few and most innovative examples of edge computing architecture, where the availability of low-delay processing is used to optimize the system's operations. The construction of a framework for such a complex layered scenario, which involves devices with different sensing and computation capabilities, presents inherent technical challenges which will be addressed by producing several innovations in the area of distributed and hierarchical learning and robot navigation

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 30)
Alsoliman, A. and Levorato, M and Chen, A. "Vision-Based Two-Factor Authentication & Localization Scheme for Autonomous Vehicles" Third International Workshop on Automotive and Autonomous Vehicle Security (AutoSec) 2021 (part of NDSS) , 2021 https://doi.org/ Citation Details
Alsoliman, Anas and Rigoni, Giulio and Levorato, Marco and Pinotti, Cristina and Tippenhauer, Nils Ole and Conti, Mauro "COTS Drone Detection using Video Streaming Characteristics" :ICDCN '21: International Conference on Distributed Computing and Networking 2021 , 2020 https://doi.org/10.1145/3427796.3428480 Citation Details
Baidya, Sabur and Levorato, Marco "On the Feasibility of Infrastructure Assistance to Autonomous UAV Systems" 16th International Conference on Distributed Computing in Sensor Systems (DCOSS) , 2020 https://doi.org/10.1109/DCOSS49796.2020.00054 Citation Details
Baidya, Sabur and Shaikh, Zoheb and Levorato, Marco "FlyNetSim: An Open Source Synchronized UAV Network Simulator based on ns-3 and Ardupilot" 21st ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems , 2018 10.1145/3242102.3242118 Citation Details
Burago, Igor and Callegaro, Davide and Levorato, Marco and Singh, Sameer "Intelligent data filtering in constrained IoT systems" 51st Asilomar Conference on Signals, Systems, and Computers , 2017 10.1109/ACSSC.2017.8335485 Citation Details
Burago, Igor and Levorato, Marco "Cloud-Assisted On-Sensor Observation Classification in Latency-Impeded IoT Systems" 2019 IEEE International Symposium on Information Theory (ISIT) , 2019 10.1109/ISIT.2019.8849760 Citation Details
Burago, Igor and Levorato, Marco "Randomized Edge-Assisted On-Sensor Information Selection for Bandwidth-Constrained Systems" 2018 52nd Asilomar Conference on Signals, Systems, and Computers , 2018 10.1109/ACSSC.2018.8645182 Citation Details
Callegaro, D. and Baidya, S. and Ramachandran, G. and Krishnamachari, B. and Levorato, M. "Information Autonomy: Self-Adaptive Information Management for Edge-Assisted Autonomous UAV Systems" IEEE Military Communications Conference (IEEE Milcom 2019) , 2019 Citation Details
Callegaro, Davide and Baidya, Sabur and Levorato, Marco "A Measurement Study on Edge Computing for Autonomous UAVs" Proceedings of the ACM SIGCOMM 2019 Workshop on Mobile AirGround Edge Computing, Systems, Networks, and Applications , 2019 10.1145/3341568.3342109 Citation Details
Callegaro, Davide and Baidya, Sabur and Levorato, Marco "Dynamic Distributed Computing for Infrastructure-Assisted Autonomous UAVs" IEEE International Conference on Communications (ICC) , 2020 https://doi.org/10.1109/ICC40277.2020.9148986 Citation Details
Callegaro, Davide and Levorato, Marco "Optimal Computation Offloading in Edge-Assisted UAV Systems" 2018 IEEE Global Communications Conference (GLOBECOM) , 2018 10.1109/GLOCOM.2018.8648099 Citation Details
(Showing: 1 - 10 of 30)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

This project made fundamental contributions toward making multi-layered communication and computing infrastructures capable of autonomously deciding how to acquire, transport and process information to accomplish a global task. Such a goal can only be achieved by introducing algorithms across the logical layers of the system that can adapt the overall information management strategy based on past experience and current state. The project attacked different aspects of the problem. First, we built a novel class of collaborative and adaptive classification algorithms for edge computing. Using a stochastic control loop between a mobile device and the edge server, our algorithms can autonomously adapt the parameters of a simple classifier deployed at a mobile device to follow the semantic state of the data, expressed as the sample distribution. The approach we developed allows computationally weak layers of the system to perform analysis and filtering of complex data. 

Within the project, an experimental platform was built that included multiple interconnected autonomous Unmanned Aerial Vehicles (UAV) and ground edge servers. We developed a middleware allowing experience-based control of how information is processed to meet data analysis delay constraints imposed by real-time applications controlling the navigation of the UAVs based on visual input. Within this context, we developed the concept of distributed redundant task allocation, where the distribution of the computing tasks to one or multiple servers is determined at  fine temporal granularity by deep reinforcement learning agents deployed at the UAV. Decision making is based on a broad definition of observable state, where state variables span across application, network and telemetry blocks. The middleware, datasets and models were all released as open source tools.

In order to facilitate the offloading of complex data analysis algorithms, in this project we introduced the concept of split Deep Neural Networks (DNN) where the architecture of the models is modified to embed an encoder-decoder structure realizing a supervised form of in-model compression. Specialized DNN training approaches were developed to maximize the compression gain, and thus minimize system load and communication time, while resulting in minimal degradation of task performance. The models and code were released as open source tools to the research community.

The project also made several technical contributions to sensor placement and target tracking by developing new algorithms based on dynamic active average consensus and distributed submodular maximization. These results allow efficient and effective distributed deployments for a group of mobile agents providing a service for a dense set of targets with limited knowledge.

The project supported workforce training at all levels, including Ph.D., master and undergraduate students from minorities. The interdisciplinary nature of the project attracted considerable attention from undergraduate students, who were involved in many research tasks. We expect that these activities will enhance the curriculum of the students and their probability of being admitted to prestigious master and Ph.D. programs. We estimated that more than 30 undergraduate students were involved in project-related tasks. The project resulted in many impactful publications across different communities.


 

 


Last Modified: 05/27/2022
Modified by: Marco Levorato

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page