Award Abstract # 1823230
CRI: CI-New: Collaborative Research: Extensible, Software Enabled Unmanned Aerial Vehicles

NSF Org: CNS
Division Of Computer and Network Systems
Recipient: THE RESEARCH FOUNDATION FOR THE STATE UNIVERSITY OF NEW YORK
Initial Amendment Date: September 4, 2018
Latest Amendment Date: August 7, 2020
Award Number: 1823230
Award Instrument: Continuing Grant
Program Manager: Marilyn McClure
mmcclure@nsf.gov
 (703)292-5197
CNS
 Division Of Computer and Network Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: October 1, 2018
End Date: September 30, 2022 (Estimated)
Total Intended Award Amount: $550,949.00
Total Awarded Amount to Date: $550,949.00
Funds Obligated to Date: FY 2018 = $328,844.00
FY 2019 = $97,846.00

FY 2020 = $124,259.00
History of Investigator:
  • Lukasz Ziarek (Principal Investigator)
    lziarek@buffalo.edu
  • Karthik Dantu (Co-Principal Investigator)
Recipient Sponsored Research Office: SUNY at Buffalo
520 LEE ENTRANCE STE 211
AMHERST
NY  US  14228-2577
(716)645-2634
Sponsor Congressional District: 26
Primary Place of Performance: SUNY at Buffalo
338E Davis Hall
Buffalo
NY  US  14260-2500
Primary Place of Performance
Congressional District:
26
Unique Entity Identifier (UEI): LMCJKRFW5R81
Parent UEI: GMZUKXFDJMA9
NSF Program(s): CSR-Computer Systems Research,
CCRI-CISE Cmnty Rsrch Infrstrc
Primary Program Source: 01001819DB NSF RESEARCH & RELATED ACTIVIT
01001920DB NSF RESEARCH & RELATED ACTIVIT

01002021DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7354, 7359
Program Element Code(s): 735400, 735900
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Unmanned aerial vehicles (UAVs) are an emerging computing platform increasingly becoming common in our society. Unfortunately, most UAV systems today are either proprietary, or specific to goals of aviation and robotic missions. This project will develop an open-source and extensible software infrastructure for UAVs to promote research and education of this exciting technology.

The proposal will result in an infrastructure to allow for extensible UAV software design across the computing stack, spanning operating systems (OS), virtual machines (VM), compilers, programming languages, and applications. This significantly shifts the focus of state of the art of UAV software where refined support is limited to hardware drivers and robotics control, OS/VM support is primitive, and high-level Application Programming Interface is minimal. The resulting infrastructure will promote whole-stack extensibility, portability, resource awareness, and application friendliness of UAV systems. The infrastructure will enable researchers from non- UAV specific domains to conduct research on the platform.

The infrastructure will impact researchers spanning areas of avionics, robotics, real-time systems, programming languages, and software engineering. Other beneficiaries of the proposed infrastructure include students and UAV users. The technologies developed under this award will provide training and research opportunities for Ph.D. students, master's students, and advanced undergraduates in UAV education. UAVs, robotics, and aviation are interesting and exciting to k-12 students. The artifacts from this project will be tailored for student outreach.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Ali, Ali J. and Kouroshli, Marziye and Semenova, Sofiya and Hashemifar, Zakieh Sadat and Ko, Steven Y. and Dantu, Karthik "Edge-SLAM: Edge-Assisted Visual Simultaneous Localization and Mapping" ACM Transactions on Embedded Computing Systems , v.22 , 2023 https://doi.org/10.1145/3561972 Citation Details
Czerniejewski, Adam and Burns, John Henry and Ghanei, Farshad and Dantu, Karthik and Liu, Yu David and Ziarek, Lukasz "JCopter: Reliable UAV Software Through Managed Languages" 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2021 https://doi.org/10.1109/IROS51168.2021.9636617 Citation Details
Liang, Xiaozhou and Burns, John Henry and Sanchez, Joseph and Dantu, Karthik and Ziarek, Lukasz and Liu, Yu David "Understanding Bounding Functions in Safety-Critical UAV Software" 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) , 2021 https://doi.org/10.1109/ICSE43902.2021.00119 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

This proposal developed a Java-based, extensible, and adaptable software infrastructure for Unmanned Aerial Vehicles (UAVs). Traditionally known for their military applications, UAVs have recently emerged as a promising platform for civilian tasks, such as merchandise delivery, traffic control, news reporting, natural disaster management, mobile social networks, and Internet connectivity in third-world countries. Current UAV systems are programmed in low level languages, require separate hardware for safely deploying payload applications, require low-level system changes to specify adaptive behavior, and are not easily accessible to non domain experts. 

Our developed infrastructure is Java-based, modular, extensible, and accessible. It supports many types of Virtual Machines (VMs), including traditional, real-time, and multi-VMs, two types of flight controllers, two flight simulators, and off-the-shelf commodity hardware. This modularity allows for the specialization of UAV deployments in both simulation and real-world flight.  Time and memory safety afforded by our infrastructure allows for deploying off-the-shelf payload applications on the same hardware, while preserving the integrity of the flight controller. In addition to the core UAV system, this proposal developed a domain specific, declarative programming language for specifying adaptive behavior for UAVs. Our domain specific language provides extensibility for our system, by allowing programmers to develop dynamic flight plans by specifying the UAV?s reactions to environmental factors. The combination of a Java based flight control, support for payload applications, coupled with a declarative programming language for specifying adaptive behavior, provides an accessible platform for developing complex and dynamic UAV systems for non experts. The infrastructure has been validated experimentally using both simulated and real-world flights. This proposal has resulted in the training and development of six Ph.D. students and four masters students as well as providing in-class educational opportunities for both undergraduate and masters students to program UAV systems.

 

 


Last Modified: 11/30/2022
Modified by: Lukasz Ziarek

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page