Award Abstract # 1853374
SHF:Small: Holistic Analysis: integrating the semantics of the world and the code

NSF Org: CCF
Division of Computing and Communication Foundations
Recipient: RECTOR & VISITORS OF THE UNIVERSITY OF VIRGINIA
Initial Amendment Date: December 7, 2018
Latest Amendment Date: December 7, 2018
Award Number: 1853374
Award Instrument: Standard Grant
Program Manager: Sol Greenspan
sgreensp@nsf.gov
 (703)292-7841
CCF
 Division of Computing and Communication Foundations
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: August 1, 2018
End Date: July 31, 2021 (Estimated)
Total Intended Award Amount: $416,001.00
Total Awarded Amount to Date: $416,001.00
Funds Obligated to Date: FY 2017 = $416,001.00
History of Investigator:
  • Sebastian Elbaum (Principal Investigator)
    selbaum@virginia.edu
Recipient Sponsored Research Office: University of Virginia Main Campus
1001 EMMET ST N
CHARLOTTESVILLE
VA  US  22903-4833
(434)924-4270
Sponsor Congressional District: 05
Primary Place of Performance: University of Virginia Main Campus
P.O. BOX 400195
CHARLOTTESVILLE
VA  US  22904-4195
Primary Place of Performance
Congressional District:
05
Unique Entity Identifier (UEI): JJG6HU8PA4S5
Parent UEI:
NSF Program(s): Software & Hardware Foundation
Primary Program Source: 01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7923, 7944, 9150
Program Element Code(s): 779800
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Systems interacting with the physical world (e.g., robots, embedded systems, cyber-physical systems) depend on the interplay of code and the physical environment. Yet, techniques and tools to support quality assurance efforts on such systems typically decouple code from the physical world to simplify the process. This research effort attempts to unlock the potential of reuniting these separate worlds, integrating the rules of the physical world with the logic of code to improve the quality of the systems we build.

The key intellectual challenges of this investigation include: 1) integrating the rules of the physical world into program analysis to help developers identify faults associated with the manipulation of physical units; 2) incorporating physical attributes manifested in code into simulation scenarios so that system designers can better explore the interplay between physical software and potential environments; and 3) inserting spatial reasoning into program analysis to help developers understand and verify how a system may translate and rotate in space over time. These efforts impact research communities by generating artifacts and tools currently lacking at the intersection of the software engineering and robotic communities, preparing several graduate students including those from underrepresented groups, and developing case studies on the faults and failures present in such systems to assist instructors, students, and practitioners to cultivate an informed perspective about the unique challenges these systems bring. The longer, broader aim is to improve the quality of these systems that increasingly affect all aspects of society.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 11)
Hildebrandt, Carl and Elbaum, Sebastian "World-in-the-Loop Simulation for Autonomous Systems Validation" IEEE International Conference on Robotics and Automation , 2021 Citation Details
Hildebrandt, Carl and Elbaum, Sebastian and Bezzo, Nicola and Dwyer, Matthew B. "Feasible and stressful trajectory generation for mobile robots" ISSTA 2020: Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis , 2020 https://doi.org/10.1145/3395363.3397387 Citation Details
Kate, Sayali and Ore, John-Paul and Zhang, Xiangyu and Elbaum, Sebastian and Xu, Zhaogui "Phys: probabilistic physical unit assignment and inconsistency detection" Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering - ESEC/FSE 2018 , 2018 10.1145/3236024.3236035 Citation Details
Ore, John-Paul and Detweiler, Carrick and Elbaum, Sebastian "An Empirical Study on Type Annotations: Accuracy, Speed, and Suggestion Effectiveness" ACM Transactions on Software Engineering and Methodology , v.30 , 2021 https://doi.org/10.1145/3439775 Citation Details
Ore, John-Paul and Detweiler, Carrick and Elbaum, Sebastian "Towards code-aware robotic simulation: vision paper" Proceeding RoSE '18 Proceedings of the 1st International Workshop on Robotics Software Engineering , 2018 10.1145/3196558.3196566 Citation Details
Ore, John-Paul and Elbaum, Sebastian and Detweiler, Carrick and Karkazis, Lambros "Assessing the type annotation burden" Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering , 2018 10.1145/3238147.3238173 Citation Details
Stein, Meriel and Elbaum, Sebastian "Automated Environment Reduction for Debugging Robotic Systems" IEEE International Conference on Robotics and Automation , 2021 Citation Details
Sun, Wei and Xu, Lisong and Elbaum, Sebastian "Scalably Testing Congestion Control Algorithms of Real-World TCP Implementations" Proceedings Article published May 2018 in 2018 IEEE International Conference on Communications (ICC) , 2018 10.1109/ICC.2018.8422949 Citation Details
Trey Woodlief, Sebastian Elbaum "Fuzzing Mobile Robot Environments for Fast Automated Crash Detection" IEEE International Conference on Robotics and Automation , 2021 Citation Details
Vu, Minh and Xu, Lisong and Elbaum, Sebastian and Sun, Wei and Qia, Kevin "Efficient systematic testing of network protocols with temporal uncertain events" Proceedings Article published Apr 2019 in IEEE INFOCOM 2019 - IEEE Conference on Computer Communications , 2019 10.1109/INFOCOM.2019.8737390 Citation Details
Wei Sun, Lisong Xu "Model-Agnostic and Efficient Exploration of Numerical State Space of Real-World TCP Congestion Control Implementations" 16th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2019, , 2019 Citation Details
(Showing: 1 - 10 of 11)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Intellectual Merit. The work conducted under this proposal was among the first to explore the subtle and often loosely specified connection between the code that runs systems that operate in the real world, like robots, and the physical attributes of those systems. It brought attention to the insidious presence of physical inconsistencies in code that drives such robotic systems, that is, code operations on variables that represent physical entities that are not treated according to the semantics of the physical world and can cause unintended behaviors. To address this challenge, this project: 1) quantified the challenges faced by engineers and the impact of current practices, 2) pioneered static analysis approaches to automatically detect physical type inconsistencies in code (in terms of misused dimensions and frames of references) in large bodies of code and also in other software artifacts like configuration and deployment files, and it 3) prototyped some of the first approaches for test case generation and debugging that blend physical robot models (kinematics and dynamics, complex simulated physical environments) and code to generate richer tests to validate robot systems.

 

Broader impact. This project helped prepare multiple graduate and undergraduate students in the development and application of unique techniques to analyze and validate the software that drives robots. Five graduate students (including one that earned a Ph.D. and is now a faculty member) and two undergraduates co-authored over 12 papers that have appeared at the top conferences in both software engineering and robotics venues. This work also resulted in multiple analysis tools and datasets that have been made publicly available. Last, the project insights were instrumental in the development of a new course that blends software engineering and robotics to prepare students to face the unique challenges of the increasingly important multidisciplinary domain of robot system development.

 


Last Modified: 08/03/2021
Modified by: Sebastian G Elbaum

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page