Award Abstract # 1918450
FMitF: Track II: Hybrid and Dynamical Systems Verification on the CPS-VO

NSF Org: CCF
Division of Computing and Communication Foundations
Recipient: VANDERBILT UNIVERSITY
Initial Amendment Date: July 29, 2019
Latest Amendment Date: December 7, 2020
Award Number: 1918450
Award Instrument: Standard Grant
Program Manager: Sandip Roy
CCF
 Division of Computing and Communication Foundations
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: October 1, 2019
End Date: March 31, 2022 (Estimated)
Total Intended Award Amount: $98,311.00
Total Awarded Amount to Date: $98,311.00
Funds Obligated to Date: FY 2019 = $98,311.00
History of Investigator:
  • Taylor Johnson (Principal Investigator)
    taylor.johnson@gmail.com
  • Joel Rosenfeld (Former Co-Principal Investigator)
Recipient Sponsored Research Office: Vanderbilt University
110 21ST AVE S
NASHVILLE
TN  US  37203-2416
(615)322-2631
Sponsor Congressional District: 05
Primary Place of Performance: Vanderbilt University
1025 16th Avenue S. Suite 102
Nashville
TN  US  37212-2328
Primary Place of Performance
Congressional District:
05
Unique Entity Identifier (UEI): GTNBNWXJ12D5
Parent UEI: K9AHBDTKCB55
NSF Program(s): FMitF: Formal Methods in the F,
CPS-Cyber-Physical Systems
Primary Program Source: 01001920DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 062Z, 7918, 8206
Program Element Code(s): 094Y00, 791800
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

This project aims to transition recent research results that automate portions of the verification process of Cyber-Physical Systems into broader practice, particularly with industrial and student users. Cyber-physical systems (CPS) are networked embedded computing systems coupled with physics, such as in motor vehicles, aircraft, medical devices, and the electrical grid. Due to their frequent use in safety-critical scenarios where significant losses may be incurred, such as of human life or monetarily, the engineering process for such systems devotes vast resources to the process of verification to ensure these systems meet their requirements. The approach builds upon recent successes in the hybrid systems verification competition (ARCH-COMP) hosted in the past three years, in which several dozen hybrid systems verification tools have competed across several problem and system categories.

To achieve the transition of verification research results for CPS models into broader practice, this project develops a cloud-based framework to interface with and execute state-of-the-art formal verification software tools from the hybrid and dynamical systems verification community using NSF's CPS Virtual Organization (CPS-VO). The project extends the Design Studio and Tool Integration frameworks for the CPS-VO, to provide an easy-to-use interface for these verification tools. It also serves as a repository for housing executable versions of the tools and benchmarks, plus facilitating repeatability evaluations for ARCH-COMP through a distributed, cloud-based execution architecture. The core technology upon which the tool is built is the hybrid systems model source transformation and translation (HyST) software tool, which performs semantics-preserving translation between state-of-the-art hybrid systems verification tools.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Bao, Tianshu and Jia, Xiaowei and Zwart, Jacob and Sadler, Jeffrey and Appling, Alison and Oliver, Samantha and Johnson, Taylor T. "Partial Differential Equation Driven Dynamic Graph Networks for Predicting Stream Water Temperature" 2021 IEEE International Conference on Data Mining (ICDM) , 2021 https://doi.org/10.1109/ICDM51629.2021.00011 Citation Details
Hamilton, Nathaniel and Musau, Patrick and Lopez, Diego Manzanas and Johnson, Taylor T. "Zero-Shot Policy Transfer in Autonomous Racing: Reinforcement Learning vs Imitation Learning" 2022 IEEE International Conference on Assured Autonomy (ICAA) , 2022 https://doi.org/10.1109/ICAA52185.2022.00011 Citation Details
Johnson, Taylor T "ARCH-COMP20 Repeatability Evaluation Report" EPiC Series in Computing , v.74 , 2020 https://doi.org/10.29007/8dp4 Citation Details
Johnson, Taylor T. and Manzanas Lopez, Diego and Benet, Luis and Forets, Marcelo and Guadalupe, Sebastián and Schilling, Christian and Ivanov, Radoslav and Carpenter, Taylor J. and Weimer, James and Lee, Insup "ARCH-COMP21 Category Report: Artificial Intelligence and Neural Network Control Systems (AINNCS) for Continuous and Hybrid Systems Plants" EPiC Series in Computing , v.80 , 2021 https://doi.org/10.29007/kfk9 Citation Details
Johnson, Taylor T and Manzanas Lopez, Diego and Musau, Patrick and Tran, Hoang-Dung and Botoeva, Elena and Leofante, Francesco and Maleki, Amir and Sidrane, Chelsea and Fan, Jiameng and Huang, Chao "ARCH-COMP20 Category Report: Artificial Intelligence and Neural Network Control Systems (AINNCS) for Continuous and Hybrid Systems Plants" EPiC Series in Computing , v.74 , 2020 https://doi.org/10.29007/9xgv Citation Details
Manzanas Lopez, Diego and Johnson, Taylor and Tran, Hoang-Dung and Bak, Stanley and Chen, Xin and Hobbs, Kerianne L. "Verification of Neural Network Compression of ACAS Xu Lookup Tables with Star Set Reachability" AIAA Scitech 2021 Forum , 2021 https://doi.org/10.2514/6.2021-0995 Citation Details
Manzanas Lopez, Diego and Johnson, Taylor T. and Bak, Stanley and Tran, Hoang-Dung and Hobbs, Kerianne L. "Evaluation of Neural Network Verification Methods for Air-to-Air Collision Avoidance" Journal of Air Transportation , v.31 , 2023 https://doi.org/10.2514/1.D0255 Citation Details
Musau, Patrick and Hamilton, Nathaniel and Lopez, Diego Manzanas and Robinette, Preston and Johnson, Taylor T. "On Using Real-Time Reachability for the Safety Assurance of Machine Learning Controllers" 2022 IEEE International Conference on Assured Autonomy (ICAA) , 2022 https://doi.org/10.1109/ICAA52185.2022.00010 Citation Details
Taylor T Johnson "ARCH-COMP21 Repeatability Evaluation Report" 8th International Workshop on Applied Verification of Continuous and Hybrid Systems (ARCH21) , v.81 , 2021 https://doi.org/https://doi.org/10.29007/zqdx Citation Details
Xiaodong Yang, Omar Ali "A Framework for Identification and Validation of Affine Hybrid Automata from Input-Output Traces" ACM Transactions on cyber-physical systems , v.6 , 2022 https://doi.org/https://doi.org/10.1145/3470455 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The outcomes of this project are intellectual merit contributions through publications and other research products, broader impacts to the research community through competition and event organization, and the broader potential for future societal impact in domains dependent upon safety-critical cyber-physical systems (CPS), such as robotics. On intellectual merit, this project has helped lead to an understanding of what are the most effective verification approaches for CPS, enabled by the underlying hybrid systems source transformation and translation (HyST) technology. This technology has eased comparisons between state-of-the-art verification approaches in the hybrid systems domain by easing model interchange and comparison of results, helping to better illustrate which verification approaches may be most effective for different classes of systems, such as those with linear versus nonlinear dynamics. The project has also led to improvements in usability of these tools through the graphical interface to HyST and hybrid systems model checkers developed within WebGME.

For broader impacts, this project enabled the repeatability evaluation for the hybrid systems verification competition (ARCH-COMP), and the broader usage of the HyST technology by the community through the interactive design studio hosted on the CPS Virtual Organization (CPS-VO). These activities formed the basis of broader research community organizational activities, specifically the Artificial Intelligence and Neural Network Control Systems (AINNCS) category of ARCH-COMP, and the Verification of Neural Networks Competition (VNN-COMP), each of which have had broad participation by the relevant research communities. Altogether, the outcomes of the project may improve safety and reliability of systems in safety-critical domains.


Last Modified: 07/28/2022
Modified by: Taylor T Johnson

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page