
NSF Org: |
CNS Division Of Computer and Network Systems |
Recipient: |
|
Initial Amendment Date: | September 16, 2019 |
Latest Amendment Date: | July 8, 2021 |
Award Number: | 1932033 |
Award Instrument: | Standard Grant |
Program Manager: |
Marilyn McClure
mmcclure@nsf.gov (703)292-5197 CNS Division Of Computer and Network Systems CSE Directorate for Computer and Information Science and Engineering |
Start Date: | October 1, 2019 |
End Date: | September 30, 2023 (Estimated) |
Total Intended Award Amount: | $649,982.00 |
Total Awarded Amount to Date: | $701,982.00 |
Funds Obligated to Date: |
FY 2020 = $16,000.00 FY 2021 = $36,000.00 |
History of Investigator: |
|
Recipient Sponsored Research Office: |
1350 BEARDSHEAR HALL AMES IA US 50011-2103 (515)294-5225 |
Sponsor Congressional District: |
|
Primary Place of Performance: |
2529 Union Drive Ames IA US 50011-2030 |
Primary Place of
Performance Congressional District: |
|
Unique Entity Identifier (UEI): |
|
Parent UEI: |
|
NSF Program(s): |
Special Projects - CNS, CSR-Computer Systems Research, CPS-Cyber-Physical Systems |
Primary Program Source: |
01002021DB NSF RESEARCH & RELATED ACTIVIT 01002122DB NSF RESEARCH & RELATED ACTIVIT |
Program Reference Code(s): |
|
Program Element Code(s): |
|
Award Agency Code: | 4900 |
Fund Agency Code: | 4900 |
Assistance Listing Number(s): | 47.070 |
ABSTRACT
Most preK-12 school districts in the United States dedicate significant resources to safeguard against active shooters, e.g., school hardening, community planning, identification of suspicious behavior, crisis training for law enforcement, and training exercises for students, teachers, and all school personnel. However, when such an active-shooting event is in progress, only vague guidance is available to students and school personnel in the form of directives such as the "run-hide-fight" protocol. The Active Shooter Tracking and Evacuation Routing for Survival (ASTERS) project will complement these efforts by tracking a shooter in real time across multiple cameras and microphones, calculate the optimum evacuation path to safety for each student, teacher, and staff member, and communicate this information through a mobile app interface that is co-created in partnership with a connected community of students, parents, educators and administrators as well as school resource officers and school safety officers. ASTERS will incorporate multi-modal sensing, machine learning and signal processing techniques to accurately localize a gunman and weapons while preserving privacy of school community members. It will also use new computer vision and high-performance computing solutions to estimate crowd density and movement of people, and novel optimization and real-time simulation algorithms to predict ideal evacuation routes based on the building layout and predicted movement of the shooter. ASTERS will collaborate with schools to develop an annotated, multi-modal active shooter data set using a combination of digital simulation data and real-life practice drills. The research team will also partner with first-responders to ensure that ASTERS aligns with their needs.
Providing customized and actionable commands to each group of civilians through a mobile app will potentially vastly improve chances of safe evacuation. Messages will provide clear actionable information and suggestions, such as "Shooter is leaving the cafeteria heading to the gym. Your best exit is out the Main Entrance", rather than leave it up to individuals' panicked judgement. Moreover, ASTERS will enable automated and instantaneous reporting of location and physical attributes of shooter and type of weapons being used, to a 911 call center. This will provide responding patrol officers with critical strategic information for planning a tactical offensive and alleviate, if not overcome, the dependence on unreliable eye-witness accounts. Data from previous mass shootings demonstrate the important of providing people accurate information and guidance about evacuation. The ASTERS project will enable the realization of smart safety systems that integrate sensors, communication, algorithms, and human factors research to provide life-saving information to vulnerable people.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH
Note:
When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external
site maintained by the publisher. Some full text articles may not yet be available without a
charge during the embargo (administrative interval).
Some links on this page may take you to non-federal websites. Their policies may differ from
this site.
PROJECT OUTCOMES REPORT
Disclaimer
This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.
The Active Shooter Tracking & Evacuation Routing for Survival (ASTERS) project was a collaborative effort between University of Tennessee, Knoxville and Iowa State University that brought together various expertise such as computer vision and machine learning, planning and optimization, human-machine interactions, education, and social sciences. The overarching goal of the project was to develop a deployable technological solution to mitigate the impact of active shooter incidents in K-12 schools and reduce resulting injuries.
To achieve this goal, the ASTERS team built a cyber-physical system (CPS) framework that leverages multiple cameras deployed in a school building to localize, identify, and track a shooter using computer vision and machine learning techniques. If a shooter is identified, the route optimization module estimates the safest evacuation routes for different groups of students and school employees in real time. Information about the shooter is communicated to appropriate school officials and law enforcement personnel automatically, and personalized evacuation guidance is provided to people under threat via the ASTERS communication module.
The training process of a camera-based shooter detection model required a large amount of data under widely different conditions in terms of locations, lighting, types of shooters, and clothing. However, publicly available data on shooters in a security context remains quite limited. Therefore, the ASTERS team explored the use of computer graphics game engines such as Unreal Engine (UE) to build a large public data set. The team developed machine learning algorithms that used this large synthetic data set augmented with a small amount of real data to build highly accurate shooter detection models that generalize well to different active shooter situations. The shooter detection and tracking system has been implemented to run on off-the-shelf, low-cost edge hardware including Raspberry Pi and Jetson Nano.
In the ASTERS route optimization framework, the team developed new mathematical models for the shooter’s movement inside a building. Using this shooter movement model, the team designed a machine learning algorithm that computes the optimal policy for the evacuees by computing the risk versus reward tradeoff of the short-term objective of getting to a safer room, and the long-term objective of getting out of the building safely. In simulation, this algorithm was shown to reduce casualties by 56% and the evacuee’s time spent in the shooter’s line of sight by 52%. The framework also addresses the bottlenecks and crowding problems that can significantly reduce evacuation efficiency. The team also investigated the effect of dynamic opening and closing of programmable automatic doors to control the shooter’s movement. The doors should be strategically placed in important parts of the building to actively steer the shooter away from large crowds, while simultaneously ensuring safety for all evacuees. The ASTERS automatic door actuation framework can significantly reduce evacuee casualties in certain scenarios. The results also helped quantify the abstract ethical questions about equitable risk distribution in the evacuation algorithm.
To evaluate the feasibility of effective personalized communication of evacuation instructions to members of a school community, the team developed a Unity-based school shooter simulation in which research study participants moved through the school to a classroom and then evacuated as quickly as possible when a shooter alert was announced within the school. Participants received instructions such as smart directive Exit signs that changed according to the location of the shooter and smart overhead audio speakers that issued customized verbal evacuation instructions depending on the location of the speaker. Results showed that the audio cues were more effective in general than the visual cues. To measure the effectiveness of an evacuation protocol, a student-led research project inspired by ASTERS created the EASE (Evacuation with Acceptable Simplicity in Emergencies) score that leverages both previous literature on fire and shooter evacuation and results from ASTERS surveys. The EASE agent-based simulation software is available as an open-source repository for use by future researchers.
The ASTERS team also engaged the end-user community such as patrol officers and school leaders through interviews to discuss the relative merits of various choices of interfaces for disseminating mission-critical information to 9-1-1 mission control and real-time survival strategies to civilians. The school leaders also helped to understand the feasibility, potential cost, and real-world application of the ASTERS system. With their help, the team developed an open-source online curriculum module to train other school leaders in developing safety plans and relationships with community members.
The ASTERS project partially supported graduate studies of 13 students (40% women or underrepresented minority) including 10 PhD students. An undergraduate CPS minor at Iowa State was launched in 2021 and the ASTERS project directly supported the development and growth of this minor.
Last Modified: 01/28/2024
Modified by: Soumik Sarkar
Please report errors in award information by writing to: awardsearch@nsf.gov.