Skip to feedback

Award Abstract # 2220956
NRI: Enhancing Autonomous Underwater Robot Perception for Aquatic Species Management

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: REGENTS OF THE UNIVERSITY OF MINNESOTA
Initial Amendment Date: August 17, 2022
Latest Amendment Date: March 28, 2023
Award Number: 2220956
Award Instrument: Standard Grant
Program Manager: Jie Yang
jyang@nsf.gov
 (703)292-4768
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: January 1, 2023
End Date: December 31, 2026 (Estimated)
Total Intended Award Amount: $929,291.00
Total Awarded Amount to Date: $945,291.00
Funds Obligated to Date: FY 2022 = $929,291.00
FY 2023 = $16,000.00
History of Investigator:
  • Junaed Sattar (Principal Investigator)
    junaed@umn.edu
  • Raymond Newman (Co-Principal Investigator)
Recipient Sponsored Research Office: University of Minnesota-Twin Cities
2221 UNIVERSITY AVE SE STE 100
MINNEAPOLIS
MN  US  55414-3074
(612)624-5599
Sponsor Congressional District: 05
Primary Place of Performance: University of Minnesota - Twin Cities
100 Union St SE
Minneapolis
MN  US  55455-0159
Primary Place of Performance
Congressional District:
05
Unique Entity Identifier (UEI): KABJZBBJ4B54
Parent UEI:
NSF Program(s): IIS Special Projects,
NRI-National Robotics Initiati
Primary Program Source: 01002223DB NSF RESEARCH & RELATED ACTIVIT
01002324DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 8013, 8086, 9251
Program Element Code(s): 748400, 801300
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

The underwater domain takes up almost four-fifths of the planet and has significant bearing on human well-being, ecological balance, and accordingly, socio-economic prosperity. However, it poses significant challenges to exploration by autonomous systems, particularly in perception and localization capabilities. Many applications, e.g., in environmental monitoring and ecosystem preservation, would benefit significantly from using autonomous underwater vehicles (AUVs), with improved efficiency, productivity, and safety. In particular, the preservation of the underwater ecosystem is of utmost importance in maintaining proper ecological balance and is a significant undertaking where autonomous underwater systems can be valuable tools. This project will integrate expertise in robotics and marine conservation biology to create novel capabilities for autonomous underwater robotic perception and navigation which will make it possible for robots to identify, track, and localize aquatic species. The research team will integrate theoretical advances in robot vision, learning, and localization on an affordable, open-source autonomous robotic platform using field trials, publications, software, and design and dataset releases, in addition to tutorials and workshops in conferences. The research team will also incorporate research results into course curricula to better prepare students for jobs in robotics and intelligent systems while advancing knowledge in conservation biology. The investigators will pay particular attention to recruit students from underrepresented groups to the research team.

This project will integrate expertise in robotics and marine conservation biology to create novel capabilities for autonomous underwater robotic perception and navigation which will make it possible for robots to identify, track, and localize aquatic species. This research will enable AUVs to act as effective robotic assistants in littoral habitats to manage these ecosystems. Specifically, the investigators will create methods to (1) enhance multimodal underwater imagery specifically for robust detection of aquatic species, (2) use zero- and/or one-shot learning for identifying aquatic species with limited training imagery, and (3) combine acoustic and bathymetric methods for accurate underwater robot localization. The research outcomes will be evaluated both individually and as an integrated, coherent system onboard underwater vehicles at appropriate field locations. Investigators have complementary expertise in underwater robotics and aquatic ecology. The integration of the diverse expertise possessed by the research team will lead to major advances in underwater autonomous robotics and enable the use of AUVs in a domain of significant ecological and economic importance.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Fulton, Michael and Prabhu, Aditya and Sattar, Junaed "HREyes: Design, Development, and Evaluation of a Novel Method for AUVs to Communicate Information and Gaze Direction *" , 2023 https://doi.org/10.1109/ICRA48891.2023.10161179 Citation Details
Fulton, Michael and Sattar, Junaed and Absar, Rafa "SIREN: Underwater Robot-to-Human Communication Using Audio" IEEE Robotics and Automation Letters , v.8 , 2023 https://doi.org/10.1109/LRA.2023.3303719 Citation Details
Hong, Jungseok and Enan, Sadman Sakib and Sattar, Junaed "Diver Identification Using Anthropometric Data Ratios for Underwater Multi-HumanRobot Collaboration" IEEE Robotics and Automation Letters , v.9 , 2024 https://doi.org/10.1109/LRA.2024.3366026 Citation Details
Knutson, Corey and Cao, Zhipeng and Sattar, Junaed "Adaptive Landmark Color for AUV Docking in Visually Dynamic Environments" , 2024 https://doi.org/10.1109/ICRA57147.2024.10611083 Citation Details
Kutzke, Demetrious T and Wariar, Ashwin and Sattar, Junaed "Autonomous robotic re-alignment for face-to-face underwater human-robot interaction*" , 2024 https://doi.org/10.1109/ICRA57147.2024.10610809 Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page