Award Abstract # 2024792
NRI: FND: Foundations for Physical Co-Manipulation with Mixed Teams of Humans and Soft Robots

NSF Org: CMMI
Division of Civil, Mechanical, and Manufacturing Innovation
Recipient: BRIGHAM YOUNG UNIVERSITY
Initial Amendment Date: August 17, 2020
Latest Amendment Date: October 13, 2020
Award Number: 2024792
Award Instrument: Standard Grant
Program Manager: Jordan Berg
jberg@nsf.gov
 (703)292-5365
CMMI
 Division of Civil, Mechanical, and Manufacturing Innovation
ENG
 Directorate for Engineering
Start Date: January 1, 2021
End Date: December 31, 2025 (Estimated)
Total Intended Award Amount: $717,030.00
Total Awarded Amount to Date: $717,030.00
Funds Obligated to Date: FY 2020 = $717,030.00
History of Investigator:
  • Marc Killpack (Principal Investigator)
    marc_killpack@byu.edu
  • John Salmon (Co-Principal Investigator)
Recipient Sponsored Research Office: Brigham Young University
A-153 ASB
PROVO
UT  US  84602-1128
(801)422-3360
Sponsor Congressional District: 03
Primary Place of Performance: Brigham Young University
350 EB, Brigham Young University
Provo
UT  US  84602-1231
Primary Place of Performance
Congressional District:
03
Unique Entity Identifier (UEI): JWSYC7RUMJD1
Parent UEI:
NSF Program(s): NRI-National Robotics Initiati
Primary Program Source: 01002021DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 8086
Program Element Code(s): 801300
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.041

ABSTRACT

The goal of this National Robotics Initiative (NRI) project is to enable mixed teams of humans and robots to work together to accomplish physically demanding object manipulation tasks in complex environments. For this project, soft robots are exclusively considered, because traditional robots are too heavy and potentially dangerous to work closely with people. Humans can effectively work together to move a bulky, heavy object because they are able to use their understanding of group goals and individual capabilities to interpret physical cues and quickly infer each other's intention. Thus, the first step in extending this ability to robots is to understand how groups of people recognize and react to pushing and pulling from other team members. The project also emphasizes the necessity of managing uncertainty when working with soft robots and with people -- soft robots because they deform significantly under typical task loads, and people because their movements may be difficult for robots to predict. Potential applications of the research can range from expediting logistics and material handling, to improving human safety in dangerous and/or hard-to-reach environments such as mining, oil rigs, logging, and search and rescue. To this end, a collaboration with a local search and rescue team will solicit feedback on human-robot co-manipulation throughout the project. Underrepresented undergraduate students will be trained with a STEM education tool leveraging soft robotics, and the students will then work to disseminate this training to local K-12 classrooms.

Co-manipulation can be defined as the actions taken and the signals sent by many collaborating agents while moving a single large object. This research will enable co-manipulation between humans and robots, and is focused on the following three main thrusts: 1) modeling, controlling, and planning effective stiffness trajectories for soft robots to deal with task uncertainty, 2) quantifying and modeling human intention and consensus during manipulation, and 3) developing algorithms that incorporate intention, consensus, and uncertainty to execute co-manipulation tasks. Building on prior work on model predictive control algorithms for large-degree-of-freedom soft robots, stiffness trajectories will be generated as part of the soft robot control based on estimates of task uncertainty. Trials with human collaborators moving large objects in real life and in virtual reality will allow the development of algorithms that predict consensus and motion of the group. Finally, given a reasonable estimate of the short-term motion goal of a group, the resulting algorithms will also generate robot motion and stiffness trajectories to help a group reach consensus more efficiently by reducing uncertainty. This research will pioneer the novel combination of natural physical interaction, control for safe robots, multi-agent coordination, and planning/acting in a distributed manner.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Freeman, Seth and Moss, Shaden and Salmon, John L and Killpack, Marc D "Classification of Co-Manipulation Modus with Human-Human Teams for Future Application to Human-Robot Systems" ACM Transactions on Human-Robot Interaction , v.13 , 2024 https://doi.org/10.1145/3659059 Citation Details
Jensen, Spencer and Salmon, John L and Killpack, Marc D "Model Evolutionary Gain-Based Predictive Control (MEGa-PC) for Soft Robotics*" , 2024 https://doi.org/10.1109/RoboSoft60065.2024.10521954 Citation Details
Jensen, Spencer W. and Johnson, Curtis C. and Lindberg, Alexa M. and Killpack, Marc D. "Tractable and Intuitive Dynamic Model for Soft Robots via the Recursive Newton-Euler Algorithm" IEEE International Conference on Soft Robotics (RoboSoft) , 2022 https://doi.org/10.1109/RoboSoft54090.2022.9762215 Citation Details
Jensen, Spencer W. and Salmon, John L. and Killpack, Marc D. "Trends in Haptic Communication of Human-Human Dyads: Toward Natural Human-Robot Co-manipulation" Frontiers in Neurorobotics , v.15 , 2021 https://doi.org/10.3389/fnbot.2021.626074 Citation Details
Johnson, Curtis C and Cheney, Daniel G and Cordon, Dallin L and Killpack, Marc D "PneuDrive: An Embedded Pressure Control System and Modeling Toolkit for Large-Scale Soft Robots" , 2024 https://doi.org/10.1109/RoboSoft60065.2024.10521958 Citation Details
Mielke, Erich and Townsend, Eric and Wingate, David and Salmon, John L and Killpack, Marc D "Human-robot planar co-manipulation of extended objects: data-driven models and control from human-human dyads" Frontiers in Neurorobotics , v.18 , 2024 https://doi.org/10.3389/fnbot.2024.1291694 Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page