Award Abstract # 1734981
NCS-FO: Collaborative Research: Understanding the neural basis for sensorimotor control loops using whisker-based robotic hardware platforms

NSF Org: BCS
Division of Behavioral and Cognitive Sciences
Recipient: NORTHWESTERN UNIVERSITY
Initial Amendment Date: August 7, 2017
Latest Amendment Date: August 7, 2017
Award Number: 1734981
Award Instrument: Standard Grant
Program Manager: Betty Tuller
btuller@nsf.gov
 (703)292-7238
BCS
 Division of Behavioral and Cognitive Sciences
SBE
 Directorate for Social, Behavioral and Economic Sciences
Start Date: September 1, 2017
End Date: August 31, 2022 (Estimated)
Total Intended Award Amount: $666,298.00
Total Awarded Amount to Date: $666,298.00
Funds Obligated to Date: FY 2017 = $666,298.00
History of Investigator:
  • Mitra Hartmann (Principal Investigator)
    hartmann@northwestern.edu
  • Lynda Brinson (Co-Principal Investigator)
Recipient Sponsored Research Office: Northwestern University
633 CLARK ST
EVANSTON
IL  US  60208-0001
(312)503-7955
Sponsor Congressional District: 09
Primary Place of Performance: Northwestern University
2145 Sheridan Road
Evanston
IL  US  60208-3111
Primary Place of Performance
Congressional District:
09
Unique Entity Identifier (UEI): EXZVPWZBLUE8
Parent UEI:
NSF Program(s): IntgStrat Undst Neurl&Cogn Sys
Primary Program Source: 01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 9251, 8089, 8551, 8091
Program Element Code(s): 862400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.075

ABSTRACT

This project will construct robots in order to understand how animals gather information through the sense of touch and how animals use touch information to perform complex behaviors. The results will be important to both neuroscience and engineering. On the neuroscience side, the results will address how the brain combines information about movement and touch, thereby improving our understanding of stroke and brain injury. On the engineering side, the work will develop novel robots and sensors that use touch to sense object location, shape, and texture, to track fluid wakes in water, and to sense the direction of airflow. These capabilities will improve the ability of robots to work in challenging environments; for example, robots could explore dark areas more easily or provide surgeons with a better sense of touch during surgery. To train the next generation of scientists and engineers, both undergraduate and graduate students will help construct the robots and will explore industry- and government-related applications of whisker-based touch sensing. The research team will investigate technology transfer opportunities in robotics and medicine, flow sensing, instrument placement, corrosion detection, three-dimensional tactile profilometry, and compliance sensing.

The fundamental scientific rationale for the work is that understanding how animal nervous systems process complex sensory and motor information necessarily requires quantification of the input. However, it is currently impossible for neuroscientists to record from all primary sensory neurons involved in a particular sensorimotor behavior. The three stages of this project exploit the whisker system of mammals in an endeavor to completely quantify whisker-based input and early neural processing in the rat (Rattus norvegicus) and the harbor seal (Phoca vitulina). The first stage of work will focus on the development of modular, reconfigurable, artificial whiskers that can sense both touch and fluid flow. The materials, manufacturing, and sensor designs necessary for whiskers at multiple length scales will be investigated and signals from the whiskers will be represented based on known coding properties of primary whisker-sensitive neurons in the trigeminal ganglion (TG). The second stage of work will involve the construction of whisker arrays that anatomically match those of the rat and the seal. These arrays will be used to develop combined hardware and software models of the responses of the entire population of TG neurons. Finally, in the third stage of work, the whisker arrays will be mounted on robotic platforms, and the robots will be put through the same head movements as real animals during natural behavior. This process will allow us to simulate the entire TG neuron population response during complex, natural behaviors. Overall, the project will help unlock the basis by which low-level but powerful neural circuits confer animals with flexibility and resourcefulness in sensing and movement. This project is funded by Integrative Strategies for Understanding Neural and Cognitive Systems (NSF-NCS), a mulitdisciplinary program jointly supported by the Directorates for Computer and Information Science and Engineering (CISE), Education and Human Resources (EHR), Engineering (ENG), and Social, Behavioral, and Economic Sciences (SBE).

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Collinson, David W. and Emnett, Hannah M. and Ning, Jinqiang and Hartmann, Mitra J.Z. and Brinson, Lynda Catherine "Tapered Polymer Whiskers to Enable Three-Dimensional Tactile Feature Extraction" Soft Robotics , 2020 https://doi.org/10.1089/soro.2019.0055 Citation Details
Collinson, David W. and Kolluru, Pavan V. and Von Windheim, Natalia and Brinson, L. Catherine "Distribution of rubber particles in the weld zone of fused filament fabricated acrylonitrile butadiene styrene and the impact on weld strength" Additive Manufacturing , v.41 , 2021 https://doi.org/10.1016/j.addma.2021.101964 Citation Details
Collinson, David W. and Sheridan, Richard J. and Palmeri, Marc J. and Brinson, L. Catherine "Best practices and recommendations for accurate nanomechanical characterization of heterogeneous polymer systems with atomic force microscopy" Progress in Polymer Science , v.119 , 2021 https://doi.org/10.1016/j.progpolymsci.2021.101420 Citation Details
Emnett, Hannah and Graff, Matthew and Hartmann, Mitra "A Novel Whisker Sensor Used for 3D Contact Point Determination and Contour Extraction" Robotics Science and Systems , v.XIV , 2018 Citation Details
Heydari, Shayan and Patankar, Neelesh A. and Hartmann, Mitra J. and Jaiman, Rajeev K. "Fluid-structure interaction of a flexible cantilever cylinder at low Reynolds numbers" Physical Review Fluids , v.7 , 2022 https://doi.org/10.1103/PhysRevFluids.7.024702 Citation Details
Kim, Suhan and Kim, Sukjun and Majditehran, Houriyeh and Patel, Dinesh K. and Majidi, Carmel and Bergbreiter, Sarah "Electromechanical Characterization of 3D Printable Conductive Elastomer for Soft Robotics" IEEE International Conference on Soft Robotics (RoboSoft) , 2020 https://doi.org/10.1109/RoboSoft48309.2020.9116027 Citation Details
Kim, Suhan and Kubicek, Regan and Paris, Aleix and Tagliabue, Andrea and How, Jonathan P. and Bergbreiter, Sarah "A Whisker-inspired Fin Sensor for Multi-directional Airflow Sensing" 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2020 https://doi.org/10.1109/IROS45743.2020.9341723 Citation Details
Kim, Suhan and Velez, Camilo and Patel, Dinesh K. and Bergbreiter, Sarah "A Magnetically Transduced Whisker for Angular Displacement and Moment Sensing" 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2019 https://doi.org/10.1109/IROS40897.2019.8968518 Citation Details
von Windheim, Natalia and Collinson, David W. and Lau, Trent and Brinson, L. Catherine and Gall, Ken "The influence of porosity, crystallinity and interlayer adhesion on the tensile strength of 3D printed polylactic acid (PLA)" Rapid Prototyping Journal , v.27 , 2021 https://doi.org/10.1108/rpj-08-2020-0205 Citation Details
Yang, Anne ET and Hartmann, Mitra JZ and Bergbreiter, S "Contact-Resistive Sensing of Touch and Airflow Using a Rat Whisker" Proceedings of the ... IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics , 2018 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

This project aimed to create bio-realistic whisker sensors to explore how animals such as rats and harbor seals interpret tactile (touch) information from their whiskers. The project was highly interdisciplinary and its intellectual merit involved at least four disciplines.

Neuroscience: A large open question in neuroscience is how the brain combines movement and sensory information to enable animals, including humans, to perceive objects through the sense of touch. Many animals use their whiskers for touch exploration, so the whisker system is often used to investigate this important question. However, it is simply not possible to record the motion of all whiskers simultaneously during naturalistic whisking behaviors. The artificial whiskers and robotic whisker sensors developed in this project enabled us to examine mechanical signals that could not be measured in the real animal and begin to develop models of the neural processing that enables touch perception.

Material Science: We developed a novel "fiber drawing" manufacturing process to produce tapered artificial whiskers that are successful mechanical and geometric mimics of biological rat vibrissae. Tests of these whiskers showed substantial improvement over previous non-tapered filaments and the ability to predict contact point locations with a median distance error of less than half a centimeter. While developing this manufacturing process we also studied how the properties of a material are influenced by the distribution of small nano and microscale sub-phases within different zones, and the impact of the material cooling after the drawing process. Finally, we wrote a review paper that describes best practices to accurately characterize complex materials using atomic force microscopy.

Soft Robotics and MEMS sensing: We engineered three different whisker sensing systems. The first whisker sensor was designed using microfabrication resulting in a sensor the same size scale of a rat's whisker. While we were able to embed real rat whiskers in a sensor of this size, the follicle design provided limited information about the whisker deflections. The second approach took advantage of inexpensive magnetic field sensors. We attached magnet to the base of a 5x scaled-up whisker manufactured with our novel fiber drawing method, and then attached the base to a spring suspension. This allowed us to measure the moments applied to the whisker and enabled sensors that could be assembled into modular arrays. We could sense whisker deflections with minimal error. The final sensing approach used computer vision along with up to six whiskers embedded in an elastomer membrane. This approach was limited in bandwidth by the frame rate of the camera, but by using the camera to monitor the motion of both the whiskers and the membrane, we were able to distinguish between different stimuli on the whiskers including touch, airflow, and inertial motion.

Fluid dynamics: Animals use their whiskers not only for touch sensing but also to sense fluid flow. We investigated several different mechanisms for tactile and airflow sensing at small scales and will continue to work toward robot integration. In addition, we performed novel theoretical analyses that investigate how fluids interact with flexible whiskers when the airflow speed is very low.

Broader impacts of the project included outreach to K-12 populations in bio-inspired robotics. Over fifteen undergraduate researchers contributed to the success of this project. Whisker-based robots and sensing devices were presented in multiple public venues including Chicago's Museum of Science and Industry.


Last Modified: 01/08/2023
Modified by: Mitra J Hartmann

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page