Award Abstract # 1403502
COLLABORATIVE RESEARCH: ARWED - AUGMENTED PERCEPTION FOR UPPER-LIMB REHABILITATION

NSF Org: CBET
Division of Chemical, Bioengineering, Environmental, and Transport Systems
Recipient: TEXAS A&M ENGINEERING EXPERIMENT STATION
Initial Amendment Date: August 6, 2014
Latest Amendment Date: August 6, 2014
Award Number: 1403502
Award Instrument: Standard Grant
Program Manager: Aleksandr Simonian
asimonia@nsf.gov
 (703)292-2191
CBET
 Division of Chemical, Bioengineering, Environmental, and Transport Systems
ENG
 Directorate for Engineering
Start Date: August 15, 2014
End Date: July 31, 2018 (Estimated)
Total Intended Award Amount: $199,976.00
Total Awarded Amount to Date: $199,976.00
Funds Obligated to Date: FY 2014 = $199,976.00
History of Investigator:
  • Amarnath Banerjee (Principal Investigator)
    banerjee@tamu.edu
  • John Buchanan (Co-Principal Investigator)
Recipient Sponsored Research Office: Texas A&M Engineering Experiment Station
3124 TAMU
COLLEGE STATION
TX  US  77843-3124
(979)862-6777
Sponsor Congressional District: 10
Primary Place of Performance: Texas Engineering Experiment Station
College Station
TX  US  77845-4645
Primary Place of Performance
Congressional District:
10
Unique Entity Identifier (UEI): QD1MX6N5YTN4
Parent UEI: QD1MX6N5YTN4
NSF Program(s): Disability & Rehab Engineering
Primary Program Source: 01001415DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 010E
Program Element Code(s): 534200
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.041

ABSTRACT

PI: Banerjee, Amarnath/Perez Gracia, Alba/Robson, Nina
Proposal Number: 1403502/1403688/1404011
Title: Collaborative Research: ARWED - Augmented Perception for Upper-Limb Rehabilitation

Broader Significance & Importance
Training and retraining the movement of individuals suffering loss of motor ability due to stroke is a challenging task. In many cases, only partial success is accomplished after long training sessions. Given the limitations of recovery for post-stroke patients, it is imperative that better tools and methods for retraining be developed. Even though several training hypotheses exist, such as need for an exact repetition of the training pattern, the solutions are still to be found. Overcoming some of these obstacles is the goal of this proposal. Recent studies show a direct link between human action perception and action execution. There is some evidence that the visual observation of human actions has an effect on the movement of the observer. This priming effect is reduced, or not present, when the motion is executed by a non-human device, such as a robot. This proposal aims to develop and test a novel wearable system for the training of the human arm. The system will allow the user to perceive the device as part of their upper limb (hence closing the perception/action loop). Training protocols based on observational learning findings will be implemented with the ARWED in order to develop it as rehabilitation training device for motor recovery in post-stroke patients.

Technical description
The intellectual merit centers on exploiting the link between action-observation and action execution in order to develop training protocols to facilitate rehabilitation following stroke. Currently, there are limited systems that utilize virtual reality in the relearning of biological movements. The proposed development of augmented wearable system (ARWED) requires solving several challenges in computer vision/modeling, and robot kinematic mapping. Testing the effectiveness of the device on priming the perception-action effect will require combined expertise from the areas of human kinematics, signal analysis, virtual reality, robotic fault recovery theory and rehabilitation. Therefore, the theoretical contributions emerging from this multidisciplinary collaborative research team will advance knowledge and understanding not only within the medical field, but also across the above-mentioned research areas. The broader impact is based on the characteristics of the device to be developed, with an expanded ability in the training and re-training of patients with motor disabilities. Efficient design and manipulation will make the proposed ARWED system a reliable solution, which will be broadly utilized by medical professionals working in rehabilitation, sports therapy and convalescence. The proposed research will provide effective tools for the training and physical rehabilitation of patients with limb limitations at any scale, ranging from individuals suffering partial loss of motor ability to those with severe limitations in mobility due to strokes, birth defects or accidents. Motor learning theory shows that reducing feedback during practice benefits long term retention of motor skill training. Observational learning may offer greater benefits regarding transfer to ADLs, in comparison to robotic-based stroke training. Thus, a success indicator for these patients would be the beneficial transfer of training from the un-affected to affected limb or vice-versa. The ARWED system is expected to advance significantly the fundamentals of engineering and scientific knowledge, by implementing the device in experimental and educational work on cognition, telemanipulation and virtual reality. The medical community would also benefit from the development of the ARWED by furthering the understanding of how training using technology may enhance the recovery of motor control in diverse populations while providing a novel intervention that may prove more effective than what is currently available. The collaborative nature of the research team will lead to the education of undergraduate and graduate students in the areas of Engineering and Kinesiology. In the long run, the outcomes of the proposal will facilitate the communication between students that want to enter Physical and Occupational Therapy professions and those that want to design and develop mechanical devices that can aid in human recovery following neurological injury.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Muthukumaraswamy, S., Banerjee, A., McCulloch, A., Buchanan, J. and Robson, N. "An AR System for Monitoring Arm Movements for Stroke Patients" Proceedings of 2017 Industrial and Systems Engineering Research Conference, Pittsburgh, PA, May 20-23, 2017 , 2017 https://www.researchgate.net/profile/Amarnath_Banerjee/publication/317061538_An_AR_System_for_Monitoring_Arm_Movements_for_Stroke_Patients/links/59239b29aca27295a8a9b04e/An-AR-System-for-Monitoring-Arm-Movements-for-Stroke-Patients.pdf?origin=fulltextSour
Muthukumaraswamy, Sivakumar; Banerjee, Amarnath; McCulloch, Austin; Buchanan, John; Robson, Nina. "An AR System for Monitoring Arm Movements for Stroke Patients" IIE Annual Conference. Proceedings; , 2017 , p.1369 https://search.proquest.com/docview/1951118349/fulltextPDF/2F3787256545493CPQ/1?accountid=7082
Robson, N., Faller II, K.J., Ahir, V., Ferrier, A.R.D.M., Buchanan, J.J., and Banerjee A. "Creating a Virtual Perception for Upper Limb Rehabilitation" International Conference on Robot Rehabilitation (ICRR) , 2017

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The ARWED device was conceptualized as a perception/action training device to assist with upper-limb rehabilitation following stroke. The long-term goal was to develop a training device that would be beneficial for the patient in a clinic as well as in the form of an affordable at home device. The device was designed based on the principles of motor learning/observational learning in an attempt to tap into the mirror neuron system or action observation network (AON) as a means to facilitate recovery by driving neuro-plastic processes of the brain. The ARWED system currently consists of a computer, Oculus 3D virtual reality (VR) goggles, the Unity software engine, and an Optotrak Certus (Northern Digital Inc., NDI) 3D motion camera system to monitor infra-red diodes mounted on the arms and hands. The differentiating factor is that the ARWED device was not designed to facilitate limb movement for the patient, as are some robotic devices and exoskeletons. The ARWED system has been tested with young and older healthy adults and with six chronic post-stroke (> 1 year) patients. The initial tests were designed to determine the use-ability of the system with regard to basic action identification and action imitation process for common everyday arm motions. In all tests so far the participants and patients were seated. No one reported that wearing the goggles and seeing the display made them nauseous or dizzy. Within the 3D VR environment participants saw a bimanual Avatar in the form of two stick figures of the left and right arms created from actual human arm movements. There were two initial tests with the device: 1) A perceptual identification test requiring participants and patients to identify the arm that moved (left or right) and the action that arm performed (pointing, making a fist, arm raised-fingers wiggling, arm raised elbow flexion-extension motion); and 2) an action imitation test requiring participants to reproduce the action seen. Reaction times in the perceptual test were measured through vocal identifications of the arm and action. Reaction times, movement times, and kinematics of the limb were derived from the diodes placed on the arm in the action imitation test. The current system may be adapted through small modifications to test action identification and action imitation processes in acute post-stroke patients within days of the stroke.


Last Modified: 11/27/2018
Modified by: Amarnath P Banerjee

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page