Award Abstract # 1541251
EAGER: Refinement and Evaluation of a Robotic Wheelchair System

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: OREGON STATE UNIVERSITY
Initial Amendment Date: April 23, 2015
Latest Amendment Date: May 6, 2015
Award Number: 1541251
Award Instrument: Standard Grant
Program Manager: Ephraim Glinert
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: May 1, 2015
End Date: April 30, 2017 (Estimated)
Total Intended Award Amount: $91,662.00
Total Awarded Amount to Date: $98,662.00
Funds Obligated to Date: FY 2015 = $98,662.00
History of Investigator:
  • William Smart (Principal Investigator)
    smartw@oregonstate.edu
Recipient Sponsored Research Office: Oregon State University
1500 SW JEFFERSON AVE
CORVALLIS
OR  US  97331-8655
(541)737-4933
Sponsor Congressional District: 04
Primary Place of Performance: Oregon State University
Corvallis
OR  US  97331-8507
Primary Place of Performance
Congressional District:
04
Unique Entity Identifier (UEI): MZ4DYXE1SL98
Parent UEI:
NSF Program(s): HCC-Human-Centered Computing
Primary Program Source: 01001516DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7367, 7916, 9251
Program Element Code(s): 736700
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

The interfaces used by full-time wheelchair users with ALS, quadriplegia, and similar conditions are typically single-tasking, direct control interfaces. For example, a person with ALS with whom the PI works drives his wheelchair through a combination of head- and shoulder-activated switches, and speaks with the assistance of a computer he controls with head movements. He cannot drive the chair and communicate at the same time, in the way that normally-abled people take for granted. For most of us, walking is an unconscious activity; we decide where to go in the room, and then forget about it. Adding autonomy to a powered wheelchair would allow many wheelchair users to recover some of this ability, by essentially turning the wheelchair into a robot that can take advantage of the vast body of existing software and techniques for navigating about the world. The user of such a wheelchair would select a location on a map displayed on his/her computer, and then forget about it as the wheelchair drives itself to that location, reducing the dependence on caregivers and increasing independence. The PI's goal in this exploratory project is to develop a low-cost, open-source electronics package that will provide this capability for a (somewhat arbitrary) total hardware cost of $500 since medical insurance will not pay for such a system so potential users must pay for it out-of-pocket and the PI is anxious to ensure that project outcomes will find their way into the lives of real wheelchair users. Instrumenting a wheelchair in this way will have additional benefits (e.g., knowing where the wheelchair is in the home could allow a simpler and faster interface to control home automation). And because the system will have an open software API, it will provide a common platform for researchers and developers working on assistive systems for full-time wheelchair users.

To these ends, the PI has designed and implemented a prototype electronics package for Permobil powered wheelchairs, and has tested this on a Permobil M300 powered wheelchair on loan from the ALS Association of Oregon and Southwest Washington. The electronics package is mounted underneath the seat at the front of the chair on a custom-fabricated metal plate, and includes two Hokuyo laser range-finders (one on each side), a small computer mounted on the front of the chair body behind the footrest, and custom electronics to supply power from the wheelchair batteries. An Arduino microcontroller connected to the computer allows movement commands to be sent to the wheelchair through a Permobil I/O Module. Integration with ROS allows the system to build maps of the environment, to use these to localize the wheelchair, and to take advantage of extensive autonomous navigation abilities. Once the wheelchair is localized within a map, the user can provide it with a goal point either via an on-screen map-based interface or by means of a Google Glass; the chair can then autonomously navigate to that point avoiding obstacles as it goes, using the standard ROS navigation system. Preliminary trials in a cluttered office environment have been encouraging, although additional refinement of the URDF and kinematic models of the system are needed, and the localization needs to be improved by adding an IMU to the electronics package. The intellectual merit of the current work lies in three areas: understanding the design pressures behind the envisaged electronics package, if it is to be deployed on a range of powered wheelchairs in the real world; the redesign and implementation of mapping, localization, and path-planning algorithms for this setting; and designing a system that is fault-tolerant and capable of running for months and years at a time, without intervention by trained roboticists. Specific tasks will include: to improve and generalize the hardware and electronic design; to improve the localization algorithm; to improve the quality of wheelchair movement; to investigate replacements for the current laser range-finders; to document how to integrate everything onto a chair; and to build a number of additional kits.

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The goal of this project was to further develop a prototype electronics package that could be added to a standard power wheelchair to turn it into a self-driving wheelchair.  The package included a number of sensors, a small computer, and a conntection to the wheelchair's electronics.  It also included a modified version of some open-source software used by sophisticated research robots to navigate around the world.

The project resulted in a new version of the electronics package that can be installed on Permobil powered wheelchairs, with only a single conntection to the on-board control electronics and another to the wheelchair batteries.  The package was successfully mounted on both the M300 and C300 wheelchairs, and we were able to show it driving autonomously in real-world environments.  A human, sitting in the chair, gives the system a point in the world that they want to go to on a map (learned by the wheelchair beforehand).  The chair then plans an appropriate path to this point, and drives along it, avoiding unexpected obstacles as it goes.

The software on the wheelchair is a customized version of the software we use on our advanced research robots, based on the popular open-source Robot Operating System (ROS).  This allows us to take advantage of the most recent planning an navigation software, while allowing us to easily customize it to the specific requirements of the wheelchair.

This project is an important first step towards developing a robust self-driving capability for powered wheelchairs, for people with severe motor disorders, such as quadriplegia and Amyotrophic Lateral Sclerosis (ALS, or Lou Gehrig's Disease).  People with these, and similar, disorders often have difficulty driving their own wheelchairs.  Giving the chair a self-driving capability will allow the wheelchair users to move about the world by simply telling the system where they want to be, using a computer menu, eye gaze, or some other approprate interface technology.


Last Modified: 08/08/2017
Modified by: William D Smart

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page