Award Abstract # 0855065
II-EN: Infrastructure for Gesture Interface Research Outside the Lab

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: TRUSTEES OF BOSTON UNIVERSITY
Initial Amendment Date: July 20, 2009
Latest Amendment Date: July 20, 2009
Award Number: 0855065
Award Instrument: Standard Grant
Program Manager: Ephraim Glinert
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: September 1, 2009
End Date: August 31, 2013 (Estimated)
Total Intended Award Amount: $591,445.00
Total Awarded Amount to Date: $591,445.00
Funds Obligated to Date: FY 2009 = $591,445.00
ARRA Amount: $591,445.00
History of Investigator:
  • Stan Sclaroff (Principal Investigator)
    sclaroff@bu.edu
  • Carol Neidle (Co-Principal Investigator)
  • Margrit Betke (Co-Principal Investigator)
Recipient Sponsored Research Office: Trustees of Boston University
1 SILBER WAY
BOSTON
MA  US  02215-1703
(617)353-4365
Sponsor Congressional District: 07
Primary Place of Performance: Trustees of Boston University
1 SILBER WAY
BOSTON
MA  US  02215-1703
Primary Place of Performance
Congressional District:
07
Unique Entity Identifier (UEI): THL6A6JLE1S7
Parent UEI:
NSF Program(s): CCRI-CISE Cmnty Rsrch Infrstrc
Primary Program Source: 01R00910DB RRA RECOVERY ACT
Program Reference Code(s): 6890, 9218, HPCC
Program Element Code(s): 735900
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5).

The proposed work is focused on gestural human computer interfaces, camera-based interfaces for individuals with severe physical disabilities, communication through sign language and gesture, and/or motion of the human body and hands. The proposed infrastructure enhancement would make it possible, as well as practical, to conduct video-based research outside the lab. The infrastructure includes a ruggedized mobile system for capture of synchronized, multi-view digital video on site, for instance in schools for the Deaf and in homes for the disabled. Software infrastructure will be enhanced to support the development of the interface for deployment of the systems to be used in the field, and for annotation of video collected in the field. Video data capture from a larger and more diverse pool of subjects will lead to a more diverse collection of videos for study of linguistic variation and for training and testing of computer vision algorithms.

The camera-based assistive technology developed as part of this project will have a positive impact on the quality of life of adults and children with severe physical disabilities, as well as their friends, families and caregivers; the software will be disseminated at special care facilities and will also be available on the internet via free download. The automated gesture spotting, indexing, matching, and retrieval methods developed in this project would enable sign-based search of ASL literature, lore, poems, performances, courses, from digital video libraries and DVDs. Such capability could have far-reaching implications for improving education, opportunities, and access for the deaf. The gestural analysis, matching, and retrieval methods developed in this project should also accelerate linguistic and cross-linguistic research on signed languages and the gestural components of spoken languages.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

C. W. Kwan, I. Paquette, J. J. Magee, and M. Betke "Adaptive Sliding Menubars Make Existing Software More Accessible to People with Severe Motion Impairments" Universal Access in the Information Society , 2013 10.1007/s10209-013-0295-2
L. Lo Presti, S. Sclaroff, and M. La Cascia "Path modeling and retrieval in distributed video surveillancedatabases" IEEE Trans. on Multimedia , v.14 , 2012
N. Ikizler-Cinbis and S. Sclaroff "Web-based classi?ers for human action recognition" IEEE Trans. on Multimedia , v.14 , 2012
R. Li, T.P Tian, and S. Sclaroff "Divide, conquer and coordinate: Globally coordinated switching linear dynamical system" IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI) , v.34 , 2012 , p.654 10.1109/TPAMI.2011.152
S. Epstein and M. Betke "The Kernel Semi-least Squares Method for Sparse Distance Approximation" Neural Computation , v.25 , 2013 , p.532 10.1162/NECO_a_00401
S. Epstein, E. Missimer and M. Betke "Using kernels for a video-based mouse-replacement interface" Personal and Ubiquitous Computing , 2012

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page