Award Abstract # 2053498
CAREER: Synergy-based Human Machine Interfaces

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: UNIVERSITY OF MARYLAND BALTIMORE COUNTY
Initial Amendment Date: November 13, 2020
Latest Amendment Date: July 11, 2023
Award Number: 2053498
Award Instrument: Continuing Grant
Program Manager: Dan Cosley
dcosley@nsf.gov
 (703)292-8832
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: August 22, 2020
End Date: August 31, 2025 (Estimated)
Total Intended Award Amount: $413,616.00
Total Awarded Amount to Date: $513,611.00
Funds Obligated to Date: FY 2019 = $19,003.00
FY 2020 = $85,643.00

FY 2021 = $101,234.00

FY 2022 = $202,963.00

FY 2023 = $104,768.00
History of Investigator:
  • Ramana Vinjamuri (Principal Investigator)
    rvinjam1@umbc.edu
Recipient Sponsored Research Office: University of Maryland Baltimore County
1000 HILLTOP CIR
BALTIMORE
MD  US  21250-0001
(410)455-3140
Sponsor Congressional District: 07
Primary Place of Performance: University of Maryland Baltimore County
MD  US  21250-0002
Primary Place of Performance
Congressional District:
07
Unique Entity Identifier (UEI): RNKYWXURFRL5
Parent UEI:
NSF Program(s): HCC-Human-Centered Computing,
IIS Special Projects
Primary Program Source: 01001920DB NSF RESEARCH & RELATED ACTIVIT
01002021DB NSF RESEARCH & RELATED ACTIVIT

01002122DB NSF RESEARCH & RELATED ACTIVIT

01002223DB NSF RESEARCH & RELATED ACTIVIT

01002324DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 1045, 120Z, 7367
Program Element Code(s): 736700, 748400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

With a brain controlled exoskeleton, an individual with spinal cord injury performed a symbolic-kickoff of for the World Cup in Brazil in 2014. Human-machine interfaces have not only become popular technologies but have become the hope of many individuals for restoring their lost limb function. Decades of research went into making the interface between the human and the machine seamless, but scientists were unable to effectively address the inherent challenges, namely, complexity, adaptability and variability. To overcome the above challenges, it is critical to computationally understand and quantitatively characterize how humans control their senses and motor abilities. Biomimetically inspired models can help to understand this process, and can enable efficient control of the machine. The human hand has many dimensions and is an ideal testbed to understand sensorimotor control while interacting with computers and other machines. Hence the goal of this project is to design and develop biomimetic models that control the human hand and extend these models to the control of multidimensional machines. The societal impacts of the proposed project will be the development of new designs of artificial limbs for individuals with disabilities that are as close to natural in their functions. The educational and outreach impacts of the project will create opportunities for students and working engineers to learn the importance of human machine interfaces. The project will facilitate mentored international research and educational opportunities for students. The hands-on modules developed as an outflow of the proposed research will ignite interest in science and technology among students at all levels, particularly women and underrepresented minorities.

The means by which the central nervous system effortlessly controls the high dimensional human hand is still an unsolved mystery. To address this high dimensional control problem, many bioinspired motor control models have been proposed, one of which is based on synergies. According to this model, instead of controlling individual motor units, central nervous system simplifies the control using coordinated control of groups of motor units called synergies. However, there are several unanswered questions today. Where are synergies present? What is their role in motor control and motor learning? To answer these fundamental questions, this project takes a holistic and comprehensive approach. It combines the concepts of human motor control, computational neuroscience, machine learning and validation with noninvasive human experiments. The research objectives of this project are: to model the generation of synergies in human hand movements and validate the model with noninvasive human experiments using computational models, electroencephalography and transcranial magnetic stimulation, to model the behavior and the role of synergies in motor learning and to apply these synergies in multidimensional machine control and machine-assisted learning.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 12)
Burns, Martin and Rosa, Rachel and Akmal, Zamin and Conway, Joseph and Pei, Dingyi and King, Emily and Banerjee, Nilanjan and Vinjamuri, Ramana "Design and Implementation of an Instrumented Data Glove that measures Kinematics and Dynamics of Human Hand" , 2021 https://doi.org/10.1109/EMBC46164.2021.9630204 Citation Details
Jambhale, Kiran and Rieland, Benjamin and Mahajan, Smridhi and Narsay, Prajakta and Banerjee, Nilanjan and Dutt, Abhijit and Vinjamuri, Ramana "Selection of Optimal Physiological Features for Accurate Detection of Stress" 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) , 2022 https://doi.org/10.1109/EMBC48229.2022.9871067 Citation Details
Kadiyala, Sai Praveen and Chen, Ke and Guo, Ziyang and Olikkal, Parthan and Catlin, Andrew and Satyanarayana, Ashwin and Vinjamuri, Ramana "Novel Hand Gesture Classification based on Empirical Fourier Decomposition of sEMG Signals *" , 2023 https://doi.org/10.1109/IEEECONF58974.2023.10404977 Citation Details
Mao, Helen X. and Widjaja, Joseph and Guo, Yifan and Yin, Jijun and Vinjamuri, Ramana "Finding Robust Low Dimensional Features for Sleep Detection Using EEG Data" 2022 IEEE 2nd International Conference on Data Science and Computer Application (ICDSCA) , 2022 https://doi.org/10.1109/ICDSCA56264.2022.9988155 Citation Details
Olikkal, Parthan and Pei, Dingyi and Adali, Tulay and Banerjee, Nilanjan and Vinjamuri, Ramana "Musculoskeletal Synergies in the Grasping Hand" 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) , 2022 https://doi.org/10.1109/EMBC48229.2022.9871023 Citation Details
Olikkal, Parthan and Pei, Dingyi and Karri, Bharat Kashyap and Satyanarayana, Ashwin and Kakoty, Nayan M and Vinjamuri, Ramana "Biomimetic learning of hand gestures in a humanoid robot" Frontiers in Human Neuroscience , v.18 , 2024 https://doi.org/10.3389/fnhum.2024.1391531 Citation Details
Olikkal, Parthan and Pei, Dingyi and Karri, Bharat Kashyap and Satyanarayana, Ashwin and Kakoty, Nayan M and Vinjamuri, Ramana "Learning Hand Gestures using Synergies in a Humanoid Robot" , 2023 https://doi.org/10.1109/ROBIO58561.2023.10354698 Citation Details
Pei, Dingyi and Adali, Tulay and Vinjamuri, Ramana "Generalizability of Hand Kinematic Synergies derived using Independent Component Analysis" , 2021 https://doi.org/10.1109/EMBC46164.2021.9630420 Citation Details
Pei, Dingyi and Olikkal, Parthan and Adali, Tulay and Vinjamuri, Ramana "Dynamical Synergies in Multidigit Hand Prehension" 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) , 2022 https://doi.org/10.1109/EMBC48229.2022.9871888 Citation Details
Pei, Dingyi and Olikkal, Parthan and Adali, Tülay and Vinjamuri, Ramana "Reconstructing Synergy-Based Hand Grasp Kinematics from Electroencephalographic Signals" Sensors , v.22 , 2022 https://doi.org/10.3390/s22145349 Citation Details
Safavi, Farshad and Olikkal, Parthan and Pei, Dingyi and Kamal, Sadia and Meyerson, Helen and Penumalee, Varsha and Vinjamuri, Ramana "Emerging Frontiers in HumanRobot Interaction" Journal of Intelligent & Robotic Systems , v.110 , 2024 https://doi.org/10.1007/s10846-024-02074-7 Citation Details
(Showing: 1 - 10 of 12)

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page