Award Abstract # 1453141
CAREER: Advances in Monitoring Human Performance: Moving Wearable Technology from the Expert to Nonexpert User

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Initial Amendment Date: March 3, 2015
Latest Amendment Date: July 2, 2019
Award Number: 1453141
Award Instrument: Continuing Grant
Program Manager: Ephraim Glinert
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: July 1, 2015
End Date: June 30, 2021 (Estimated)
Total Intended Award Amount: $625,901.00
Total Awarded Amount to Date: $635,901.00
Funds Obligated to Date: FY 2015 = $153,023.00
FY 2016 = $112,113.00

FY 2017 = $123,867.00

FY 2018 = $123,746.00

FY 2019 = $123,152.00
History of Investigator:
  • Leia Stirling (Principal Investigator)
    leias@umich.edu
Recipient Sponsored Research Office: Massachusetts Institute of Technology
77 MASSACHUSETTS AVE
CAMBRIDGE
MA  US  02139-4301
(617)253-1000
Sponsor Congressional District: 07
Primary Place of Performance: Massachusetts Institute of Technology
MA  US  02139-4307
Primary Place of Performance
Congressional District:
07
Unique Entity Identifier (UEI): E2NYLCDML6V1
Parent UEI: E2NYLCDML6V1
NSF Program(s): HCC-Human-Centered Computing
Primary Program Source: 01001516DB NSF RESEARCH & RELATED ACTIVIT
01001617DB NSF RESEARCH & RELATED ACTIVIT

01001718DB NSF RESEARCH & RELATED ACTIVIT

01001819DB NSF RESEARCH & RELATED ACTIVIT

01001920DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 1045, 7218, 7367, 9251
Program Element Code(s): 736700
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Wearable computing technology is rapidly proliferating and playing an increasing role in our daily lives. The PI's focus in this research is on developing technology for the monitoring by non-experts of human performance within the context of stroke rehabilitation, which will be applicable to a wide spectrum of applications. Robust performance metrics that can be interpreted by a non-expert would enable people to track their well-being in a manner not currently possible. With technology in the home environment, there is the potential to better engage the user in self-monitoring, to increase motivation, and to improve motion strategies for activities related to well-being. From the healthcare professional's perspective, wearable technology in the home could allow the clinician to change the balance of time so as to emphasize educating and working with the patient on enabling tasks, because the wearable technology would provide information on compliance history and progress. The longitudinal data from the sensors would also permit improved evaluation of patient-specific dose-response sensitivity. The human-centered research methodology implemented here will also provide new insights into systems modeling heuristics, in particular how to formalize relationships between the human and computer entities of the systems architecture. Because the research will involve both healthy and stroke participant groups, project outcomes will include a novel database with participant demographics, expert outcome measures, and daily home task performance which will permit the advancement of new algorithms and will provide a way to compare algorithm performance across populations.

The PI argues that higher fidelity motion sensing is the key to empowering improved human performance, goal monitoring, and well-being. To this end, in this project she will extend the capabilities of wearable motion sensing technology through advances in dynamic system modeling and signal processing to account for the underlying variability in motion and compliant structure of the individual. A cyber-human platform will be developed for those with limited knowledge in sensor technology and physiological systems (non-experts), through analysis of performance metrics and decision-making interfaces with the end user in mind. The effort will involve three related thrusts that will be demonstrated within the context of stroke rehabilitation: characterization of variability for relevant tasks in a natural environment; application of estimation algorithms and investigation of performance metrics robust to uncertainties in the natural environment; and evaluation of decision-making interfaces synergistic with the expected end user. The PI will implement novel estimation and calibration algorithms to inform performance metric generation, and will integrate these parameters into a user interface that is evaluated in human studies as a platform for decision making across expertise level. By bridging biomechanics and control theory, new capabilities will be enabled for wearable motion-sensing devices that integrate relevant nonlinear models with the appropriate stochasticity, which in turn will lead to exciting research opportunities for the biomechanics community to understand motor behavior in natural settings, as well as adaptations and extensions in control theory from a methods perspective due to new challenges in maintaining calibrations for systems with compliance and underlying variability.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 18)
Fineman, Richard A and McGrath, Timothy M and Kelty-Stephen, Damian G and Abercromby, Andrew FJ and Stirling, Leia A "Objective metrics quantifying fit and performance in spacesuit assemblies" Aerospace medicine and human performance , v.89 , 2018 , p.985--995
Fineman, Richard A and Stirling, Leia A "Quantification and visualization of coordination during non-cyclic upper extremity motion" Journal of biomechanics , v.63 , 2017 , p.82--91
Fineman R, McGrath T, Kelty-Stephen D, Abercromby A, Stirling L "Objective Metrics for Quantifying Fit and Performance in Spacesuit Assemblies" Aerospace Medicine and Human Performance , v.89 , 2018 , p.985
Fineman, R, Stirling, L "Quantification and Visualization of Coordination during Non-Cyclic Upper Extremity Motion" Journal of Biomechanics , v.63 , 2017
Leia Stirling and Julie MacLean "Roadmap for the Development of at-Home Telemonitoring Systems to Augment Occupational Therapy" IEEE Transactions on Human-Machine Systems , v.46 , 2016 , p.569-580
Leia Stirling, Ho Chit Siu, Eric Jones, and Kevin Duda "Human Factors Considerations for Enabling Functional Use of Exosystems in Operational Environments" IEEE Systems Journal , v.13 , 2019 , p.1072-1083
Leia Stirling, Julie MacLean "Roadmap for the Development of at-Home Telemonitoring Systems to Augment Occupational Therapy" IEEE Transactions on Human-Machine Systems , v.46 , 2016 , p.569-580 10.1109/THMS.2015.2506729
L. Stirling, H.C. Siu, E.J., K. Duda "Human Factors Considerations for Enabling Functional Use of Exosystems in Operational Environments" IEEE Systems Journal , v.13 , 2019 , p.1072
L. Stirling L, J. MacLean "Roadmap for the Development of at-Home Telemonitoring Systems to Augment Occupational Therapy" IEEE Transactions on Human-Machine Systems , v.46 , 2016 , p.569
McGrath, Timothy and Fineman, Richard and Stirling, Leia "An auto-calibrating knee flexion-extension axis estimator using principal component analysis with inertial sensors" Sensors , v.18 , 2018 , p.1882
McGrath, Timothy and Stirling, Leia "Body-Worn IMU Human Skeletal Pose Estimation Using a Factor Graph-Based Optimization Framework" Sensors , v.20 , 2020 , p.6887
(Showing: 1 - 10 of 18)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Wearable computing technology is rapidly proliferating and playing an increasing role in our daily lives. The PI's focus in this research was on developing technology for monitoring human performance within the context of stroke rehabilitation that is applicable to a wide spectrum of applications related to human movement assessment. Robust performance metrics that can be interpreted by a non-expert in sensor technologies enables people to track their well-being in a manner not currently possible. With technology in the home environment, there is the potential to better engage the user in self-monitoring, to increase motivation, and to improve motion strategies for activities related to well-being. From the healthcare professional's perspective, wearable technology in the home could allow the clinician to change the balance of time so as to emphasize educating and working with the patient on enabling tasks, because the wearable technology would provide information on compliance history and progress. The longitudinal data from the sensors would also permit improved evaluation of patient-specific dose-response sensitivity. The human-centered research methodology implemented here also provides new insights into systems modeling heuristics, in particular how to formalize relationships between the human and computer entities for decision making needs.


In this project the capabilities of wearable motion sensing technology were extended through advances in dynamic system modeling and signal processing to account for the underlying variability in motion and compliant structure of the individual with evidence-based approaches to assess the robustness of novel metrics of motion performance. During the performance years, the effort (1) characterized clinical decision making of occupational therapists to support the definition of metrics that would augment clinical assessment capabilities; (2) developed new algorithms for estimating human kinematics (the motions of the body); as well as (3) defining metrics of performance that aligned with operational-relevant clinical decision making for balance, coordination, and compensatory motions. Due to the pandemic, an additional task was included that examined telehealth practices of occupational and physical therapists that complemented the initial characterization of clinical decision making. While the initial motivation for the effort was for clinical applications, these methods were also synergistically applied and implemented to support human performance assessment for other wearable technologies, such as space suits and exoskeletons.

 

By bridging biomechanics and statistical modelling, new capabilities were developed for wearable motion-sensing devices that integrated relevant nonlinear models with the appropriate uncertainty, which in turn enabled estimation of body motions using a wearable sensor array. By bridging biomechanics with human factors, the decision making models and essential clinical monitoring criteria were uncovered that informed the definition of human movement performance metrics relevant for supporting assessment and plan of care progressions. The human-centered research methodology implemented in this research to define metrics of performance can support decision making across a variety of fields where mobility is important. Methods from this award will continue to be extended to support clinical decision making, but will also be applied to workplace safety, human performance training and readiness, as well as the assessment of how medical interventions, body-worn gear, and wearable technology affect movement.

 

As part of this effort, the research team engaged with students and teachers in collaboration with the MIT museum and Nord Anglia Education (which has schools around the world and includes a family of more than 50,000 students). Content was developed for teachers and students to support design challenges based on an overall theme of STEAM superheroes. The research team participated in synchronous in-person STEAM teacher workshops and student workshops, as well as developing asynchronous In-School Challenges that could be performed by individual students and student teams with the support of their teachers. The challenges were based on quantifying human performance and informed by ideas related to this research program. The open-ended challenges provided opportunity for students to engage in design thinking in a human-centered community focused mindset that would support their creativity and positive engagement with science and engineering.

 


Last Modified: 07/08/2021
Modified by: Leia Stirling

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page