Award Abstract # 1652203
CAREER: Advanced data analytics and high-resolution cervical auscultation can accurately predict dysphagia

NSF Org: CBET
Division of Chemical, Bioengineering, Environmental, and Transport Systems
Recipient: UNIVERSITY OF PITTSBURGH - OF THE COMMONWEALTH SYSTEM OF HIGHER EDUCATION
Initial Amendment Date: January 26, 2017
Latest Amendment Date: January 26, 2017
Award Number: 1652203
Award Instrument: Standard Grant
Program Manager: Steve Zehnder
szehnder@nsf.gov
 (703)292-7014
CBET
 Division of Chemical, Bioengineering, Environmental, and Transport Systems
ENG
 Directorate for Engineering
Start Date: July 1, 2017
End Date: September 30, 2023 (Estimated)
Total Intended Award Amount: $549,139.00
Total Awarded Amount to Date: $549,139.00
Funds Obligated to Date: FY 2017 = $549,139.00
History of Investigator:
  • Ervin Sejdic (Principal Investigator)
    esejdic@pitt.edu
Recipient Sponsored Research Office: University of Pittsburgh
4200 FIFTH AVENUE
PITTSBURGH
PA  US  15260-0001
(412)624-7400
Sponsor Congressional District: 12
Primary Place of Performance: University of Pittsburgh
Pittsburgh
PA  US  15213-2303
Primary Place of Performance
Congressional District:
12
Unique Entity Identifier (UEI): MKAGLD59JRL1
Parent UEI:
NSF Program(s): Disability & Rehab Engineering
Primary Program Source: 01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 1045
Program Element Code(s): 534200
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.041

ABSTRACT

1652203- Sejdic

Dysphagia (swallowing disorders) causes 150,000 annual hospitalizations, increases pneumonia incidence, and adds 220,000 additional days to hospital admissions each year. Dysphagia risk is currently assessed via screening, and a failed screen then leads to the diagnostic gold-standard, the videofluoroscopic x-ray test. However, many patients who aspirate (take food or drink into their lungs) pass initial screens because they aspirate silently. Therefore, this CAREER project proposes to develop fundamentally new computational tools to be used in conjunction with high-resolution vibration and sound recordings from the neck to screen for dysphagia. First, the project will advance computational models to detect the activities of swallowing from vibration and sound recordings from the neck. Second, the project will advance techniques for making vibration and sound recordings from the neck to better understand how the airway normally protects itself during swallowing to avoid aspiration, and how this is affected during dysphagia. Success in this project will reduce incidence of silent aspiration, but it will also reduce the necessity for overly conservative recommendations that might limit eating and drinking for individuals with neurological disabilities (e.g. stroke, MS, ALS) who are at greater risk of dysphagia. Educational and outreach activities focus on increasing interest in applying new computational techniques to swallowing disorders, as well as encouraging underrepresented groups of students to pursue education and careers in STEM fields.

The PI's long-term research goal is to utilize computational approaches and instrumentation to nurture translation of innovative engineering research to clinically relevant solutions for dysphagia. Therefore, the research objective of this CAREER proposal is the advancement of fundamentally new data analytics tools to be used in conjunction with high-resolution cervical auscultation (HRCA - accelerometer and microphone recordings from the neck) in order to instrumentally screen for dysphagia. The HRCA screening device can detect pharyngeal vibrations caused by dysphagia. As of yet the current device cannot detect silent aspiration before patients are placed at risk. New fundamental advances in data analytics are needed, which is the main research contribution of the proposed program. The PI?s long-term educational goal is to translate advances in dysphagia data analytics into educational modules that will be disseminated to a wide clinical and engineering audience. Hence, the educational objective is to create interdisciplinary training opportunities for high school (e.g., educational modules to be distributed across the US), engineering undergraduate, and graduate students (e.g., an easily accessible open online course), while disseminating the results of this project to a clinical audience as well (e.g., grand rounds). In addition, projects will focus on encouraging underrepresented groups to pursue education and career opportunities in STEM fields.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Coyle, James L. and Sejdi, Ervin "High-Resolution Cervical Auscultation and Data Science: New Tools to Address an Old Problem" American Journal of Speech-Language Pathology , v.29 , 2020 https://doi.org/10.1044/2020_AJSLP-19-00155 Citation Details
Khalifa, Yassin and Coyle, James L. and Sejdi, Ervin "Non-invasive identification of swallows via deep learning in high resolution cervical auscultation recordings" Scientific Reports , v.10 , 2020 https://doi.org/10.1038/s41598-020-65492-1 Citation Details
Khalifa, Yassin and Donohue, Cara and Coyle, James L. and Sejdic, Ervin "Upper Esophageal Sphincter Opening Segmentation With Convolutional Recurrent Neural Networks in High Resolution Cervical Auscultation" IEEE Journal of Biomedical and Health Informatics , v.25 , 2021 https://doi.org/10.1109/JBHI.2020.3000057 Citation Details
Khalifa, Yassin and Mahoney, Amanda S. and Lucatorto, Erin and Coyle, James L. and Sejdi, Ervin "Non-Invasive Sensor-Based Estimation of Anterior-Posterior Upper Esophageal Sphincter Opening Maximal Distension" IEEE Journal of Translational Engineering in Health and Medicine , v.11 , 2023 https://doi.org/10.1109/JTEHM.2023.3246919 Citation Details
Khalifa, Yassin and Mandic, Danilo and Sejdi, Ervin "A review of Hidden Markov models and Recurrent Neural Networks for event detection and localization in biomedical signals" Information Fusion , v.69 , 2021 https://doi.org/10.1016/j.inffus.2020.11.008 Citation Details
Sabry, Aliaa and Mahoney, Amanda S. and Mao, Shitong and Khalifa, Yassin and Sejdi, Ervin and Coyle, James L. "Automatic Estimation of Laryngeal Vestibule Closure Duration Using High-Resolution Cervical Auscultation Signals" Perspectives of the ASHA Special Interest Groups , v.5 , 2020 https://doi.org/10.1044/2020_PERSP-20-00073 Citation Details
SEJDI, Ervin and KHALIFA, Yassin and MAHONEY, Amanda S and COYLE, James L "ARTIFICIAL INTELLIGENCE AND DYSPHAGIA: NOVEL SOLUTIONS TO OLD PROBLEMS" Arquivos de Gastroenterologia , v.57 , 2020 https://doi.org/10.1590/s0004-2803.202000000-66 Citation Details
Yu, Caroline and Khalifa, Yassin and Sejdic, Ervin "Silent aspiration detection in high resolution cervical auscultations" IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) , 2019 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Dysphagia (swallowing disorders) causes 150,000 annual hospitalizations, increases pneumonia incidence, adds 220,000 additional days to hospital admissions each year, and is prevalent in nursing homes. Choking (airway obstruction, asphyxiation) and pneumonia due to aspiration (inhalation of swallowed food and liquids), are common consequences of dysphagia. Both are preventable when dysphagia is identified before patients are offered oral food, liquids, or medications. Furthermore, aspiration without symptoms (silent aspiration) is completely invisible to any observer without sophisticated imaging equipment. Like cancer screening, dysphagia risk is screened by inexpensive and noninvasive tests that attempt to predict the likelihood of dysphagia. Dysphagia screening is limited to observing a patient drinking water and noting whether she/he coughs (failed screen). A failed screen leads to testing with the diagnostic gold-standard videofluoroscopic test, and the nature of the dysphagia and aspiration can then be assessed, and efficacy of corrective treatments tested. However, screening tests only identify at-risk patients who are symptomatic, failing to identify silent aspiration. Many patients who aspirate (60,000 with stroke annually), pass traditional screens because they aspirate silently. Therefore, the intellectual merit of this project was to develop a non-invasive high-resolution cervical auscultation screening device designed to detect pharyngeal vibrations caused by silent aspiration and dysphagia.

The CAREER project aimed to advance novel deep learning approaches to position high-resolution cervical auscultation as a reliable dysphagia screening tool, which can be implemented in immediately upon admission to hospital emergency rooms, in hospital wards and residential institutions, in which dysphagia is prevalent, when a new suspicion of dysphagia and silent aspiration arises insidiously, and in underserved and developing communities. Our goal was to facilitate accident prevention and reductions of in-hospital and community acquired aspiration pneumonia and other adverse outcomes related to dysphagia. Therefore, this CAREER program made the following major contributions:

1)    We related high-resolutions cervical auscultation signals to swallowing physiological events via deep learning methods by modeling interactions between objective swallowing physiology observations from videofluoroscopic tests and the co-occurring high-resolutions cervical auscultation signals. This is a major contribution to the fields of biomedical signal processing (novel deep learning approaches) and speech-language pathology (relating the high-resolutions cervical auscultation signal signatures to actual physiological events for the first time).

2)    We discriminated normal from abnormal airway protection and kinematic functions via machine-learning analysis of high-resolution cervical auscultation signals with similar accuracy as videofluoroscopic tests. We proposed novel deep learning methods used to draw inferences regarding the continuum of abnormal airway protection during swallowing. This was a major contribution for the dysphagia assessment and treatment community (i.e., the rehabilitation community).

3)    We developed a massive open online course to a) facilitate broad research and community development of instrumental swallowing assessment based on high-resolutions cervical auscultation, and b) to share sample data with research and academic communities to facilitate further developments of signal processing methods for swallowing assessments.

4)    In addition to our global outreach efforts, the CAREER project created interdisciplinary learning opportunities for engineering and rehabilitation science students. Engineering students learned about real-life needs for patients with swallowing difficulties and used their engineering background to resolve these issues. Rehabilitation sciences students interested in mitigating disease-related activity limitations and participation restrictions gained a greater understanding of data science, artificial intelligence and machine learning principles.

The broader impact of this proposal was that it supported the development data-driven healthcare approaches, especially in the field of speech-language pathology, which currently underutilizes data-driven efforts to improve patient outcomes. The project enabled us to train future speech-language pathology and engineering researchers in a novel field, and these former trainees are already in academic and industrial positions continuing to work on this novel field of work. Furthermore, by utilizing a massive open online course platform and data sharing efforts, we offer the opportunity to transfer academic results into mainstream clinical practices. Lastly, these resources are valuable for underserved clinicians and students at all levels to enhance their skills and knowledge in this exciting area.


Last Modified: 11/08/2023
Modified by: Ervin Sejdic

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page