Award Abstract # 1565269
CSR: Large: Collaborative Research: Smart earpiece for supporting healthy eating behaviors

NSF Org: CNS
Division Of Computer and Network Systems
Recipient: TRUSTEES OF DARTMOUTH COLLEGE
Initial Amendment Date: September 20, 2016
Latest Amendment Date: October 30, 2017
Award Number: 1565269
Award Instrument: Continuing Grant
Program Manager: Marilyn McClure
mmcclure@nsf.gov
 (703)292-5197
CNS
 Division Of Computer and Network Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: October 1, 2016
End Date: September 30, 2020 (Estimated)
Total Intended Award Amount: $1,082,976.00
Total Awarded Amount to Date: $1,098,976.00
Funds Obligated to Date: FY 2016 = $515,493.00
FY 2017 = $567,483.00

FY 2018 = $16,000.00
History of Investigator:
  • David Kotz (Principal Investigator)
    David.F.Kotz@Dartmouth.edu
  • Kofi Odame (Co-Principal Investigator)
  • Ryan Halter (Co-Principal Investigator)
  • Xing-Dong Yang (Co-Principal Investigator)
Recipient Sponsored Research Office: Dartmouth College
7 LEBANON ST
HANOVER
NH  US  03755-2170
(603)646-3007
Sponsor Congressional District: 02
Primary Place of Performance: Dartmouth College
6211 Sudikoff Lab
Hanover
NH  US  03755-3510
Primary Place of Performance
Congressional District:
02
Unique Entity Identifier (UEI): EB8ASJBCFER9
Parent UEI: T4MWFG59C6R3
NSF Program(s): Special Projects - CNS,
CSR-Computer Systems Research
Primary Program Source: 01001617DB NSF RESEARCH & RELATED ACTIVIT
01001718DB NSF RESEARCH & RELATED ACTIVIT

01001819DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7925, 9150, 9251
Program Element Code(s): 171400, 735400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Obesity is one of the most pressing health challenges faced by our country, and has been the target of much attention in the mobile health (mHealth) community. While the science of obesity indicates that diet is a major factor in behavioral change to encourage healthy weight management, we are still not able to effectively, quickly and easily measure eating and drinking behavior. This project's goal is to develop a digital earpiece ­­ small and comfortable enough to wear behind the ear ­­ that can sense and detect actions such as eating and drinking. The project's long­term vision is to enable behavioral­health researchers to better understand health­related behaviors and, subsequently, to support the development of effective behavioral­health interventions that promote healthy diet and behavior.
Ultimately, a better understanding of eating­related behaviors, and better design of effective interventions regarding eating behavior, will have profound impact on personal and public health as well as the national economy. The project's hardware and software prototypes will be shared widely in the research community to enable experimentation around the sensing and interaction opportunities possible in an earpiece device. Furthermore, the project directly involves undergraduate and graduate students in interdisciplinary research, and outreach to middle­school students, expanding the supply of scientists educated in this important emerging topic.

The goal of the proposed work is to develop a digital earpiece ­­ small and comfortable enough to wear behind the ear ­­ that can sense and detect actions such as eating, drinking, smoking, and speaking, and measure physiological stress. The project's long­term vision is that computational jewelry like this earpiece will enable behavioral­health researchers to better understand health­related behaviors and, subsequently, to support the validation and deployment of effective behavioral­health interventions that promote healthy diet and behavior.
The project's approach is to build a prototype wireless earpiece, small enough to wear behind the ear, with low­power (microwatt­scale) electronics and software sufficient to allow for the battery to last a full waking day; to develop efficient algorithms for detecting and distinguishing health­related behaviors (eating, drinking, smoking, speaking, and stress); and to develop easy and effective means for the wearer to interact with the earpiece and its applications.
Contributions: The team expects to answer scientific questions important to achieving the above goals. Specifically, they seek to advance scientific knowledge through the design and development of a wireless earpiece capable of sensing behavior and interacting with its wearer; develop novel low­power analog electronics and distributed software algorithms for inferring relevant behaviors from sensor data; develop novel interaction modalities involving bone­conduction audio between the earpiece and its wearer, complemented by tactile interfaces on the earpiece, on the skin, or on auxiliary devices like a wristband or smartphone; and validate these approaches through user studies and experiments inside and outside the lab.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Gong, Jun and Yang, Xin and Seyed, Teddy and Davis, Josh Urban and Yang, Xing-Dong "Indutivo: Contact-Based, Object-Driven Interactions with Inductive Sensing" Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology , 2018 10.1145/3242587.3242662 Citation Details
Gong, Jun; Yang, Xin; Seyed, Teddy; Davis, Josh Urban; Yang, Xing-Dong "Indutivo: Contact-Based, Object-Driven Interactions with Inductive Sensing" Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology , 2018 , p.321 10.1145/3242587.3242662
J. Gong, Y. Zhang, X. Zhou, and X.-D. Yang "Pyro: Thumb-Tip gesture recognition using pyroelectric infrared sensing" Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST) , 2017 , p.553 10.1145/3126594.3126615
Jun Gong, Yu Wu, Lei Yan, Teddy Seyed, and Xing-Dong Yang "Tessutivo: Contextual Interactions on Interactive Fabrics with Inductive Sensing" Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19) , 2019 10.1145/3332165.3347897
Lesniara-Stachon, Anna and Quansah, Dan Yedu and Schenk, Sybille and Retsa, Chrysa and Halter, Ryan J and Murray, Micah M and Lacroix, Alain and Horsch, Antje and Toepel, Ulrike and Puder, Jardena J "Brain responses to food viewing in women during pregnancy and post partum and their relationship with metabolic health: study protocol for the FOODY Brain Study, a prospective observational study" BMJ Open , v.13 , 2023 https://doi.org/10.1136/bmjopen-2022-067013 Citation Details
Maria T. Nyamukuru and Kofi Odame "Tiny Eats : Eating Detection on a Microcontroller" IEEE Workshop on Machine Learning on Edge in Sensor Systems (SenSys-ML) , 2020 10.1109/SenSysML50931.2020.00011
Shengjie Bi, Tao Wang, Nicole Tobias, Josephine Nordrum, Shang Wang, George Halvorsen, Sougata Sen, Ronald Peterson, Kofi Odame, Kelly Caine, Ryan Halter, Jacob Sorber, and David Kotz. "Auracle: Detecting Eating Episodes with an Ear-Mounted Sensor" Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) (Ubicomp) , v.2 , 2018 10.1145/3264902
Te-Yen Wu, Shutong Qi, Junchi Chen, MuJie Shang, Jun Gong, Teddy Seyed, and Xing-Dong Yang "Fabriccio: Touchless Gestural Input on Interactive Fabrics" Proceedings of the Conference on Human Factors in Computing Systems (CHI) , 2020 10.1145/3313831.3376681

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page