Award Abstract # 1704682
CHS: Medium: Collaborative Research: Managing Stress in the Workplace: Unobtrusive Monitoring and Adaptive Interventions

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: UNIVERSITY OF HOUSTON SYSTEM
Initial Amendment Date: June 21, 2017
Latest Amendment Date: March 29, 2019
Award Number: 1704682
Award Instrument: Continuing Grant
Program Manager: Todd Leen
tleen@nsf.gov
 (703)292-7215
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: August 1, 2017
End Date: January 31, 2022 (Estimated)
Total Intended Award Amount: $380,000.00
Total Awarded Amount to Date: $409,898.00
Funds Obligated to Date: FY 2017 = $380,000.00
FY 2019 = $29,898.00
History of Investigator:
  • Ioannis Pavlidis (Principal Investigator)
    ipavlidis@uh.edu
Recipient Sponsored Research Office: University of Houston
4300 MARTIN LUTHER KING BLVD
HOUSTON
TX  US  77204-3067
(713)743-5773
Sponsor Congressional District: 18
Primary Place of Performance: University of Houston
4302 University Drive, Room 316
Houston
TX  US  77204-6022
Primary Place of Performance
Congressional District:
18
Unique Entity Identifier (UEI): QKWEF8XLMTT3
Parent UEI:
NSF Program(s): HCC-Human-Centered Computing,
IIS Special Projects
Primary Program Source: 01001718DB NSF RESEARCH & RELATED ACTIVIT
01001920DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7484, 7924, 7367
Program Element Code(s): 736700, 748400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Workplace stress is a serious problem that has a direct and negative impact on health, happiness, and productivity. Current approaches for both measuring stress and reducing it are limited; measurements typically rely on self-report or obtrusive sensors, while people often don't seek treatment until the stress has built to dangerous levels (or at all, if they are afraid of other people's judgments). This project's goal is to develop methods both to detect stress and provide personalized relaxation exercises, in real time and in the work context. To detect stress, the research team will study how well data from commonly available devices at work such as webcams, fitness trackers, and keyboards can predict individuals' stress levels. To reduce stress, the team will develop a suite of brief relaxation exercises and a system that uses predicted stress levels to recommend different exercises, learning over time which ones work best for a particular person. These predictive models and interventions will be tested in a long-term study in a real office environment, both validating the work and providing direct effects on experimental participants' well-being. The project will also have direct educational impacts for groups underrepresented in STEM fields and generate anonymized datasets that other researchers can use.

The team will develop experimental methods to reliably extract stress cues from commodity devices, using a suite of cognitive tasks that represent knowledge work and typical workplace stressors (e.g., time pressure, noise, distractions). Participants will perform the tasks and experience stressors while the team collects behavioral data from the commodity devices and ground truth stress measurements using physiological signals derived from thermal imaging. The team will evaluate how well features derived from the sensed behavioral data, using different sets of devices, can predict the ground truth stress data and how it varies based on specific stressors. The team will also develop a framework to deliver brief stress-reduction exercises that promote deep breathing, a proven effective and learnable stress reduction technique. The team will use iterative prototyping to develop novel, engaging mobile apps that use biofeedback, games, and music to support breathing exercises; these will be delivered by a multi-arm bandit-based recommendation system that considers the current context (predicted stress and stressors, time of day, particular computer activities) along with historical exercise adherence and results to suggest effective exercises. The stress sensing models and intervention framework will be validated through a series of lab and field studies with information workers at a software company, collecting stress data in situ with ecological momentary assessment techniques, validated survey instruments for stress and affect, and interviews.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Akbar, Fatema and Mark, Gloria and Pavlidis, Ioannis and Gutierrez-Osuna, Ricardo "An empirical study comparing unobtrusive physiological sensors for stress detection in computer work" Sensors , v.19 , 2019 Citation Details
Akbar, Fatema and Pavlidis, Ioannis and Storer, Kevin and Wang, Zelun and Wesley, Amanveer and Zaman, Shaila and Bayraktaroglu, Ayse Elvan and Buddharaju, Pradeep and Da Cunha Silva, Dennis Rodrigo and Gao, Ge and Grover, Ted and Gutierrez-Osuna, Ricardo "Email Makes You Sweat: Examining Email Interruptions and Stress Using Thermal Imaging" Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems , 2019 10.1145/3290605.3300898 Citation Details
Akleman, Ergun and Hasan, MD Tanim and Pavlidis, Ioannis "Under the Spell of Deadlines" CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems , 2021 https://doi.org/10.1145/3411763.3450366 Citation Details
Blank, Christopher and Zaman, Shaila and Wesley, Amanveer and Tsiamyrtzis, Panagiotis and Da Cunha Silva, Dennis R. and Gutierrez-Osuna, Ricardo and Mark, Gloria and Pavlidis, Ioannis "Emotional Footprints of Email Interruptions" CHI '20: CHI Conference on Human Factors in Computing Systems , 2020 10.1145/3313831.3376282 Citation Details
Dukes, Daniel and Abrams, Kathryn and Adolphs, Ralph and Ahmed, Mohammed E. and Beatty, Andrew and Berridge, Kent C. and Broomhall, Susan and Brosch, Tobias and Campos, Joseph J. and Clay, Zanna and Clément, Fabrice and Cunningham, William A. and Damasio, "The rise of affectivism" Nature Human Behaviour , v.5 , 2021 https://doi.org/10.1038/s41562-021-01130-8 Citation Details
Hasan, MD Tanim and Zaman, Shaila and Wesley, Amanveer and Tsiamyrtzis, Panagiotis and Pavlidis, Ioannis "Sympathetic Activation in Deadlines of Deskbound Research - A Study in the Wild" CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems , 2023 https://doi.org/10.1145/3544549.3585585 Citation Details
Zaman, Shaila and Wesley, Amanveer and Silva, Dennis Rodrigo Da Cunha and Buddharaju, Pradeep and Akbar, Fatema and Gao, Ge and Mark, Gloria and Gutierrez-Osuna, Ricardo and Pavlidis, Ioannis "Stress and productivity patterns of interrupted, synergistic, and antagonistic office activities" Scientific Data , v.6 , 2019 https://doi.org/10.1038/s41597-019-0249-5 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Fear not the deadlines, new research finds!

Our project investigated the effects of temporal stressors and distractions on knowledge workers. First, we conducted controlled experiments in the lab to gain some fundamental understanding of the phenomena and perfect our measurement methods. Armed with this understanding and our newly developed technical capabilities, we concluded our research by carrying out naturalistic studies to observe these phenomena in the actual world. In the said naturalistic studies, per an institutionally approved protocol, we monitored the conditions and behaviors of academic researchers as they were working their way towards and out of proposal and paper deadlines.

 

We chose to study deadlines because they are part and parcel of modern knowledge work. Journalists must serve their weekly columns, managers must turn in their monthly reports, and researchers must submit their papers and proposals on time. Despite their ubiquity, deadlines conjure up negative feelings and are perceived as challenging events. Accordingly, there has been a trend to do away with deadlines, where possible.  Critics, however, have been arguing that although deadlines may be painful, they are necessary, because they motivate people to act.

 

The key question we set out to address was the following: "Does knowledge work near deadlines incurs higher sympathetic load than knowledge work away from deadlines?" Sympathetic activation is the state of physiological arousal that indicates how much people are "on the tips of their toes". Sympathetic activation often leads to stress, and this is why its intensity and duration should be kept in check. 

 

Our naturalistic study was the first of its kind. Miniature cameras were placed at the researchers' university office to unobtrusively record their facial physiology and expressions, as well as their movements throughout the working day. The participants' sympathetic activation was measured every second through quantification of their imaged perinasal perspiration levels. Applying advanced data modeling on hundreds of hours of multimodal recordings, our team found that researchers experience high sympathetic activation while working, which speaks to the challenging nature of the research profession. Surprisingly, this high sympathetic activation remains about the same with or without deadlines. "Research is tough every day! If I were to use a metaphor, if you are under heavy rain all the time, if one day the rain is a little heavier, it would not make much difference to you, because you are already wet to the bone. This is what our models show with respect to the effect of deadlines on researchers", Pavlidis, one of the principal investigators, commented.

 

The only factors found to exacerbate sympathetic activation were extensive smartphone use and prolific reading/writing. The first factor is manifestation of the gadget-based addiction trends that have altered human behaviors across the board. The second factor is integral to research work, and thus unavoidable. Thankfully, however, researchers appear to auto-regulate increases in their sympathetic activation by instinctively adjusting the frequency of physical breaks. It was observed that on average researchers take one physical break every two hours. From this baseline, data analysis showed that for every 50% increase in sympathetic activation, the break frequency nearly doubles, revealing the limits of cognitive work under increasing stress. 

 

"Our naturalistic study not only brings fresh insights into researchers' behaviors but also challenges some prevailing views about deadlines", Pavlidis said. "With the recent advances in affective computing, I expect such naturalistic studies to proliferate across domains, challenging misconceptions we hold about a lot of things", Pavlidis remarked.

 

 

 

 


Last Modified: 07/11/2023
Modified by: Ioannis Pavlidis

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page