Skip to feedback

Award Abstract # 1928614
FW-HTF-RL: Collaborative Research: Future expert work in the age of "black box", data-intensive, and algorithmically augmented healthcare

NSF Org: ECCS
Division of Electrical, Communications and Cyber Systems
Recipient: NEW YORK UNIVERSITY
Initial Amendment Date: August 1, 2019
Latest Amendment Date: November 17, 2022
Award Number: 1928614
Award Instrument: Standard Grant
Program Manager: Richard Nash
rnash@nsf.gov
 (703)292-5394
ECCS
 Division of Electrical, Communications and Cyber Systems
ENG
 Directorate for Engineering
Start Date: September 1, 2019
End Date: August 31, 2025 (Estimated)
Total Intended Award Amount: $1,500,000.00
Total Awarded Amount to Date: $1,548,000.00
Funds Obligated to Date: FY 2019 = $1,500,000.00
FY 2020 = $16,000.00

FY 2021 = $16,000.00

FY 2023 = $16,000.00
History of Investigator:
  • Oded Nov (Principal Investigator)
    on272@nyu.edu
  • Maurizio Porfiri (Co-Principal Investigator)
  • Batia Wiesenfeld (Co-Principal Investigator)
  • Yindalon Aphinyanaphongs (Co-Principal Investigator)
  • Yvonne Lui (Co-Principal Investigator)
Recipient Sponsored Research Office: New York University
70 WASHINGTON SQ S
NEW YORK
NY  US  10012-1019
(212)998-2121
Sponsor Congressional District: 10
Primary Place of Performance: New York University
5 Metrotech Center
New York
NY  US  10012-1019
Primary Place of Performance
Congressional District:
10
Unique Entity Identifier (UEI): NX9PXMKW5KW8
Parent UEI:
NSF Program(s): FW-HTF Futr Wrk Hum-Tech Frntr,
EPMD-ElectrnPhoton&MagnDevices
Primary Program Source: 01002324DB NSF RESEARCH & RELATED ACTIVIT
01001920DB NSF RESEARCH & RELATED ACTIVIT

01002021DB NSF RESEARCH & RELATED ACTIVIT

01002122DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 063Z, 116E, 1517, 9102, 9178, 9231, 9251
Program Element Code(s): 103Y00, 151700
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.041

ABSTRACT

The nature of expert work is changing. Technological advances such as artificial intelligence and data science increasingly enable new computerized tools and products that make predictions and recommendations which were previously made by human experts. However, many of these new tools are "black boxes" whose inner workings are often not understood by their users, place demands that create cognitive load, and de-emphasize abstract problem solving. As these technologies are being deployed, there is little understanding of how they affect experts' work practices, perceptions of the value of work, and the expert-client relationship. Foundational research is needed in order to understand and improve work in an age of data-intensive enhanced cognition, especially in healthcare where such new technologies are rapidly changing expert work. This project is expected to transform the future of expert work through a combined redesign of technology, workflow, and interactions. It will lead to: a healthier and better-informed population; efficient deployment of human capabilities in restructured healthcare occupations; healthcare providers reducing the proportion of time spent on repetitive tasks while increasing time devoted to value-adding, meaningful activities; guidelines on design and delivery of cognition-augmenting expert advice; and students who are well versed in cross-disciplinary research on cognition-augmenting technologies in the workplace.

The project's goals are: i) to study the relationships between experts, patients, and technologies in a multidisciplinary way; ii) to develop new ways for these technologies to serve experts and clients; and iii) to make expert work more responsive, value-adding, and meaningful. The project includes two strands. In the "Understand" strand, the interactions between experts, clients and cognition-augmenting technologies are examined. In the "Shape" strand, the project lays the foundations for technological and organizational interventions that will make the interactions between experts, clients, and technology more effective and empowering. With a multidisciplinary team including researchers in computer science, human-computer interaction, dynamical systems, and organization alongside with medical clinicians, the project will contribute: i) scalable approaches toward quantifying the benefits and drawbacks of cognition-augmented interactions, as well as measuring information flow in relationships between experts, clients, and cognition augmenting technologies; ii) insights into when, why, and how cognition-augmenting technologies are experienced as expertise enhancing, rather than degrading; iii) data-driven methodologies to predict the effects of technical and organizational interventions on experts' work and experts' interaction with patients; iv) novel tools and workflows for experts and clients to interact with black-box cognition-augmenting technologies; v) modeling how representation of problems can be embedded in expert; and vi) systematic exploration of explanation and dialogue interventions with regard to how they affect experts' work and expert-client relationship.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 43)
Mann, Devin M and Lawrence, Katharine "Reimagining Connected Care in the Era of Digital Medicine" JMIR mHealth and uHealth , v.10 , 2022 https://doi.org/10.2196/34483 Citation Details
Balestra, Martina and Chen, Ji and Iturrate, Eduardo and Aphinyanaphongs, Yindalon and Nov, Oded "Predicting inpatient pharmacy order interventions using provider action data" JAMIA Open , v.4 , 2021 https://doi.org/10.1093/jamiaopen/ooab083 Citation Details
Barak_Ventura, Roni and Catalano, Angelo and Succar, Rayan and Porfiri, Maurizio "Automating the assessment of wrist motion in telerehabilitation with haptic devices" , 2024 https://doi.org/10.1117/12.3010545 Citation Details
Barak Ventura, Roni and Nov, Oded and Ruiz Marin, Manuel and Raghavan, Preeti and Porfiri, Maurizio "A low-cost telerehabilitation paradigm for bimanual training" IEEE/ASME Transactions on Mechatronics , 2021 https://doi.org/10.1109/TMECH.2021.3064930 Citation Details
Barak_Ventura, Roni and Ruan, Ligao and Porfiri, Maurizio "Detecting impaired movements of stroke patients in bimanual training from motion sensor data" , 2024 https://doi.org/10.1117/12.3010546 Citation Details
Barak Ventura, Roni and Stewart Hughes, Kora and Nov, Oded and Raghavan, Preeti and Ruiz Marín, Manuel and Porfiri, Maurizio "Data-Driven Classification of Human Movements in Virtual RealityBased Serious Games: Preclinical Rehabilitation Study in Citizen Science" JMIR Serious Games , v.10 , 2022 https://doi.org/10.2196/27597 Citation Details
Bell, Andrew and Nov, Oded and Stoyanovich, Julia "The Algorithmic Transparency Playbook: A Stakeholder-first Approach to Creating Transparency for Your Organizations Algorithms" 2023 CHI Conference on Human Factors in Computing Systems , 2023 https://doi.org/10.1145/3544549.3574169 Citation Details
Bell, Andrew and Nov, Oded and Stoyanovich, Julia "Think about the stakeholders first! Toward an algorithmic transparency playbook for regulatory compliance" Data & Policy , v.5 , 2023 https://doi.org/10.1017/dap.2023.8 Citation Details
Bell, Andrew and Solano-Kamaiko, Ian and Nov, Oded and Stoyanovich, Julia "Its Just Not That Simple: An Empirical Study of the Accuracy-Explainability Trade-off in Machine Learning for Public Policy" ACM Conference on Fairness, Accountability, and Transparency 2022 Pages 248266 , 2022 https://doi.org/10.1145/3531146.3533090 Citation Details
Chunara, Rumi and Zhao, Yuan and Chen, Ji and Lawrence, Katharine and Testa, Paul A and Nov, Oded and Mann, Devin M "Telemedicine and Healthcare Disparities: A cohort study in a large healthcare system in New York City during COVID-19" Journal of the American Medical Informatics Association , 2020 https://doi.org/10.1093/jamia/ocaa217 Citation Details
Clark, Phoebe and Kim, Jayne and Aphinyanaphongs, Yindalon "Marketing and US Food and Drug Administration Clearance of Artificial Intelligence and Machine Learning Enabled Software in and as Medical Devices: A Systematic Review" JAMA Network Open , v.6 , 2023 https://doi.org/10.1001/jamanetworkopen.2023.21792 Citation Details
(Showing: 1 - 10 of 43)

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page