Award Abstract # 1618096
CHS: Small: Coordination of Opportunistic Actions to Produce Globally Effective Behaviors for Physical Crowdsourcing

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: NORTHWESTERN UNIVERSITY
Initial Amendment Date: July 5, 2016
Latest Amendment Date: July 5, 2016
Award Number: 1618096
Award Instrument: Standard Grant
Program Manager: William Bainbridge
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: July 1, 2016
End Date: June 30, 2021 (Estimated)
Total Intended Award Amount: $496,380.00
Total Awarded Amount to Date: $496,380.00
Funds Obligated to Date: FY 2016 = $496,380.00
History of Investigator:
  • Haoqi Zhang (Principal Investigator)
    hq@northwestern.edu
  • Darren Gergle (Co-Principal Investigator)
Recipient Sponsored Research Office: Northwestern University
633 CLARK ST
EVANSTON
IL  US  60208-0001
(312)503-7955
Sponsor Congressional District: 09
Primary Place of Performance: Northwestern University
2133 Sheridan Road
IL  US  60208-4001
Primary Place of Performance
Congressional District:
09
Unique Entity Identifier (UEI): EXZVPWZBLUE8
Parent UEI:
NSF Program(s): HCC-Human-Centered Computing
Primary Program Source: 01001617DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7367, 7923
Program Element Code(s): 736700
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

This project will develop theory, algorithms, and example systems for motivating large numbers of autonomous individuals to solve problems that require coordination in the physical world. In these "physical crowdsourcing" systems, people make small contributions toward a larger collective problem, such as tracking animal species or air quality for citizen science projects or providing rides or package delivery in commercial applications. In these systems, opportunistically relying on people to do convenient parts of the problem causes incomplete solutions, while directing people to do inconvenient tasks requires high incentives. By modeling the timing and location of tasks, along with knowledge of people's routines, the project will develop algorithms that make use of ideas from decision theory to best decide when, where and to whom to suggest tasks, in a way that balances individual convenience with system needs. Doing this should increase people's willingness to participate, reduce the need to incentivize participation, and create more complete, timely, and accurate solutions to the collective problem. The investigators will develop several prototype systems that address practical problems such as package delivery and lost and found searches to demonstrate the effectiveness of their ideas; they will also release a toolkit that allows other people to use their work when designing their own physical crowdsourcing systems for solving both scientific and practical problems of interest to society.

The work will be carried out in three main phases. The first phase will develop "incentive chaining", a strategy to encourage opportunistic contributors to become more directable. Using an existing prototype for surveying tree species, the team will model people's opportunistic contributions and routines, then suggest relatively easy "nearby" tasks where others have contributed but where further work is needed, building people's interest and capacity to contribute. Once the nearby collaborative tasks are done, the system will direct these experienced and motivated contributors toward new areas and tasks, which will in turn become the "nearby" contributions that attract the next round of contributors. The second phase will develop decision-theoretic hit-or-wait algorithms to decide if and when to notify contributors about tasks, using a community-based lost and found application. Building on the modeling of behavioral routines, these algorithms will use sequential decision processes to estimate the maximize total value of tasks that contributors will complete, given individuals' history and current state, the system-determined value of nearby tasks, and the system's estimate of how likely the contributor would be to respond to a notification. The third phase will develop notification policies that satisfy the system's quality of service needs while minimizing disruption to contributors. To do this, the investigators will develop a supply management framework that considers the pool of available helpers, the current task demand and values, and a range of policies for making directed requests and evaluate it in the context of a peer-to-peer package delivery system.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Kapil Garg, Yongsung Kim, Darren Gergle, and Haoqi Zhang "4X: A Hybrid Approach for Scaffolding Data Collection and Interest in Low-Effort Participatory Sensing" ACM CSCW , 2019 https://doi.org/10.1145/3359192
Ryan Louie, Darren Gergle, and Haoqi Zhang "Opportunistic Collective Experiences: Surfacing Situations that Arise for Engaging in Shared Experiences and Activities at Distance" ACM CSCW 2020 , 2020
Yongsung Kim, Darren Gergle, Haoqi Zhang "Hit-or-Wait: Coordinating Opportunistic Low-effort Contributions to Achieve Global Outcomes in On-the-go Crowdsourcing" CHI 2018 , 2018
Yongsung Kim, Emily Harburg, Shana Azria, Aaron Shaw, Elizabeth Gerber, Darren Gergle, and Haoqi Zhang. "Studying the Effects of Task Notification Policies on Participation and Outcomes in On-the-go Crowdsourcing" Proceedings of the AAAI Conference on Human Computation and Crowdsourcing (HCOMP ?16) , 2016

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The goal of this project was to enhance physical crowdsourcing--the presentation of physical tasks and activities to people who make small contributions toward a collective problem--by designing interactions, algorithms and architectures that produce globally effective behaviors from opportunistic contributions. Our research aims to enable physical crowdsourcing systems to tap into the rich daily physical routines of on-the-go Americans to better transport goods, map the world in exquisite new detail, and accomplish a broad range of tasks at scale in their communities. A core challenge is in bringing together the benefits of opportunistic approaches--which give users the freedom to contribute where they wish but make it difficult to guarantee globally effective solutions--and directed approaches--that prompt users for input based on high-level system goals but can require contributions outside people's existing routines or otherwise require strong incentives. To overcome this challenge, the PIs and team advanced a hybrid approach through building theory, algorithms and a framework to indirectly coordinate individuals who when induced to make small contributions through their existing routines, will jointly achieve complex communal and societal goals, such as surveying the natural world at unprecedented resolutions, performing efficient search over large regions, and producing on-time transport of goods.

Specifically, the project led to four key technological and theoretical developments:

(1) We advanced principles for flexible coordination, or ways to engage people to contribute when it is convenient for them to do so, but that nevertheless are indirectly coordinated to achieve globally effective outcomes.

(2) We developed a new data-collection framework we call 4X---eXplore, eXpand, eXploit and eXterminate---that uses flexible coordination principles to dynamically switch across data collection strategies to collect low-effort contributions by reasoning about volunteers' dynamic changing state of interests and current knowledge about the world.

(3) We developed two decision-theoretic mechanisms for flexible coordination: (A) Opportunistic Hit-or-Wait, which makes dynamic decisions about when to engage a volunteer to make contributions en-route (e.g., searching for a lost item) when it is convenient for them and valuable for the system (e.g., where the item is likely lost); and (B) Opportunistic Supply Management, which makes dynamic decisions about how to engage a community of volunteers in a way that can optimize the desired balance between the experience of volunteers (e.g., avoiding disruption) and the goals of the system (e.g., transporting goods for community members).

(4) Using our understanding of flexible coordination from physical crowdsourcing, we also developed technologies for helping friends and families connect at distance. Unlike existing social technologies that largely promote engaging with posted social content (e.g., via feeds and commenting on posts), our early design and technical work on Opportunistic Collective Experiences (OCEs) promoted active engagement in shared activities with friends and family at a distance during opportune moments in their lives.

Our evaluation work demonstrated the effectiveness of the flexible coordination approach. Specifically, we conducted user studies on 4X, Opportunistic Hit-or-Wait, Opportunistic Supply Management, and OCEs that collective provide evidence for how flexibly engaging individuals to contribute to collective problems or connect with friends and family can support completing communal tasks, gathering useful information, and enhance social connections -- all while minimally disrupting users by weaving tasks and interactions into people's routines, and inline with their interests. For example, the 4X framework created 34% more opportunities for contributing data without increasing disruption; moreover, participating in OCEs led to higher feelings of being a part of a group than viewing posts and replies on social media and helped people connect with friends who they normally wouldn't reach out to or direct message.

These findings suggest that communities and organizations can better achieve desired goals while attending to the needs and interests of volunteers, workers, and citizens by using the flexible coordination type of mechanisms that we pioneered. More broadly, our findings show the promise of using flexible coordination principles for creating entirely new way for intelligent systems to help people manage the complexities of modern life, which often requires us to intelligently address multiple competing goals, in which systems do not prescribe actions but instead surface them within the flow of people's changing activities, availabilities and interests. In other words, they allow individuals and communities to achieve the benefits of coordinating with one another, while at the same time preserving the benefits of flexibility and individual autonomy.


Last Modified: 11/04/2021
Modified by: Haoqi Zhang

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page