
NSF Org: |
IIS Division of Information & Intelligent Systems |
Recipient: |
|
Initial Amendment Date: | August 1, 2014 |
Latest Amendment Date: | August 1, 2014 |
Award Number: | 1407927 |
Award Instrument: | Standard Grant |
Program Manager: |
Maria Zemankova
IIS Division of Information & Intelligent Systems CSE Directorate for Computer and Information Science and Engineering |
Start Date: | September 1, 2014 |
End Date: | August 31, 2018 (Estimated) |
Total Intended Award Amount: | $299,994.00 |
Total Awarded Amount to Date: | $299,994.00 |
Funds Obligated to Date: |
|
History of Investigator: |
|
Recipient Sponsored Research Office: |
809 S MARSHFIELD AVE M/C 551 CHICAGO IL US 60612-4305 (312)996-2862 |
Sponsor Congressional District: |
|
Primary Place of Performance: |
851 South Morgan Street Chicago IL US 60607-7053 |
Primary Place of
Performance Congressional District: |
|
Unique Entity Identifier (UEI): |
|
Parent UEI: |
|
NSF Program(s): | Info Integration & Informatics |
Primary Program Source: |
|
Program Reference Code(s): |
|
Program Element Code(s): |
|
Award Agency Code: | 4900 |
Fund Agency Code: | 4900 |
Assistance Listing Number(s): | 47.070 |
ABSTRACT
Precision modeling tools for realistic and complex human social interaction are not available today. First-person videos provide a unique opportunity to capture social interaction at unprecedented precision. In contrast, current third person surveillance video only records the few distance views of the interaction passively at a much reduced spatial resolution. This exploratory research project proposes to harness multiple first-person cameras as one collective instrument to capture, model, and predict social behaviors. The proposed research transforms the way we construct realistic social interaction models, while also advancing first-person video recognition. If successful, the envisioned computational model can act as a coach who learns what constitutes successful interactions and failures, thus being able to find solutions to mediate and prevent potential conflicts.
The proposed research will model dynamic social interactions in 3D space from multiple personal perspectives. Recognition and prediction of complex social group interactions are challenging because people in the group can carry out unexpected actions intentionally or by mistake. In addition, due to variances in individuals' preferences and abilities, the same activities could be carried out in different ways. First-person videos can be highly jittery, resulting in fast and unpredictable object motions in the field of view. Building on PI's recent work establishing computational foundations for modeling social (people-people) and personal (people-scene) interactions using first-person cameras, this research will explore the novel concept the duality between social attention and roles: social attention provides a cue for recognizing social roles, and social roles facilitate the predictions of dynamic social formation change and its associated social attention. The formal foundation of the 3D model is based on constructing a visual memory that stores first-person social experiences in three forms: (a) geometric social formation, (b) visual image of first-person view, and (c) first-person seen by nearby third person views. As a proof-of-concept, the 3D space model capturing social interactions will be tested on collaborative social tasks such as assembling (Ikea) furniture, or building a block house with a group of friends. This research will construct a labeled dataset capturing the interactions, and perform analysis on both accuracy in recognizing social roles and precision in predicting spatial movements of the members in that social interaction. The results of this project, including papers and dataset, will be disseminated to the public through our project website (http://www.andrew.cmu.edu/user/lakoglu/PROJECTS/OPINION_FRAUD/). The software created under this project will be made available to the public through GitHub, a web-based Git repository hosting service
PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH
Note:
When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external
site maintained by the publisher. Some full text articles may not yet be available without a
charge during the embargo (administrative interval).
Some links on this page may take you to non-federal websites. Their policies may differ from
this site.
PROJECT OUTCOMES REPORT
Disclaimer
This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.
Fake opinions are wide-spread on social media. To ensure that the social media information can be trusted, we must detect such fake opinions and other forms of disinformation. In terms of applications, since social media posts are increasingly used by businesses, organizations, social sciences, and health sciences, detecting disinformation or spamming becomes very urgent. In this project, our goal is to propose a collective detection framework via synergistic integration of multiple information sources: linguistics, user behavior, and network effects to detect fake reviews and fake reviewers (also called opinion spammers). We have used this framework in our proposed algorithms. My group at the University of Illinois at Chicago pioneered the research area of detecting fake reviews and reviewers by publishing the first paper on the topic in 2008. Over the years, we have contributed many useful algorithms. This project continued to contribute significantly to this effort. Below, we highlight three major outcomes or discoveries of this project.
- Bimodal posting rate: For the first time, we discovered that reviewers’ posting rates (number of reviews written in a period of time) follow an interesting distribution pattern, which has not been reported before. That is, their posting rates are bimodal. Furthermore, multiple spammers tend to collectively and actively post reviews to the same set of products within a short time frame, which we call co-bursting. We also found some other interesting patterns in individual reviewers’ temporal dynamics and their co-bursting behaviors with other reviewers. Inspired by these findings, we proposed a two-mode Labeled Hidden Markov Model to model spamming using only individual reviewers’ review posting times. We then extend it to the Coupled Hidden Markov Model to capture both reviewer posting behaviors and co-bursting signals to detect review spammers.
- Changed-hand account: As many review hosting sites are actively detecting fake reviews and reviewers (spammers), it has become difficult to post fake reviews. Spammers began to buy reputable accounts to post fake opinions to avoid detection, or to raise their own accounts by behaving like genuine reviewers for a period of time and then use these “trustworthy” accounts to launch spam campaigns. Such accounts are called raised accounts (like raising a child) which behave normally in a period of time to gain credibility but are then used later to write fake reviews or opinions. Before this research, this problem was not studied by the research community. This project conducted a comprehensive study of this new type of spammers (or spam accounts) and proposed an effective technique for their detection. We call such accounts changed-hand accounts.
- Hidden campaign promoter: Some spammers work together to secretly promote some target products or services by influencing people’s behaviors/opinions/decisions in a latent manner so that the readers are not aware that the messages they are seeing are strategic campaign posts aimed at persuading them to buy some target products/services. Readers take such campaign posts (often opinionated) as just other organic posts from the general public. It is thus important to discover such campaigns, their promoter accounts, and how the campaigns are organized and executed. In this project, we studied this problem on the Twitter platform. Given a set of tweets streamed from Twitter based on a set of keywords representing a particular topic, our technique can identify user accounts that are involved in promotion. We formulated the problem as a relational classification problem and solved it using typed Markov Random Fields (T-MRF), which is a generalization of the classic Markov Random Fields.
We believe that these discoveries and associated detection techniques are all very useful in practice and will help ensure the social media to be a trusted source of information.
Last Modified: 12/01/2018
Modified by: Bing Liu
Please report errors in award information by writing to: awardsearch@nsf.gov.