Award Abstract # 1407927
III: Medium: Collaborative Research: Collective Opinion Fraud Detection: Identifying and Integrating Cues from Language, Behavior, and Networks

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: UNIVERSITY OF ILLINOIS
Initial Amendment Date: August 1, 2014
Latest Amendment Date: August 1, 2014
Award Number: 1407927
Award Instrument: Standard Grant
Program Manager: Maria Zemankova
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: September 1, 2014
End Date: August 31, 2018 (Estimated)
Total Intended Award Amount: $299,994.00
Total Awarded Amount to Date: $299,994.00
Funds Obligated to Date: FY 2014 = $299,994.00
History of Investigator:
  • Bing Liu (Principal Investigator)
    liub@uic.edu
Recipient Sponsored Research Office: University of Illinois at Chicago
809 S MARSHFIELD AVE M/C 551
CHICAGO
IL  US  60612-4305
(312)996-2862
Sponsor Congressional District: 07
Primary Place of Performance: University of Illinois at Chicago
851 South Morgan Street
Chicago
IL  US  60607-7053
Primary Place of Performance
Congressional District:
07
Unique Entity Identifier (UEI): W8XEAJDKMXH3
Parent UEI:
NSF Program(s): Info Integration & Informatics
Primary Program Source: 01001415DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7364, 7924
Program Element Code(s): 736400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Precision modeling tools for realistic and complex human social interaction are not available today. First-person videos provide a unique opportunity to capture social interaction at unprecedented precision. In contrast, current third person surveillance video only records the few distance views of the interaction passively at a much reduced spatial resolution. This exploratory research project proposes to harness multiple first-person cameras as one collective instrument to capture, model, and predict social behaviors. The proposed research transforms the way we construct realistic social interaction models, while also advancing first-person video recognition. If successful, the envisioned computational model can act as a coach who learns what constitutes successful interactions and failures, thus being able to find solutions to mediate and prevent potential conflicts.

The proposed research will model dynamic social interactions in 3D space from multiple personal perspectives. Recognition and prediction of complex social group interactions are challenging because people in the group can carry out unexpected actions intentionally or by mistake. In addition, due to variances in individuals' preferences and abilities, the same activities could be carried out in different ways. First-person videos can be highly jittery, resulting in fast and unpredictable object motions in the field of view. Building on PI's recent work establishing computational foundations for modeling social (people-people) and personal (people-scene) interactions using first-person cameras, this research will explore the novel concept the duality between social attention and roles: social attention provides a cue for recognizing social roles, and social roles facilitate the predictions of dynamic social formation change and its associated social attention. The formal foundation of the 3D model is based on constructing a visual memory that stores first-person social experiences in three forms: (a) geometric social formation, (b) visual image of first-person view, and (c) first-person seen by nearby third person views. As a proof-of-concept, the 3D space model capturing social interactions will be tested on collaborative social tasks such as assembling (Ikea) furniture, or building a block house with a group of friends. This research will construct a labeled dataset capturing the interactions, and perform analysis on both accuracy in recognizing social roles and precision in predicting spatial movements of the members in that social interaction. The results of this project, including papers and dataset, will be disseminated to the public through our project website (http://www.andrew.cmu.edu/user/lakoglu/PROJECTS/OPINION_FRAUD/). The software created under this project will be made available to the public through GitHub, a web-based Git repository hosting service

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 11)
Huayi Li and Bing Liu "Modeling Review Spam Using Temporal Patterns and Co-bursting Behaviors" The 25th ACM International Conference on Information and Knowledge Management (CIKM 2016) , 2016
Geli Fei, Shuai Wang, and Bing Liu "Learning Cumulatively to Become More Knowledgeable" Proceedings of SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2016) , 2016
Huayi Li, Geli Fei, Shuai Wang, Bing Liu, Weixiang Shao, Arjun Mukherjee and Jidong Shao "Bimodal Distribution and Co-Bursting in Review Spam Detection" Proceedings of International World Wide Web Conference (WWW-2017) , 2017
Hu Xu, Bing Liu, Lei Shu and Philip S. Yu "Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction" Proceedings of Annual Meeting of the Association for Computational Linguistics (ACL-2018) , 2018
Hu Xu, Bing Liu, Lei Shu and Philip S. Yu "Lifelong Domain Word Embedding via Meta-Learning" Proceedings of International Conference on Artificial Intelligence (IJCAI-ECAI-2018) , 2018
Lei Shu, Hu Xu, and Bing Liu "Lifelong Learning CRF for Supervised Aspect Extraction" Proceedings of Annual Meeting of the Association for Computational Linguistics (ACL-2017, short paper) , 2017
Qian Liu, Bing Liu, Yuanlin Zhang, Doo Soon Kim and Zhiqiang Gao "Improving Opinion Aspect Extraction using Semantic Similarity and Aspect Associations" Thirtieth AAAI Conference on Artificial Intelligence , 2016
Sahisnu Mazumder and Bing Liu "Context-aware Path Ranking for Knowledge Base Completion" Proceedings of International Joint Conference on Artificial Intelligence (IJCAI-2017) , 2017
Shuai Wang, Sahisnu Mazumder, Bing Liu, Mianwei Zhou, and Yi Chang "Target-Sensitive Memory Networks for Aspect Sentiment Classification" Proceedings of Annual Meeting of the Association for Computational Linguistics (ACL-2018) , 2018
Shuai Wang, Zhiyuan Chen, Bing Liu "Mining Aspect-Speci?c Opinion using a Holistic Lifelong Topic Model" 25th International World Wide Web Conference (WWW 2016) , 2016
Shuai Wang, Zhiyuan Chen, Geli Fei, Bing Liu and Sherry Emery "Targeted Topic Modeling for Focused Analysis" Proceedings of SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2016) , 2016
(Showing: 1 - 10 of 11)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Fake opinions are wide-spread on social media. To ensure that the social media information can be trusted, we must detect such fake opinions and other forms of disinformation. In terms of applications, since social media posts are increasingly used by businesses, organizations, social sciences, and health sciences, detecting disinformation or spamming becomes very urgent. In this project, our goal is to propose a collective detection framework via synergistic integration of multiple information sources: linguistics, user behavior, and network effects to detect fake reviews and fake reviewers (also called opinion spammers). We have used this framework in our proposed algorithms. My group at the University of Illinois at Chicago pioneered the research area of detecting fake reviews and reviewers by publishing the first paper on the topic in 2008. Over the years, we have contributed many useful algorithms. This project continued to contribute significantly to this effort. Below, we highlight three major outcomes or discoveries of this project.

  1. Bimodal posting rate: For the first time, we discovered that reviewers’ posting rates (number of reviews written in a period of time) follow an interesting distribution pattern, which has not been reported before. That is, their posting rates are bimodal. Furthermore, multiple spammers tend to collectively and actively post reviews to the same set of products within a short time frame, which we call co-bursting. We also found some other interesting patterns in individual reviewers’ temporal dynamics and their co-bursting behaviors with other reviewers. Inspired by these findings, we proposed a two-mode Labeled Hidden Markov Model to model spamming using only individual reviewers’ review posting times. We then extend it to the Coupled Hidden Markov Model to capture both reviewer posting behaviors and co-bursting signals to detect review spammers.
  2. Changed-hand account: As many review hosting sites are actively detecting fake reviews and reviewers (spammers), it has become difficult to post fake reviews. Spammers began to buy reputable accounts to post fake opinions to avoid detection, or to raise their own accounts by behaving like genuine reviewers for a period of time and then use these “trustworthy” accounts to launch spam campaigns. Such accounts are called raised accounts (like raising a child) which behave normally in a period of time to gain credibility but are then used later to write fake reviews or opinions. Before this research, this problem was not studied by the research community. This project conducted a comprehensive study of this new type of spammers (or spam accounts) and proposed an effective technique for their detection. We call such accounts changed-hand accounts.
  3. Hidden campaign promoter: Some spammers work together to secretly promote some target products or services by influencing people’s behaviors/opinions/decisions in a latent manner so that the readers are not aware that the messages they are seeing are strategic campaign posts aimed at persuading them to buy some target products/services. Readers take such campaign posts (often opinionated) as just other organic posts from the general public. It is thus important to discover such campaigns, their promoter accounts, and how the campaigns are organized and executed. In this project, we studied this problem on the Twitter platform. Given a set of tweets streamed from Twitter based on a set of keywords representing a particular topic, our technique can identify user accounts that are involved in promotion. We formulated the problem as a relational classification problem and solved it using typed Markov Random Fields (T-MRF), which is a generalization of the classic Markov Random Fields.

We believe that these discoveries and associated detection techniques are all very useful in practice and will help ensure the social media to be a trusted source of information.

 


Last Modified: 12/01/2018
Modified by: Bing Liu

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page