Award Abstract # 1848898
CHS:Eager:Aiding Reasoning about Correlation and Causation

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: TRUSTEES OF INDIANA UNIVERSITY
Initial Amendment Date: August 15, 2018
Latest Amendment Date: August 15, 2018
Award Number: 1848898
Award Instrument: Standard Grant
Program Manager: Dan Cosley
dcosley@nsf.gov
 (703)292-8832
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: April 1, 2019
End Date: March 31, 2022 (Estimated)
Total Intended Award Amount: $299,879.00
Total Awarded Amount to Date: $299,879.00
Funds Obligated to Date: FY 2018 = $299,879.00
History of Investigator:
  • Francesco Cafaro (Principal Investigator)
    fcafaro@iu.edu
Recipient Sponsored Research Office: Indiana University
107 S INDIANA AVE
BLOOMINGTON
IN  US  47405-7000
(317)278-3473
Sponsor Congressional District: 09
Primary Place of Performance: Indiana University Purdue Univ
535 W Michigan St., IT 475
Indianapolis
IN  US  46202-3103
Primary Place of Performance
Congressional District:
07
Unique Entity Identifier (UEI): YH86RTW2YVJ4
Parent UEI:
NSF Program(s): HCC-Human-Centered Computing,
Cyberlearn & Future Learn Tech
Primary Program Source: 01001819DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7367, 7916, 8045
Program Element Code(s): 736700, 802000
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

People are increasingly exposed to data and datasets in everyday life, in domains from health and science to news and policy. This raises important questions about how to help non-specialists make sense of those data, in particular, around understanding how to think about correlation and causation. These concepts can be slippery; confounding correlation with causation may lead people to assume causality when there is none, but correlations do often provide precious hints to causation. This project will investigate how theories of cognition that emphasize the relationship between thinking and physical action can be used to design full-body and tangible ways to interact with data-based museum installations that prime people to think in ways that improve their understanding of causation and correlation. The goal is to develop bridges between theories of embodied cognition, the design of data visualizations, and long-term learning effects about science, technology, engineering, and mathematics concepts discussed in the installations. The project will be deployed in real contexts, having direct potential impacts on visitors' understanding, and will be used to inform educational curricula in ubiquitous computing and design for informal learning.

The project is organized in four phases that will be conducted at Discovery Place, a science museum in Charlotte, NC. In part one, the team will design visualizations of geo-referenced datasets on a wall-size projected screen. Using a semi-experimental design, groups of visitors will interact with one of several variations of the installation, including full-body and tangible interaction styles based on different physical metaphors for correlation as well as a tablet-based control condition. In part two, the team will experiment with different styles of data visualization (e.g., line charts or heat maps), and in part three visitors will be asked personalize the dataset on display; these extensions are necessary to assess the generalizability of the results from phase one to different data presentations and domains. Part four addresses transferability of learning across time and to other contexts, following up with museum visitors weeks or months after their visit and asking them to evaluate the likely correctness of data-based claims about correlation and causation in science articles in domains such as health remedies.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Alhakamy, A'aeshah and Cafaro, Francesco and Trajkova, Milka and Kankara, Sreekanth and Mallappa, Rashmi and Veda, Sanika "Design Strategies and Optimizations for Human-Data Interaction Systems in Museums" 2020 IEEE 20th International Conference on Advanced Learning Technologies (ICALT) , 2020 10.1109/ICALT49669.2020.00081 Citation Details
Alhakamy, A'aeshah and Trajkova, Milka and Cafaro, Francesco "Show Me How You Interact, I Will Tell You What You Think: Exploring the Effect of the Interaction Style on Users Sensemaking about Correlation and Causation in Data" Designing Interactive Systems Conference 2021 , 2021 https://doi.org/10.1145/3461778.3462083 Citation Details
Cafaro, Francesco and Trajkova, Milka and Alhakamy, A'aeshah "Designing embodied interactions for informal learning: two open research challenges" PerDis '19: Proceedings of the 8th ACM International Symposium on Pervasive Displays , 2019 10.1145/3321335.3329688 Citation Details
Trajkova, Milka and Alhakamy, Aaeshah and Cafaro, Francesco and Mallappa, Rashmi and Kankara, Sreekanth R. "Move Your Body: Engaging Museum Visitors with Human-Data Interaction" Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI 20) , 2020 10.1145/3313831.3376186 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Causation and correlation are two concepts that are essential to understanding modern science. They are, however, difficult to interpret. For example, people may believe that the mumps, measles, and rubella (MMR) vaccine causes autism (even if these two variables increase in different years). On the other hand, the mantra that correlation does not imply causation may conceal how correlation can be a precious hint to causation (for example, the correlation between smoking and lung cancer).

This project attempts to mitigate these challenges by providing guidelines for designing interactive installations for informal learning places like museums. We hypothesized that different ways of interacting with a data visualization could affect how we make sense of causation and correlation in data. To test this hypothesis, we iteratively designed and implemented three prototypes of an interactive museum installation. In the full-body prototype, visitors interacted with a geo-referenced data visualization using hand gestures and body movements (like jumping or grabbing). In the tangible prototype, they used paper-made objects or a 3D-printed globe. In the traditional prototype, visitors used a gamepad to control the installation.

We tested our prototypes at Discovery Place, a science museum in Charlotte, NC. We placed a 65" TV in a busy area of the museum and allowed visitors to interact with the installation freely. During our initial study sessions, we also identified interactivity problems that affect data visualizations in museums. In particular, screens in museums often compete with surrounding stimuli (e.g., people, exhibits, signage, objects). This limits the number of people who notice them or who understand that the display is interactive (two phenomena known in the pervasive display literature as "display blindness" and "interaction blindness"). To address these issues, we investigated how different ways of representing the user next-to a data visualization (as a skeleton, avatar, or by using the full camera feed) impact people's engagement with the installation. For example, in a study with 731 museum visitors, we found that by representing the user as an avatar or using the full video feed from the camera, the screen could attract more people than using a skeleton.

Because of COVID-19 related closures and restrictions, we continued our studies in-lab at IUPUI in Indianapolis, IN. Consistently with our original hypothesis, our experimental findings indicate that different interaction styles alter how we make sense of causation and correlation in data. In particular, our experimental sessions showed that people report different levels of agreement with statements that portray correlation and causation across the data on display, depending on the prototype they used. Participants tended to agree less with such statements after interacting with a gamepad. Vice versa, interacting with body movements may promote the detection of causal patterns.

This grant allowed a diverse pool of undergraduate and graduate students to participate in research activities actively. It enabled the research team to produce peer-reviewed publications that were presented at highly competitive international conferences in the field of Human-Computer Interaction and that were shared with professionals at the partner museum. 

 


Last Modified: 06/28/2022
Modified by: Francesco Cafaro

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page