Award Abstract # 1814846
SaTC: CORE: Small: RUI: Leveraging Movement, Posture, and Anthropometric Contexts to Strengthen the Security of Mobile Biometrics

NSF Org: CNS
Division Of Computer and Network Systems
Recipient: NEW YORK INSTITUTE OF TECHNOLOGY
Initial Amendment Date: September 4, 2018
Latest Amendment Date: September 4, 2018
Award Number: 1814846
Award Instrument: Standard Grant
Program Manager: Jeremy Epstein
CNS
 Division Of Computer and Network Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: October 1, 2018
End Date: March 31, 2023 (Estimated)
Total Intended Award Amount: $499,758.00
Total Awarded Amount to Date: $499,758.00
Funds Obligated to Date: FY 2018 = $499,758.00
History of Investigator:
  • Kiran Balagani (Principal Investigator)
    kbalagan@nyit.edu
  • Rosemary Gallagher (Co-Principal Investigator)
  • Paolo Gasti (Co-Principal Investigator)
  • Isaac Kurtzer (Co-Principal Investigator)
Recipient Sponsored Research Office: New York Institute of Technology
1855 BROADWAY
NEW YORK
NY  US  10023-7606
(516)686-7737
Sponsor Congressional District: 12
Primary Place of Performance: New York Institute of Technology
Northern Boulevard, PO Box 8000
Old Westbury
NY  US  11568-8000
Primary Place of Performance
Congressional District:
03
Unique Entity Identifier (UEI): SVZSJHR2A4T6
Parent UEI:
NSF Program(s): Secure &Trustworthy Cyberspace
Primary Program Source: 01001819DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 025Z, 7434, 7923, 065Z
Program Element Code(s): 806000
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Modern smartphones regularly store and access large amounts of personal data, such as e-mails, photos, videos, and banking information. For this reason, securing them is of paramount importance. User authentication is a crucial step towards securing a smartphone. However, current user authentication mechanisms such as graphical passwords, Personal Identification Numbers (PINs), and fingerprint scans offer limited security, and are ineffective after the smartphone has been unlocked. To address these issues, this project develops continuous authentication mechanisms that rely on behavioral cues to determine whether the smartphone is being used by its owner. This project will result in (1) new foundational understanding of mobile behavioral biometrics under realistic posture, movement, and anthropometric conditions, and (2) new techniques to distinguish legitimate behavioral traits from forgeries.

The project will systematically quantify the impact of posture, movement, and anthropometric variables on behavioral biometric traits in hitherto understudied subject populations, such as older adults and people with Parkinson's disease. To this end, the project involves the analysis and dissemination of datasets collected in two settings: (1) fine-grained 3-dimensional motion capture data collected in a laboratory setting, and (2) real-world smartphone sensor data captured over a period of up to 12 months in the users' everyday environment. The project is expected to result in new behavioral authentication techniques that achieve lower error rates under realistic conditions by adapting to drifts in contexts and behaviors. Additionally, this project seeks to quantify the susceptibility of behavioral biometric traits to forgery attacks, and introduce novel liveness detection techniques that rely on contextual information, as well as lightweight and unobtrusive user challenges, to mitigate these attacks. The investigators will evaluate these techniques on up to 150 subjects, and will share the results of this project in the form of datasets, presentations, publications, and code.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Kurtzer, Isaac L. and Muraoka, Tetsuro and Singh, Tarkeshwar and Prasad, Mark and Chauhan, Riddhi and Adhami, Elan "Reaching movements are automatically redirected to nearby options during target split" Journal of Neurophysiology , v.124 , 2020 https://doi.org/10.1152/jn.00336.2020 Citation Details
Gan, Q. and Watanabe, S. "Synaptic Vesicle Endocytosis in Different Model Systems" Frontiers in cellular neuroscience , v.12 , 2018 https://doi.org/10.3389 Citation Details
Gómez-Granados, Ana and Barany, Deborah A. and Schrayer, Margaret and Kurtzer, Isaac L. and Bonnet, Cédrick T. and Singh, Tarkeshwar "Age-related deficits in rapid visuomotor decision-making" Journal of Neurophysiology , v.126 , 2021 https://doi.org/10.1152/jn.00073.2021 Citation Details
Herter, Troy M. and Kurtzer, Isaac and Granat, Lauren and Crevecoeur, Frédéric and Dukelow, Sean P. and Scott, Stephen H. "Interjoint coupling of position sense reflects sensory contributions of biarticular muscles" Journal of Neurophysiology , v.125 , 2021 https://doi.org/10.1152/jn.00317.2019 Citation Details
Kiran Balagani, Matteo Cardaioli "We Can Hear Your PIN Drop: An Acoustic Side-Channel Attack on ATM PIN Pads" ESORICS 2022 , 2022 Citation Details
Maurus, Philipp and Kurtzer, Isaac and Antonawich, Ryan and Cluff, Tyler "Similar stretch reflexes and behavioral patterns are expressed by the dominant and nondominant arms during postural control" Journal of Neurophysiology , v.126 , 2021 https://doi.org/10.1152/jn.00152.2021 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The primary goal of this project was to use spatial and temporal measurements of body posture and movement when a user interacts with a smartphone to build the foundation for robust and secure behavioral authentication on mobile devices. Using these measurements, we systematically quantified the impact of posture, movement, anthropometric, and cohort-specific variables on behavioral authentication signals collected from young adults (20-40 years old), individuals of age 65 or older, and individuals with Parkinson's disease (PD).

This research provided a new foundational understanding of the security of mobile behavioral biometrics under realistic posture, movement, and anthropometric contexts. By involving elderly subjects and subjects with PD, the proposed research paved the way for reliable continuous authentication with these cohorts. This is in stark contrast with prior work, which based its results largely on data from young adults and student cohorts.

In the project, the major activities performed include the following (1) smartphone and 3D motion capture data collected from a total of 84 subjects (including 41 young adults, 22 older adults, and 21 people with Parkinson Disease); (2) smartphone behavioral authentication data (i.e., typing and swiping patterns) collected from a total of 29 users in their home environment without any restrictions imposed on the posture; (3) development of a smartphone biometric authentication framework to expand the behavioral biometric features by including posture contexts extracted from smartphone motion capture data; (4) using neurophysiological guiding principles to extract postural features; (5) Use of multiple body-sensor based authentication to circumvent impostor attacks as well as reduce authentication latency.

For smartphone behavioral biometric authentication, we designed feature selection methods to separate posture-related physiological features from smartphone behavioral features. We also extracted features and specific posture-related context by utilizing the joint angles and posture geometry from 3D motion capture data.

Our work quantified the influence of contexts on behavioral biometric signals and refined context extraction with the goal of reducing authentication errors. We quantified the reduction of error rates by using head and body postural contexts along with behavioral biometric signals. We developed a data collection app that we then deployed the subject’s own environment (e.g., subject’s home) to help determine the collectability of each postural context that can be extracted or inferred from smartphone sensors. 

We also investigated whether it is possible to reconstruct swipes from video of users performing common activities on their smartphone. Based on the resulting evidence, the possibility of recreating swipes from the external videos was low because of the low coverage obtained in the external videos recorded from above the subject, especially during walking activities.

 


Last Modified: 07/01/2023
Modified by: Kiran Balagani

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page