Award Abstract # 1250718
CAREER: Secure and Trustworthy Ocular Biometrics

NSF Org: CNS
Division Of Computer and Network Systems
Recipient: TEXAS STATE UNIVERSITY
Initial Amendment Date: February 5, 2013
Latest Amendment Date: June 16, 2017
Award Number: 1250718
Award Instrument: Continuing Grant
Program Manager: Nina Amla
namla@nsf.gov
 (703)292-7991
CNS
 Division Of Computer and Network Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: September 1, 2013
End Date: August 31, 2020 (Estimated)
Total Intended Award Amount: $512,964.00
Total Awarded Amount to Date: $695,556.00
Funds Obligated to Date: FY 2013 = $121,591.00
FY 2014 = $318,258.00

FY 2015 = $16,000.00

FY 2016 = $223,707.00

FY 2017 = $16,000.00
History of Investigator:
  • Oleg Komogortsev (Principal Investigator)
    ok11@txstate.edu
Recipient Sponsored Research Office: Texas State University - San Marcos
601 UNIVERSITY DR
SAN MARCOS
TX  US  78666-4684
(512)245-2314
Sponsor Congressional District: 15
Primary Place of Performance: Texas State University - San Marcos
601 University dr.
San Marcos
TX  US  78749-4684
Primary Place of Performance
Congressional District:
21
Unique Entity Identifier (UEI): HS5HWWK1AAU5
Parent UEI:
NSF Program(s): Special Projects - CNS,
Secure &Trustworthy Cyberspace
Primary Program Source: 01001314DB NSF RESEARCH & RELATED ACTIVIT
01001415DB NSF RESEARCH & RELATED ACTIVIT

01001516DB NSF RESEARCH & RELATED ACTIVIT

01001617DB NSF RESEARCH & RELATED ACTIVIT

01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 025Z, 1045, 7434, 9178, 9251
Program Element Code(s): 171400, 806000
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

The need for accurate and unforgeable identity recognition techniques has become an issue of increasing urgency. Biometric approaches such as iris recognition hold huge promise but still have significant limitations, including susceptibility to 'spoofing'. This project seeks to advance our knowledge of security and accuracy of multibiometric systems by inventing, evaluating, and applying innovative methods and tools to combine highly accurate static traits, such as iris patterns, with novel traits based on the dynamics of eye movements. The strategy is to use existing iris recognition hardware to combine three different biometrics approaches related to the eye: measurement of iris patterns, unique characteristics of the eye globe and its muscles, and the brain's strategies for guiding visual attention. This multimodal ocular biometrics approach has the potential to improve liveness detection and resistance to sophisticated counterfeiting techniques and coercion attacks, while improving identification accuracy. This research tackles important questions related to the individuality, variability, scalability, and longevity of these ocular traits, building a foundation for security and accuracy improvement when those traits are combined with iris recognition. This project aims to benefit efforts such as the Unique Identification project in India, which seeks to use biometric information of 1.2 billion individuals to fight fraud.

Educational activities include three initiatives: 1) creation of a strong outreach activity to K-12 students, 2) expansion of an interdisciplinary research-oriented educational program previously created by the PI for undergraduate and graduate students, and 3) mentoring and guidance to interest undergraduate students in scientific careers and encourage more students from diverse backgrounds to pursue graduate study.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 41)
A. Karpov, O. V. Komogortsev, C. Holland "Oculomotor Plant Characteristics: The Effects of Environment and Stimulus" IEEE Transactions on Information Forensics and Security , v.11 , 2016 , p.62
C. Holland, A. Garza, E. Kurtova, J. Cruz, and O. V. Komogortsev "Usability Evaluation of Eye Tracking on an Unmodified Common Tablet" ACM Conference on Human Factors in Computing Systems (CHI) , 2013
C. Holland, and O. V. Komogortsev "Complex Eye Movement Pattern Biometrics: Analyzing Fixations and Saccades" IEEE/IARP International Conference on Biometrics (ICB) , 2013
Complex Eye Movement Pattern Biometrics: The Effects of Environment and Stimulus "Complex Eye Movement Pattern Biometrics: The Effects of Environment and Stimulus" IEEE Transactions on Information Forensics and Security , v.8 , 2013 , p.2115 10.1109/TIFS.2013.2285884
Dillon James Lohr, Oleg V Komogortsev "A Comparison of Smooth Pursuit-and Dwell-based Selection at Multiple Levels of Spatial Accuracy" Human Factors in Computing Systems (CHI) Conference , 2017
D. KatrychukH. GriffithO. Komogortsev "A Calibration Framework for Photosensor-based Eye-Tracking System" ACM Eye Tracking Research & Applications Symposium , 2020
D. KatrychukH. GriffithO. Komogortsev "Power-efficient and shift-robust eye-tracking sensor for portable VR headsets" Eye Tracking Research and Applications Symposium (ETRA 2019) , 2019
D. Lohr,H. Griffith, S. Aziz, O. Komogortsev "A Metric Learning Approach to Eye Movement Biometrics" IEEE International Joint Conference on Biometrics , 2020
D. Lohr, S. Berndt, O. Komogortsev "An implementation of eye movement-driven biometric in virtual reality" Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction (PETMEI). PETMEI was part of the Eye Tracking Research and Application Symposium (ETRA 2018) , 2018
E. Abdulin and O. V. Komogortsev "Person Verification via Eye Movement-driven Text Reading Model" IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS) , 2015
E. Abdulin and O. V. Komogortsev "User Eye Fatigue Detection via Eye Movement Behavior" ACM Conference on Human Factors in Computing Systems (CHI) , 2015
(Showing: 1 - 10 of 41)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

This project concentrated on understanding highly dynamic and individualistic traits related to eye movements and their relationship to internal, non-visible, anatomical properties of the human eye and the brain’s strategies for guiding visual attention to assess the utility of eye movement biometrics – an accurate and spoof resistant method of person’s authentication.

 

We found individual differences in ways people move their eyes on macro and micro scale. If eye motility is recorded with high enough quality the differences in eye movement patterns of any two individuals are such that it is possible to distinguish between them with an accuracy comparable to fingerprints. This discovery validates eye movements as an authentication method for devices that have eye tracking capabilities.

 

We have also verified the efficacy of eye movements as a tool against spoof attacks where intruders create various replicas of a human eye to get an unauthorized entry into a secure system. For example, we have successfully verified that it is possible to guard against print attacks (printed images of the human eye) and eye mechanical replicas by analyzing signal captured by eye tracking capable hardware.

 

The findings of uniqueness of eye movements were verified via statistical methods which were based on the idea of improving authentication accuracy by selecting uncorrelated eye motility-derived features that have high degree of temporal persistence. The use of statistical methods in eye movement-driven biometrics will help to understand and interpret the nature of the phenomenon of why fingerprint-like accuracy of user authentication can be achieved from eye movement signal.

 

While we expect that future machine learning-based approaches to improve the authentication performance we posit that statistical methods provide an important analytical tool to start answering future research questions such as: “How to assess neurological health of a person using same features that are employed for person authentication?”, “How such human states as fatigue, emotions, stress affect eye movement signal and the performance of eye movement biometrics system in the authentication and health assessment mode?”, “How quality of the captured eye tracking signal affects the performance of the eye movement-driven biometric system in authentication and health assessment mode?”.

 

We have made publicly available the eye movement dataset that was recorded as a result of work on this grant to facilitate further research in the eye movement biometrics domain and beyond.

 

Our findings of high authentication accuracy and spoofing resistance have positive implications for future virtual and augmented reality platforms, which are expected to have eye tracking hardware incorporated in them for purposes of foveated rendering and human computer interaction. Assuming that eye motility signal capture on such platforms can be done with high enough quality eye movements can be used as one of the most secure ways to authenticate its users or even provide health assessment capabilities with proper privacy handling.

 

Important educational and outreach activities were supported by this grant including but not limited to involvement of minority and underrepresented undergraduate students, several of which, subsequently, have received National Science Foundation Graduate Research Fellowship awards. The work on this grant supported a development and enactment of a Ph.D. program in Computer Science at Texas State University – a Hispanic serving institution. Multiple news articles, papers, patents, and talks have resulted from the work on this grant.

 

Deep gratitude goes to President Barack Obama for recognizing the importance of this direction of work and bestowing Presidential Early Career Award for Scientists and Engineers on this grant’s PI as a sign of support.

 


Last Modified: 12/29/2020
Modified by: Oleg V Komogortsev

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page