Skip to feedback

Award Abstract # 2147253
FAI: Advancing Optimization for Threshold-Agnostic Fair AI Systems

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: THE UNIVERSITY OF IOWA
Initial Amendment Date: March 4, 2022
Latest Amendment Date: March 4, 2022
Award Number: 2147253
Award Instrument: Standard Grant
Program Manager: Balakrishnan Prabhakaran
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: August 1, 2022
End Date: October 31, 2022 (Estimated)
Total Intended Award Amount: $500,000.00
Total Awarded Amount to Date: $500,000.00
Funds Obligated to Date: FY 2022 = $0.00
History of Investigator:
  • Tianbao Yang (Principal Investigator)
    tianbao-yang@tamu.edu
  • Qihang Lin (Co-Principal Investigator)
  • Mingxuan Sun (Co-Principal Investigator)
Recipient Sponsored Research Office: University of Iowa
105 JESSUP HALL
IOWA CITY
IA  US  52242-1316
(319)335-2123
Sponsor Congressional District: 01
Primary Place of Performance: University of Iowa
2 GILMORE HALL
IOWA CITY
IA  US  52242-1320
Primary Place of Performance
Congressional District:
01
Unique Entity Identifier (UEI): Z1H9VJS8NG16
Parent UEI:
NSF Program(s): Fairness in Artificial Intelli
Primary Program Source: 01002223DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 075Z
Program Element Code(s): 114Y00
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Artificial intelligence (AI) and machine learning technologies are being used in high-stakes decision-making systems like lending decision, employment screening, and criminal justice sentencing. A new challenge arising with these AI systems is avoiding the unfairness they might introduce and that can lead to discriminatory decisions for protected classes. Most AI systems use some kinds of thresholds to make decisions. This project aims to improve fairness-aware AI technologies by formulating threshold-agnostic metrics for decision making. In particular, the research team will improve the training procedures of fairness-constrained AI models to make the model adaptive to different contexts, applicable to different applications, and subject to emerging fairness constraints. The success of this project will yield a transferable approach to improve fairness in various aspects of society by eliminating the disparate impacts and enhancing the fairness of AI systems in the hands of the decision makers. Together with AI practitioners, the researchers will integrate the techniques in this project into real-world systems such as education analytics. This project will also contribute to training future professionals in AI and machine learning and broaden this activity by including training high school students and under-represented undergraduates.

This project focuses on advancing optimization for threshold-agnostic fair AI systems. The research activities include: (i) developing scalable stochastic optimization algorithms for optimizing a broad family of rank-based threshold-agnostic objectives; (ii) developing novel threshold-agnostic fairness measures including Receiver Operating Characteristic curve (ROC) fairness, Area under the ROC Curve (AUC) fairness, etc. and studying the relationship between them and the existing fairness measures; (iii) developing efficient stochastic methods for in-processing fairness-aware learning methods to directly optimize threshold-agnostic objectives subject to new threshold-agnostic fairness-ensuring constraints; and, (iv) investigating effective end-to-end deep learning framework that not only automatically learns the feature representations, but also satisfies the fairness constraints. The algorithms will be evaluated on multiple tasks, including image recognition, recommendation, spatial-temporal hazard prediction, and predicting students? performance.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Li, Zhuoqun and Sun, Mingxuan. "Sparse Transformer Hawkes Process for Long Event Sequences" Machine Learning and Knowledge Discovery in Databases: Research Track. ECML PKDD 2023 , 2023 https://doi.org/10.1007/978-3-031-43424-2_11 Citation Details
Li, Zhuoqun and Zhou, Zihan and Sun, Mingxuan and Xu, Hongteng "Debiased Imitation Learning for Modulated Temporal Point Processes" Proceedings of the SIAM International Conference on Data Mining , 2023 Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page