Award Abstract # 2107096
III: Medium: Collaborative Research: Deep Generative Modeling for Urban and Archaeological Recovery

NSF Org: IIS
Division of Information & Intelligent Systems
Recipient: PURDUE UNIVERSITY
Initial Amendment Date: August 25, 2021
Latest Amendment Date: August 25, 2021
Award Number: 2107096
Award Instrument: Standard Grant
Program Manager: Sylvia Spengler
sspengle@nsf.gov
 (703)292-7347
IIS
 Division of Information & Intelligent Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: October 1, 2021
End Date: September 30, 2026 (Estimated)
Total Intended Award Amount: $830,060.00
Total Awarded Amount to Date: $830,060.00
Funds Obligated to Date: FY 2021 = $830,060.00
History of Investigator:
  • Daniel Aliaga (Principal Investigator)
  • Ian Lindsay (Co-Principal Investigator)
  • Rajesh Kalyanam (Co-Principal Investigator)
Recipient Sponsored Research Office: Purdue University
2550 NORTHWESTERN AVE # 1100
WEST LAFAYETTE
IN  US  47906-1332
(765)494-1055
Sponsor Congressional District: 04
Primary Place of Performance: Purdue University
305 N. University St.
West Lafayette
IN  US  47906-2186
Primary Place of Performance
Congressional District:
04
Unique Entity Identifier (UEI): YRXVL4JYCEF5
Parent UEI: YRXVL4JYCEF5
NSF Program(s): Info Integration & Informatics
Primary Program Source: 01002122DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7364, 7924
Program Element Code(s): 736400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Modeling and understanding the evolution of urbanization over the course of human history elucidates a key aspect of human civilization, and can significantly help stakeholders today make better informed decisions for future urban development. However, the modeling of current and past urban spaces remains extremely challenging and a rigorous comparison between ancient and modern urban form is lacking. In this project, the team will provide an artificial intelligence based framework for discovering a relatively complex urban model (walls, corners, rooms, orientation, and built area clusters) from a sparse number of remote sensing and field observations. As opposed to cities present today, modeling a historical urban site is fundamentally limited to sparse (and few) data observations because most of the structures have been eroded or destroyed. The research team will provide a preliminary cyberinfrastructure, pursue 3D re-creations of historical sites, create a feature- and time-based urban taxonomy of ancient sites from the late Prehispanic and Colonial period Andes and the Bronze/Iron Age South Caucasus periods, while leveraging the NEH and American Council of Learned Societies funded GeoPACHA web platform for result dissemination. Moreover, the project spans three major US universities and five departments, led by five experienced senior researchers and a team of at least six multidisciplinary graduate students, as well as additional undergraduates, who will produce publications in top tier venues, conference workshops, as well as theses and PhD dissertations.

To assist with modeling and understanding the evolution of urbanization over the course of human history, this project seeks a computational methodology for discovering a relatively complex urban model from a sparse number of observations. While performing a dense acquisition of a current city implies focusing on sensor deployment and on big data issues, modeling a historical urban site is fundamentally limited to sparse (and few) data observations because most of the structures have been eroded or destroyed. Inferencing approaches show significant promise, but they struggle in a situation of relatively sparse data and obscured structure. As a first domain application, the team will assist computational archaeologists having relatively sparse data but of an underlying structured site. First, they will solve a set cover problem to determine a discrete set of atomic elements and rules that are minimal yet sufficient to span the sparse data. Second, they will use these atomic elements and rules to produce sufficient data samples for training deep networks in a self-supervised manner in order to learn how to perform segmentation, classification, and completion. Finally, they will use the learned representations to model archaeological sites resulting in reconstructions, semantic understandings, and site taxonomies, for instance. Further, the team anticipates that the developed models can be re-tooled to assist with other domains also limited to sparse observations of an underlying structured region.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Aliaga, Daniel and Niyogi, Dev "Digitizing cities for urban weather: representing realistic cities for weather and climate simulations using computer graphics and artificial intelligence" Computational Urban Science , v.4 , 2024 https://doi.org/10.1007/s43762-023-00111-z Citation Details
Firoze, Adnan and Benes, Bedrich and Aliaga, Daniel "Urban tree generator: spatio-temporal and generative deep learning for urban tree localization and modeling" The Visual Computer , v.38 , 2022 https://doi.org/10.1007/s00371-022-02526-x Citation Details
Firoze, Adnan and Wingren, Cameron and Yeh, Raymond A. and Benes, Bedrich and Aliaga, Daniel "Tree Instance Segmentation with Temporal Contour Graph" , 2023 https://doi.org/10.1109/CVPR52729.2023.00218 Citation Details
He, Liu and Aliaga, Daniel "COHO: Context-Sensitive City-Scale Hierarchical Urban Layout Generation" , 2024 Citation Details
He, Liu and Aliaga, Daniel "GlobalMapper: Arbitrary-Shaped Urban Layout Generation" , 2023 Citation Details
He, Liu and Shan, Jie and Aliaga, Daniel "Generative Building Feature Estimation From Satellite Images" IEEE Transactions on Geoscience and Remote Sensing , v.61 , 2023 https://doi.org/10.1109/TGRS.2023.3242284 Citation Details
Kamath, Harsh and Singh, Manmeet and Malviya, Neetiraj and Martilli, Alberto and He, Liu and Aliaga, Daniel and He, Cenlin and Chen, Fei and Magruder, Lori and Yang, Zong-Liang and Niyogi, Dev "GLObal Building heights for Urban Studies (UT-GLOBUS) for city- and street- scale urban simulations: Development and first applications" Nature Scientific Data , 2024 Citation Details
Zhang, Xiaowei and Aliaga, Daniel "RFCNet: Enhancing urban segmentation using regularization, fusion, and completion" Computer Vision and Image Understanding , v.220 , 2022 https://doi.org/10.1016/j.cviu.2022.103435 Citation Details
Zhang, Xiaowei and Ma, Wufei and Varinlioglu, Gunder and Rauh, Nick and He, Liu and Aliaga, Daniel "Guided pluralistic building contour completion" The Visual Computer , v.38 , 2022 https://doi.org/10.1007/s00371-022-02532-z Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page