Award Abstract # 1734854
NCS-FO: Data-driven modeling of visual cortex

NSF Org: SMA
SBE Office of Multidisciplinary Activities
Recipient: NEW YORK UNIVERSITY
Initial Amendment Date: August 7, 2017
Latest Amendment Date: August 7, 2017
Award Number: 1734854
Award Instrument: Standard Grant
Program Manager: Jonathan Fritz
SMA
 SBE Office of Multidisciplinary Activities
SBE
 Directorate for Social, Behavioral and Economic Sciences
Start Date: September 1, 2017
End Date: August 31, 2022 (Estimated)
Total Intended Award Amount: $599,968.00
Total Awarded Amount to Date: $599,968.00
Funds Obligated to Date: FY 2017 = $599,968.00
History of Investigator:
  • Robert Shapley (Principal Investigator)
    shapley@cns.nyu.edu
  • Lai-Sang Young (Co-Principal Investigator)
Recipient Sponsored Research Office: New York University
70 WASHINGTON SQ S
NEW YORK
NY  US  10012-1019
(212)998-2121
Sponsor Congressional District: 10
Primary Place of Performance: New York University
665 Broadway, Suite 801
New York
NY  US  10012-2331
Primary Place of Performance
Congressional District:
10
Unique Entity Identifier (UEI): NX9PXMKW5KW8
Parent UEI:
NSF Program(s): MATHEMATICAL BIOLOGY,
IntgStrat Undst Neurl&Cogn Sys
Primary Program Source: 01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 4444, 8089, 8091, 8251, 8551
Program Element Code(s): 733400, 862400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.075

ABSTRACT

One of the great challenges of modern neuroscience is a comprehensive theory of the function of the cerebral cortex. The overall aim of the present project is to answer this challenge with a new model of the visual cortex. The modeling process will lead to the discovery of common, canonical neural mechanisms behind a multitude of visual phenomena, giving special emphasis to canonical computations that are performed not just in the visual cortex but also in other regions of the cerebral cortex. The project aims to enhance understanding of cortical function by looking beyond structure to study the dynamics of cortical activity. An important part of the project's broader impact will be to provide interdisciplinary training for young researchers in response to society's need for an educated workforce with multi-disciplinary skills bridging mathematics and neurobiology. Additionally, the principal investigators will reach out to broad scientific audiences as well as high school students. Specifically, the results of this project will be disseminated by giving invited scientific lectures to national and international scientific meetings. The investigators also participate in university-sponsored outreach events for New York City-area high school students, such as the annual C-Splash lectures at the NYU Courant Institute of Mathematical Sciences.

This project adopts an integrative strategy to apply ideas from dynamical systems theory to theoretical neuroscience. The project will construct a next-generation model of the visual cortex that is realistic and comprehensive in the way it reproduces the dynamics of cortex and its visual functions. The model will be constrained by hundreds of sets of visual neuroscience data and by all that is known about cortical neuroanatomy. Such a model is a tool to advance neuroscience and a step toward building robotic intelligent systems that emulate human perception. The visual cortex will be modeled as a large network of spiking, conductance-based neurons. It will be analyzed as a complex dynamical system. Specific projects are: 1) network models of local circuitries; 2) extended models of the visual cortex covering a substantial portion of the visual field, and 3) dynamical interactions on neuronal scale to perceptual organization of two- and three-dimensional objects. The modeling and analysis will have wide impact beyond visual cortex in studies of the functional, dynamical consequences of canonical computations that are performed throughout the cerebral cortex.

This project is funded by Integrative Strategies for Understanding Neural and Cognitive Systems (NSF-NCS), a multidisciplinary program jointly supported by the Directorates for Computer and Information Science and Engineering (CISE), Education and Human Resources (EHR), Engineering (ENG), and Social, Behavioral, and Economic Sciences (SBE). This award is co-funded by the Division of Mathematical Sciences in the Directorate for Mathematical and Physical Sciences (MPS).

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Ambrosio, Benjamin and Young, Lai-Sang "The Use of Reduced Models to Generate Irregular, Broad-Band Signals That Resemble Brain Rhythms" Frontiers in Computational Neuroscience , v.16 , 2022 https://doi.org/10.3389/fncom.2022.889235 Citation Details
Chariker, Logan and Shapley, Robert and Hawken, Michael and Young, Lai-Sang "A Computational Model of Direction Selectivity in Macaque V1 Cortex Based on Dynamic Differences between On and Off Pathways" The Journal of Neuroscience , v.42 , 2022 https://doi.org/10.1523/JNEUROSCI.2145-21.2022 Citation Details
Chariker, Logan and Shapley, Robert and Hawken, Michael and Young, Lai-Sang "A theory of direction selectivity for macaque primary visual cortex" Proceedings of the National Academy of Sciences , v.118 , 2021 https://doi.org/10.1073/pnas.2105062118 Citation Details
Chariker, Logan and Shapley, Robert and Young, Lai-Sang "Contrast response in a comprehensive network model of macaque V1" Journal of Vision , v.20 , 2020 10.1167/jov.20.4.16 Citation Details
Chariker, Logan and Shapley, Robert and Young, Lai-Sang "Rhythm and Synchrony in a Cortical Network Model" The Journal of Neuroscience , v.38 , 2018 10.1523/JNEUROSCI.0675-18.2018 Citation Details
Joglekar, M. R. and Chariker, L. and Shapley, R. and Young, L-S. "A case study in the functional consequences of scaling the sizes of realistic cortical models." PLoS computational biology , v.15 , 2019 https://doi.org/10.1371/journal.pcbi.1007198 Citation Details
Li, Y and Young, L-S "Unraveling the mechanisms of surround suppression in early visual processing" PLoS computational biology , v.17 , 2021 https://doi.org/10.1371/journal.pcbi.1008916 Citation Details
Saraf, Sonica and Young, Lai-Sang "Malleability of gamma rhythms enhances population-level correlations" Journal of Computational Neuroscience , v.49 , 2021 https://doi.org/10.1007/s10827-021-00779-4 Citation Details
Xiao, Zhuo-Cheng and Lin, Kevin K. and Young, Lai-Sang "A data-informed mean-field approach to mapping of cortical parameter landscapes" PLOS Computational Biology , v.17 , 2021 https://doi.org/10.1371/journal.pcbi.1009718 Citation Details
Young, Lai-Sang "Towards a Mathematical Model of the Brain" Journal of Statistical Physics , v.180 , 2020 https://doi.org/10.1007/s10955-019-02483-1 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Our project's outcomes show that today enough is known to make comprehensive computational models of the primary visual cortex, V1, that emulate its function in great detail, quantitatively. Our aim is to understand V1 function through computational modeling, and through understanding V1 to begin to understand cerebral cortex function in general. Our work has a strong focus on population dynamics not present in previous studies. To discover mechanisms, we study not only behaviors of individual model neurons but also how well the model's population behavior emulates population data obtained in the real V1.  Analysis of population activity in large-scale network models has the potential to yield new valuable information for theoretical neuroscience.

What was modeled was a small region of Layer 4Cα (L4), the input layer to V1 in the magnocellular pathway. In addition to L4, the model has two other components: 1) the magnocellular layers of the thalamic visual nucleus, the Lateral Geniculate Nucleus (LGN), which feeds forward to L4, and 2)  Layer 6 (L6) in V1, which feeds back to L4. The problem of feedback, a perennial headache for modelers, is solved in our models with a self-adjusted dynamic algorithm that represents the interactions between L4 and L6.

Here we present two major outcomes of the modeling work: 1) activity maps in the model that show the spatial distributions of firing rate across the cortical surface, and 2) population distributions of directional selectivity in the model that emulate the real cortex with great accuracy. There were many other theorecal results but the two presented here are representative outcomes of the grant.

Studying spatial maps of cortical activity on the cortical surface helps us to understand cortical function.  In the model as in real cortex, firing rates of cells in optimally driven domains climb steeply, while firing rates of cells in orthogonal domains are virtually unchanged. Thus, the firing rate profile across the cortical surface is extremely uneven, with tall peaks separated by deep valleys. How can such a wildly varying landscape of activity in mutually interacting neurons be stable? To answer this question, we present simulated activity maps in the model

Consider first the activity maps of E-cells (Fig 1, top row). Looking at the intended orientations map in Panel B, we see that the vertical preferring region is comprised of three diamonds stacked up vertically on the left side and three half-diamonds on the right side of the 9 HC model cortex. This means that when the vertical, or 0o, grating is presented, one should expect these diamond-shaped regions to respond most vigorously. The top left panel of Fig 1 shows that this is indeed the case. But then consider the panel in A corresponding to the 45o grating (middle of top row). As one can see in Panel B, there is no LGN template that prefers this orientation. There are, however, domains favoring 30o and 60o; the region in the model cortex that responded most vigorously to 45o straddled those two regions evenly. We intentionally used 8 gratings with evenly spaced orientations, a number incommensurate with the 6 sets of LGN templates, to show that through dynamical interactions, both lateral and feedback, neurons in L4 are able to respond correctly to in- between orientations to produce a smooth orientation map.  

Activity maps for I-cells look different. Figure 1 second row, shows activity maps for I-cells. Observe that E- and I-cells are co-activated, and I-firing rates are 3-4 times higher than those of E-cells, consistent with data. Also, the regions of elevated I-spiking are larger than those for E-cells, and I-firing rates are above 20-30 spikes/sec virtually everywhere, unlike E-cells, which in orthogonal regions fire at or slightly above background level, i.e. at ~4 spikes/s.  

Each of the panels in Figure 1 represents a continuum of local equilibria, obtained through the dynamic balancing of excitation and inhibition. In the model as in real cortex, the circuitry of Layer 4Cα is roughly spatially homogeneous. The inputs received, on the other hand, vary from point to point depending on the stimulus, and activity maps are produced by the subtle changes in inputs together with cortico-cortical interaction.

Figure 2 shows the outcome of our modeling of Direction Selectivity (DS) in layer 4Cα based on dynamic differences in the ON and OFF LGN inputs to V1. Fig 2A shows distributions of Pref/Opp in layer 4Cα Simple cells (green, upper panel) and in model Simple cells (black, lower panel).  The two distributions have very similar medians (~3.5) and similar fractions of cells with very high DS, ie Pref/Opp>8. The cumulative distribution functions (CDFs) of DS of Simple and Complex cells in the model simulate those of the data very closely, also (Fig 2B). No other model has achieved this kind of agreement with cortical data on DS at the population level.


Last Modified: 10/04/2022
Modified by: Robert Shapley

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page