Award Abstract # 1845166
CAREER: Extracting principles of neural computation from large scale neural recordings through neural network theory and high dimensional statistics
NSF Org: |
IIS
Division of Information & Intelligent Systems
|
Recipient: |
THE LELAND STANFORD JUNIOR UNIVERSITY
|
Initial Amendment Date:
|
August 30, 2019 |
Latest Amendment Date:
|
August 30, 2019 |
Award Number: |
1845166 |
Award Instrument: |
Standard Grant |
Program Manager: |
Kenneth Whang
kwhang@nsf.gov
(703)292-5149
IIS
Division of Information & Intelligent Systems
CSE
Directorate for Computer and Information Science and Engineering
|
Start Date: |
October 1, 2019 |
End Date: |
September 30, 2025 (Estimated) |
Total Intended Award
Amount: |
$500,000.00 |
Total Awarded Amount to
Date: |
$500,000.00 |
Funds Obligated to Date:
|
FY 2019 = $500,000.00
|
History of Investigator:
|
-
Surya
Ganguli
(Principal Investigator)
sganguli@stanford.edu
|
Recipient Sponsored Research
Office: |
Stanford University
450 JANE STANFORD WAY
STANFORD
CA
US
94305-2004
(650)723-2300
|
Sponsor Congressional
District: |
16
|
Primary Place of
Performance: |
Stanford University
318 Campus Dr., S244
Stanford
CA
US
94305-7464
|
Primary Place of
Performance Congressional District: |
|
Unique Entity Identifier
(UEI): |
HJD6G4D6TJY5
|
Parent UEI: |
|
NSF Program(s): |
Robust Intelligence
|
Primary Program Source:
|
01001920DB NSF RESEARCH & RELATED ACTIVIT
|
Program Reference
Code(s): |
1045,
7495,
8089
|
Program Element Code(s):
|
749500
|
Award Agency Code: |
4900
|
Fund Agency Code: |
4900
|
Assistance Listing
Number(s): |
47.070
|
ABSTRACT

Recent technological advances now enable recordings of thousands of neurons during complex behaviors. Such experimental capabilities could potentially reveal how the brain encodes sensations, forms memories, learns tasks, makes decisions, and generates motor actions. However, there exist major obstacles to attaining a scientific understanding of how the psychological capabilities of the mind emerge from the biological wetware of the brain. First, data analytic methods are not adequate to make sense of the massive datasets currently being gathered from the brain. Second, theoretical methods are not adequate for both optimally designing large-scale neural recordings, and bridging scales from the collective biophysics of many neurons to psychological processes underlying sensations, thoughts and actions. This project will develop novel data analytic and theoretical methods to extract a conceptual understanding of how the brain gives rise to cognition. These methods will be tested in large-scale recordings from many experimental labs studying perception, memory, learning, decision making and motor control. They will also be applied to developing better learning protocols and neural prosthetic devices.
This project will pursue three overarching aims. It will build on advances in high dimensional statistics to develop a theory of when and how subsets of neurons reflect the collective dynamics of the much larger unobserved circuit in which they are embedded. This theory will provide quantitative guidance for the efficient design of future large-scale recording experiments. Second, it will build on advances in deep learning to develop algorithmic methods for extracting a conceptual understanding of how complex neural networks solve tasks. These algorithmic methods will elucidate which aspects of network connectivity and dynamics are essential to understanding how neural circuits perform their computations, thereby providing guidance for what to measure in future neuroscience experiments. Finally, it will advance theories of neural network learning to better understand how the structure of prior experience determines learned neural connectivity, and how this learning process can be optimized. These general theoretical advances will be refined and tested in specific, close experimental collaborations, involving: identifying feedback control laws in motor cortex, finding signatures of attractor dynamics in the hippocampal memory circuits, understanding the neural algorithms for perception in the retina and decision making in prefrontal cortex, and developing frameworks for understanding rapid rodent learning built upon prior experiences.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:
When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external
site maintained by the publisher. Some full text articles may not yet be available without a
charge during the embargo (administrative interval).
Some links on this page may take you to non-federal websites. Their policies may differ from
this site.
(Showing: 1 - 10 of 37)
(Showing: 1 - 37 of 37)
Ebrahimi, Sadegh and Lecoq, Jérôme and Rumyantsev, Oleg and Tasci, Tugce and Zhang, Yanping and Irimia, Cristina and Li, Jane and Ganguli, Surya and Schnitzer, Mark J
"Emergent reliability in sensory cortical coding and inter-area communication"
Nature
, v.605
, 2022
https://doi.org/10.1038/s41586-022-04724-y
Citation
Details
Fort, S and Dziugaite, G.K. and Paul, M. and Kharaghani, S. and Roy, D.M. and Ganguli, S.
"Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel"
Advances in neural information processing systems
, v.33
, 2020
Citation
Details
Gupta, Agrim and Fan, Linxi and Ganguli, Surya and Fei-Fei, Li
"Metamorph: learning universal controllers with transformers"
International Conference on Learning Representations
, 2022
Citation
Details
Hazon, Omer and Minces, Victor H and Tomàs, David P and Ganguli, Surya and Schnitzer, Mark J and Jercog, Pablo E
"Noise correlations in neural ensemble activity limit the accuracy of hippocampal spatial representations"
Nature Communications
, v.13
, 2022
https://doi.org/10.1038/s41467-022-31254-y
Citation
Details
Kadmon, J. and Timcheck, J. and Ganguli, S
"Predictive coding in balanced neural networks with noise, chaos and delays"
Advances in neural information processing systems
, v.33
, 2020
Citation
Details
Kunin, D. and Nayebi, A and Javier, S. and Ganguli, S and Bloom, J. and Yamins, D.
"Two Routes to Scalable Credit Assignment without Weight Symmetry, International Conference on Machine"
Proceedings of Machine Learning Research
, v.37
, 2020
Citation
Details
Maheswaranathan, N. and Williams, A and Golub, M and Ganguli, S and Sussillo, D
"Universality and individuality in neural dynamics across large populations of recurrent networks"
Advances in neural information processing systems
, v.32
, 2019
Citation
Details
Maheswaranathan, N. and Williams, A and Golub, M and Ganguli, S and Sussillo, D.
"Reverse engineering recurrent networks for sentiment classification reveals line attractor dynamics"
Advances in neural information processing systems
, v.32
, 2019
Citation
Details
Maheswaranathan, Niru and McIntosh, Lane T and Tanaka, Hidenori and Grant, Satchel and Kastner, David B and Melander, Joshua B and Nayebi, Aran and Brezovec, Luke E and Wang, Julia H and Ganguli, Surya and Baccus, Stephen A
"Interpreting the retinal neural code for natural scenes: From computations to neurons"
Neuron
, v.111
, 2023
https://doi.org/10.1016/j.neuron.2023.06.007
Citation
Details
Mann, Kevin and Deny, Stephane and Ganguli, Surya and Clandinin, Thomas R.
"Coupling of activity, metabolism and behaviour across the Drosophila brain"
Nature
, v.593
, 2021
https://doi.org/10.1038/s41586-021-03497-0
Citation
Details
Marsh, Brendan P. and Guo, Yudan and Kroeze, Ronen M. and Gopalakrishnan, Sarang and Ganguli, Surya and Keeling, Jonathan and Lev, Benjamin L.
"Enhancing Associative Memory Recall and Storage Capacity Using Confocal Cavity QED"
Physical Review X
, v.11
, 2021
https://doi.org/10.1103/PhysRevX.11.021048
Citation
Details
Marshel, James H. and Kim, Yoon Seok and Machado, Timothy A. and Quirin, Sean and Benson, Brandon and Kadmon, Jonathan and Raja, Cephra and Chibukhchyan, Adelaida and Ramakrishnan, Charu and Inoue, Masatoshi and Shane, Janelle C. and McKnight, Douglas J.
"Cortical layerspecific critical dynamics triggering perception"
Science
, v.365
, 2019
https://doi.org/10.1126/science.aaw5202
Citation
Details
Melander, Joshua B and Nayebi, Aran and Jongbloets, Bart C and Fortin, Dale A and Qin, Maozhen and Ganguli, Surya and Mao, Tianyi and Zhong, Haining
"Distinct in vivo dynamics of excitatory synapses onto cortical pyramidal neurons and parvalbumin-positive interneurons"
Cell Reports
, v.37
, 2021
https://doi.org/10.1016/j.celrep.2021.109972
Citation
Details
Mel, G. and Ganguli, S
"A theory of high dimensional regression with arbitrary correlations between input features and target functions: sample complexity, multiple descent curves and a hierarchy of phase transitions"
International Conference on Machine Learning
, v.139
, 2021
Citation
Details
Nair, Aditya and Karigo, Tomomi and Yang, Bin and Ganguli, Surya and Schnitzer, Mark J and Linderman, Scott W and Anderson, David J and Kennedy, Ann
"An approximate line attractor in the hypothalamus encodes an aggressive state"
Cell
, v.186
, 2023
https://doi.org/10.1016/j.cell.2022.11.027
Citation
Details
Nayebi, A and Srivastava, S and Ganguli, S and Yamins, D.
"Identifying Learning Rules From Neural Network Observables"
Advances in neural information processing systems
, v.33
, 2020
Citation
Details
Nayebi, Aran and Attinger, Alexander and Campbell, Malcolm G and Hardcastle, Kiah and Low, Isabel IC and Mallory, Caitlin S and Mel, Gabriel C and Sorscher, Ben and Williams, Alex and Ganguli, Surya and Giocomo, Lisa and Yamins, Daniel LK
"Explaining heterogeneity in medial entorhinal cortex with task-driven neural networks"
NeurIPS
, 2021
https://doi.org/10.1101/2021.10.30.466617
Citation
Details
Paul, Mansheej and Ganguli, Surya and Dziugaite, Karolina G
"Deep Learning on a Data Diet: Finding Important Examples Early in Training"
NeurIPS
, 2021
Citation
Details
Paul, Mansheej and Larsen, Brett W and Ganguli, Surya and Frankle, Jonathan and Dziugaite, Karolina G
"Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks"
NeurIPS
, 2022
Citation
Details
Rumyantsev, Oleg I. and Lecoq, Jérôme A. and Hernandez, Oscar and Zhang, Yanping and Savall, Joan and Chrapkiewicz, Radosaw and Li, Jane and Zeng, Hongkui and Ganguli, Surya and Schnitzer, Mark J.
"Fundamental bounds on the fidelity of sensory cortical coding"
Nature
, v.580
, 2020
https://doi.org/10.1038/s41586-020-2130-2
Citation
Details
Sorscher, B. and Mel, G. and Ocko, S.
"A unified theory for the origin of grid cells through the lens of pattern formation."
Advances in neural information processing systems
, v.32
, 2019
Citation
Details
Sorscher, Ben and Ganguli, Surya and Sompolinsky, Haim
"Neural representational geometry underlies few-shot concept learning"
Proceedings of the National Academy of Sciences
, v.119
, 2022
https://doi.org/10.1073/pnas.2200800119
Citation
Details
Sorscher, Ben and Geirhos, Robert and Shekhar, Shashank and Ganguli, Surya and Morcos, Ari S
"Beyond neural scaling laws: beating power law scaling via data pruning"
NeurIPS
, 2022
Citation
Details
Sorscher, Ben and Mel, Gabriel C and Ocko, Samuel A and Giocomo, Lisa M and Ganguli, Surya
"A unified theory for the computational and mechanistic origins of grid cells"
Neuron
, v.111
, 2023
https://doi.org/10.1016/j.neuron.2022.10.003
Citation
Details
Stock, Christopher H and Harvey, Sarah E and Ocko, Samuel A and Ganguli, Surya
"Synaptic balancing: A biologically plausible local learning rule that provably increases neural network noise robustness without sacrificing task performance"
PLOS Computational Biology
, v.18
, 2022
https://doi.org/10.1371/journal.pcbi.1010418
Citation
Details
Takeo, Yukari H. and Shuster, S. Andrew and Jiang, Linnie and Hu, Miley C. and Luginbuhl, David J. and Rülicke, Thomas and Contreras, Ximena and Hippenmeyer, Simon and Wagner, Mark J. and Ganguli, Surya and Luo, Liqun
"GluD2- and Cbln1-mediated competitive interactions shape the dendritic arbors of cerebellar Purkinje cells"
Neuron
, v.109
, 2021
https://doi.org/10.1016/j.neuron.2020.11.028
Citation
Details
Tanaka, H. and Kunin, D. and Yamins, Y. and Ganguli, S
"Pruning neural networks without any data by iteratively conserving synaptic flow"
Advances in neural information processing systems
, v.33
, 2020
Citation
Details
Tanaka, H and Nayebi, A and Maheswaranathan, N and McIntosh, L and Baccus, S and Ganguli, S.
"From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction"
Advances in neural information processing systems
, v.32
, 2019
Citation
Details
Tian, Y. and Chen, X. and Ganguli, S.
"Understanding Self-Supervised Learning Dynamics without Contrastive Pairs"
International conference on machine learning
, v.139
, 2021
Citation
Details
Timcheck, Jonathan and Kadmon, Jonathan and Boahen, Kwabena and Ganguli, Surya
"Optimal noise level for coding with tightly balanced networks of spiking neurons in the presence of transmission delays"
PLOS Computational Biology
, v.18
, 2022
https://doi.org/10.1371/journal.pcbi.1010593
Citation
Details
Wagner, Mark J. and Savall, Joan and Hernandez, Oscar and Mel, Gabriel and Inan, Hakan and Rumyantsev, Oleg and Lecoq, Jérôme and Kim, Tony Hyun and Li, Jin Zhong and Ramakrishnan, Charu and Deisseroth, Karl and Luo, Liqun and Ganguli, Surya and Schnitzer
"A neural circuit state change underlying skilled movements"
Cell
, v.184
, 2021
https://doi.org/10.1016/j.cell.2021.06.001
Citation
Details
Williams, Alex H. and Poole, Ben and Maheswaranathan, Niru and Dhawale, Ashesh K. and Fisher, Tucker and Wilson, Christopher D. and Brann, David H. and Trautmann, Eric M. and Ryu, Stephen and Shusterman, Roman and Rinberg, Dmitry and Ölveczky, Bence P. an
"Discovering Precise Temporal Patterns in Large-Scale Neural Recordings through Robust and Interpretable Time Warping"
Neuron
, v.105
, 2020
https://doi.org/10.1016/j.neuron.2019.10.020
Citation
Details
Yamamoto, Y. and Leleu, T. and Ganguli, S. and Mabuchi, H.
"Coherent Ising machinesQuantum optics and neural network Perspectives"
Applied Physics Letters
, v.117
, 2020
https://doi.org/10.1063/5.0016140
Citation
Details
(Showing: 1 - 10 of 37)
(Showing: 1 - 37 of 37)
Please report errors in award information by writing to: awardsearch@nsf.gov.