Award Abstract # 2223827
EFRI BRAID: DenPro3D ? Dendritic Processing of Spike Sequences in Biological and Artificial Brains

NSF Org: EFMA
Office of Emerging Frontiers in Research and Innovation (EFRI)
Recipient: THE LELAND STANFORD JUNIOR UNIVERSITY
Initial Amendment Date: September 16, 2022
Latest Amendment Date: September 21, 2023
Award Number: 2223827
Award Instrument: Continuing Grant
Program Manager: Ale Lukaszew
rlukasze@nsf.gov
 (703)292-8103
EFMA
 Office of Emerging Frontiers in Research and Innovation (EFRI)
ENG
 Directorate for Engineering
Start Date: September 1, 2022
End Date: August 31, 2026 (Estimated)
Total Intended Award Amount: $1,999,991.00
Total Awarded Amount to Date: $1,999,991.00
Funds Obligated to Date: FY 2022 = $1,200,000.00
FY 2023 = $799,991.00
History of Investigator:
  • Kwabena Boahen (Principal Investigator)
    boahen@stanford.edu
  • H S Philip Wong (Co-Principal Investigator)
  • Subhasish Mitra (Co-Principal Investigator)
  • Nicholas Steinmetz (Co-Principal Investigator)
  • Kareem Zaghloul (Co-Principal Investigator)
Recipient Sponsored Research Office: Stanford University
450 JANE STANFORD WAY
STANFORD
CA  US  94305-2004
(650)723-2300
Sponsor Congressional District: 16
Primary Place of Performance: Stanford University
290 Jane Stanford Way
Stanford
CA  US  94305-2004
Primary Place of Performance
Congressional District:
16
Unique Entity Identifier (UEI): HJD6G4D6TJY5
Parent UEI:
NSF Program(s): EFRI Research Projects
Primary Program Source: 01002324DB NSF RESEARCH & RELATED ACTIVIT
01002223DB NSF RESEARCH & RELATED ACTIVIT

01002425DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 8091, 086Z, 9179
Program Element Code(s): 763300
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.041

ABSTRACT

Artificial Intelligence (AI) has progressed rapidly over the past decade, but the cost of deploying and operating AI in energy, dollars, and carbon emissions is growing unsustainably. Users currently access AI through the cloud, sacrificing personalization and privacy. This project uses inspiration from the brain, including learning with dendrites that neuroscientists have recently discovered, to reverse engineer the brain's learning rules guided by neuroscience theory and experimental techniques. These insights will be implemented in a novel neuromorphic chip using emerging three-dimensional (3-D) fabrication techniques. The success of such an approach would allow AI to run, not with megawatts in the cloud, but rather with watts on a smartphone. Thus, learning with dendrites could reign in unsustainably growing costs, distribute productivity gains equitably, personalize user experience, and restore privacy. This project also aims to increase opportunities for students through ongoing summer internship programs and new outreach efforts (Demo Day on campus for high-schoolers and Engineering Night at high schools).

Tiling computing units and stacking them in the third dimension shortens distances and cuts the energy communication uses, which now dominates the energy budget of today?s processors. But stacking reduces the surface area for dissipating heat, restricting a 3-D processor to serial, rather than parallel operation. Less heat would be produced if units communicate sparsely. This could be accomplished by exchanging patterns of binary-amplitude signals (e.g., high or low voltages on a digital bus) for sequences of unary-amplitude signals (e.g., spikes from an ensemble of neurons). But this would require synthesizing connections to precisely order synaptic inputs on a dendrite-like device, shifting the prevailing abstraction of a brain centered on learning with synapses to one centered on learning with dendrites or what the project team refers to as dendrocentric learning. To accomplish this goal, three objectives are proposed: (1) Identify how spiking sequences represent information as subsequences across cortical columns and model how a column learns to generate its subsequence. (2) Establish the combinatorial logic neighboring stretches of dendrite use to decode a sequence?s subsequences and model how a stretch of dendrite learns to detect a subsequence. (3) Emulate a stretch of dendrite?s sequence selectivity in a nanoscale electronic device, integrate it in 3-D, and design a switching network to implement the learning rules formulated in objectives 1 & 2. Achieving these objectives would enable learning in sparse environments with extreme energy efficiency leading to a transformational impact on how information technology serves society while ensuring equity and access.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Chen, Hugo J-Y and Beauchamp, Matthew and Toprasertpong, Kasidit and Huang, Fei and Le_Coeur, Louis and Nemec, Thorgund and Wong, H-S Philip and Boahen, Kwabena "Multi-gate FeFET Discriminates Spatiotemporal Pulse Sequences for Dendrocentric Learning" Teaching for excellence and equity in mathematics , 2023 https://doi.org/10.1109/IEDM45741.2023.10413707 Citation Details
LE_COEUR, Louis and Riedman, Nick and Sarup, Saarthak and Boahen, Kwabena "Energy-efficient detection of a spike sequence" , 2023 https://doi.org/10.14428/esann/2023.es2023-179 Citation Details
Rich, Dennis and Kasperovich, Anna and Malakoutian, Mohamadali and Radway, Robert M and Hagiwara, Shiho and Yoshikawa, Takahide and Chowdhury, Srabanti and Mitra, Subhasish "Thermal Scaffolding for Ultra-Dense 3D Integrated Circuits" , 2023 https://doi.org/10.1109/DAC56929.2023.10247815 Citation Details
Smith, Jimmy TH and De_Mello, Shalini and Kautz, Jan and Linderman, Scott W and Byeon, Wonmin "Convolutional State Space Models for Long-Range Spatiotemporal Modeling" , 2023 Citation Details
Smith, Jimmy TH and Warrington, Andrew and Linderman, Scott W "Simplified State Space Layers for Sequence Modeling" , 2023 Citation Details
Wang, Yixin and Degleris, Anthony and Williams, Alex and Linderman, Scott W "Spatiotemporal Clustering with Neyman-Scott Processes via Connections to Bayesian Nonparametric Mixture Models" Journal of the American Statistical Association , v.119 , 2024 https://doi.org/10.1080/01621459.2023.2257896 Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page