Awesome Spiking Neural Networks

Collect some spiking neural network papers & codes. (Actively keep updating)

If you own or find some overlooked SNN papers, you can add them to this document by pull request.

News

[2024.10.15] Update SNN-related papers in ECCV 2024 (8 papers).

[2024.05.29] Update SNN-related papers in ICLR 2024 (17 papers), AAAI 2024 (8 papers), CVPR 2024 (3 papers), ICML 2024 (13 papers), IJCAI 2024 (5 papers).

[2023.12.31] Update SNN-related papers in TPAMI 2023, Frontiers in Neuroscience 2023.

[2023.11.06] Update SNN-related papers in NeurIPS 2023 (12 papers).

[2023.10.08] Update SNN-related papers in CVPR 2023 (2 papers), ICML 2023 (2), IJCAI 2023 (3), and ICCV 2023 (10).

[2023.06.25] Update SNN-related papers in ICLR 2023 (6 papers), AAAI 2023 (6 papers).

Papers

2024

Review

Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods (Frontiers in Neuroscience 2024). [paper] [arxiv]

NeurIPS, AAAI, ICLR, Frontiers in Neuroscience, CVPR, ICML, IJCAI

Spiking Neural Network as Adaptive Event Stream Slicer (NeurIPS 2024). [paper]
Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators (NeurIPS 2024). [paper] [code]
QKFormer: Hierarchical Spiking Transformer using Q-K Attention (NeurIPS 2024). [paper] [code]
Integer-Valued Training and Spike-Driven Inference Spiking Neural Network for High-performance and Energy-efficient Object Detection (ECCV 2024). [paper] [code]
Spiking Wavelet Transformer (ECCV 2024). [paper] [code]
Efficient Training of Spiking Neural Networks with Multi-Parallel Implicit Stream Architecture (ECCV 2024). [paper] [code]
Asynchronous Bioplausible Neuron for Spiking Neural Networks for Event-Based Vision (ECCV 2024). [paper]
BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation (ECCV 2024). [paper] [code]
Exploring Vulnerabilities in Spiking Neural Networks: Direct Adversarial Attacks on Raw Event Data (ECCV 2024). [paper]
EAS-SNN: End-to-End Adaptive Sampling and Representation for Event-based Detection with Recurrent Spiking Neural Networks (ECCV 2024). [paper] [code]
Spike-Temporal Latent Representation for Energy-Efficient Event-to-Video Reconstruction (ECCV 2024). [paper]
EC-SNN: Splitting Deep Spiking Neural Networks on Edge Devices (IJCAI 2024). [code]
One-step Spiking Transformer with a Linear Complexity (IJCAI 2024).
TIM: An Efficient Temporal Interaction Module for Spiking Transformer (IJCAI 2024). [paper] [code]
Learning a Spiking Neural Network for Efficient Image Deraining (IJCAI 2024). [code]
LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimization (IJCAI 2024). [paper]
Temporal Spiking Neural Networks with Synaptic Delay for Graph Reasoning (ICML 2024). [paper]
Towards efficient deep spiking neural networks construction with spiking activity based pruning (ICML 2024). [paper]
Efficient and Effective Time-Series Forecasting with Spiking Neural Networks (ICML 2024). [paper]
Autaptic Synaptic Circuit Enhances Spatio-temporal Predictive Learning of Spiking Neural Networks (ICML 2024). [paper]
Robust Stable Spiking Neural Networks (ICML 2024). [paper]
CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks (ICML 2024). [paper]
NDOT: Neuronal Dynamics-based Online Training for Spiking Neural Networks (ICML 2024). [paper]
High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost (ICML 2024). [paper]
Towards Efficient Spiking Transformer: a Token Sparsification Framework for Training and Inference Acceleration (ICML 2024). [paper]
SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms (ICML 2024). [paper]
Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network (ICML 2024). [paper]
Enhancing Adversarial Robustness in SNNs with Sparse Gradients (ICML 2024). [paper]
SpikeZIP-TF: Conversion is All You Need for Transformer-based SNN (ICML 2024). [paper]
Are Conventional SNNs Really Efficient? A Perspective from Network Quantization (CVPR 2024). [paper]
SFOD: Spiking Fusion Object Detector (CVPR 2024). [paper] [code]
SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks (CVPR 2024). [paper] [code]
SGLFormer: Spiking Global-Local-Fusion Transformer with high performance (Frontiers in Neuroscience 2024).[paper] [code]
Towards Energy Efficient Spiking Neural Networks: An Unstructured Pruning Framework (ICLR 2024). [paper]
Online Stabilization of Spiking Neural Networks (ICLR 2024). [paper]
SpikePoint: An Efficient Point-based Spiking Neural Network for Event Cameras Action Recognition (ICLR 2024). [paper]
Spatio-Temporal Approximation: A Training-Free SNN Conversion for Transformers (ICLR 2024). [paper]
Sparse Spiking Neural Network: Exploiting Heterogeneity in Timescales for Pruning Recurrent SNN (ICLR 2024). [paper]
Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable Spacings (ICLR 2024). [paper] [code]
Threaten Spiking Neural Networks through Combining Rate and Temporal Information (ICLR 2024). [paper] [code]
TAB: Temporal Accumulated Batch Normalization in Spiking Neural Networks (ICLR 2024). [paper]
Certified Adversarial Robustness for Rate Encoded Spiking Neural Networks (ICLR 2024). [paper]
Bayesian Bi-clustering of Neural Spiking Activity with Latent Structures (ICLR 2024). [paper]
Adaptive deep spiking neural network with global-local learning via balanced excitatory and inhibitory mechanism (ICLR 2024). [paper]
Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural Networks (ICLR 2024). [paper] [code]
A Progressive Training Framework for Spiking Neural Networks with Learnable Multi-hierarchical Model (ICLR 2024). [paper] [code]
LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Units (ICLR 2024). [paper] [code]
Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips (ICLR 2024). [paper] [code]
Can we get the best of both Binary Neural Networks and Spiking Neural Networks for Efficient Computer Vision? (ICLR 2024). [paper] [code]
A Graph is Worth 1-bit Spikes: When Graph Contrastive Learning Meets Spiking Neural Networks (ICLR 2024). [paper] [code]
Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks (AAAI 2024). [paper] [code]
Memory-Efficient Reversible Spiking Neural Networks (AAAI 2024). [paper] [code]
Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks (AAAI 2024). [paper]
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation (AAAI 2024). [paper] [code]
TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modelling (AAAI 2024). [paper] [code]
Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Networks (AAAI 2024). [paper]
Dynamic Spiking Graph Neural Networks (AAAI 2024). [paper]
An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain (AAAI 2024). [paper] [code]

Arxiv

Q-SNNs: Quantized Spiking Neural Networks. [paper]
Scalable MatMul-free Language Modeling. [paper] [code]
QKFormer: Hierarchical Spiking Transformer using Q-K Attention. [paper] [code]
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket. [paper] [code]
SpikeNAS: A Fast Memory-Aware Neural Architecture Search Framework for Spiking Neural Network Systems. [paper]
Astrocyte-Enabled Advancements in Spiking Neural Networks for Large Language Modeling. [paper]

2023

Review

Direct Learning-Based Deep Spiking Neural Networks: A Review (Frontiers in Neuroscience 2023). [paper]

AAAI, ICLR, CVPR, ICML, IJCAI, ICCV, NeurIPS, TPAMI, Science Advances

SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence (Science Advances 2023). [paper] [code]
Spike-driven Transformer [paper] [code]
Parallel Spiking Neurons with High Efficiency and Long-term Dependencies Learning Ability (NeurIPS 2023). [paper] [code]
Temporal Conditioning Spiking Latent Variable Models of the Neural Response to Natural Visual Scenes (NeurIPS 2023). [paper]
SEENN: Towards Temporal Spiking Early Exit Neural Networks (NeurIPS 2023). [paper]
EICIL: Joint Excitatory Inhibitory Cycle Iteration Learning for Deep Spiking Neural Networks (NeurIPS 2023). [paper]
Addressing the speed-accuracy simulation trade-off for adaptive spiking neurons (NeurIPS 2023). [paper]
Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networks (NeurIPS 2023). [paper]
Trial matching: capturing variability with data-constrained spiking neural networks (NeurIPS 2023). [paper]
Evolving Connectivity for Recurrent Spiking Neural Networks (NeurIPS 2023). [paper]
SparseProp: Efficient Event-Based Simulation and Training of Sparse Recurrent Spiking Neural Networks (NeurIPS 2023). [paper]
Spiking PointNet: Spiking Neural Networks for Point Clouds (NeurIPS 2023). [paper] [code]
Exploring Loss Functions for Time-based Training Strategy in Spiking Neural Networks (NeurIPS 2023). [paper]
Membrane Potential Batch Normalization for Spiking Neural Networks (ICCV 2023). [paper]
Unleashing the Potential of Spiking Neural Networks with Dynamic Confidence (ICCV 2023). [paper]
RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networks (ICCV 2023). [paper]
Inherent Redundancy in Spiking Neural Networks (ICCV 2023). [paper]
Temporal-Coded Spiking Neural Networks with Dynamic Firing Threshold: Learning with Event-Driven Backpropagation (ICCV 2023). [paper]
Efficient Converted Spiking Neural Network for 3D and 2D Classification (ICCV 2023). [paper]
Deep Directly-Trained Spiking Neural Networks for Object Detection (ICCV 2023). [paper]
Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks (ICCV 2023). [paper]
SSF: Accelerating Training of Spiking Neural Networks with Stabilized Spiking Flow (ICCV 2023). [paper]
Masked Spiking Transformer (ICCV 2023). [paper]
Spatial-Temporal Self-Attention for Asynchronous Spiking Neural Networks (IJCAI 2023). [paper]
Learnable Surrogate Gradient for Direct Training Spiking Neural Networks (IJCAI 2023). [paper]
Enhancing Efficient Continual Learning with Dynamic Structure Development of Spiking Neural Networks (IJCAI 2023). [paper]
Adaptive Smoothing Gradient Learning for Spiking Neural Networks (ICML 2023). [paper]
Surrogate Module Learning: Reduce the Gradient Error Accumulation in Training Spiking Neural Networks (ICML 2023). [paper] [code]
Rate Gradient Approximation Attack Threats Deep Spiking Neural Networks (CVPR 2023). [paper]
Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation (CVPR 2023). [paper]
Attention Spiking Neural Networks (TPAMI 2023) .[paper] [code]
Heterogeneous neuronal and synaptic dynamics for spike-efficient unsupervised learning: Theory and design principles (ICLR 2023).[paper]
Spiking Convolutional Neural Networks for Text Classification (ICLR 2023) .[paper]
Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes (ICLR 2023).[paper] [code]
Spikformer: When Spiking Neural Network Meets Transformer (ICLR 2023) .[paper] [code]
A Unified Framework of Soft Threshold Pruning (ICLR 2023). [paper] [code]
Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes (ICLR 2023). [paper] [code]
Reducing ANN-SNN Conversion Error through Residual Membrane Potential (AAAI 2023). [paper] [code]
Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and Mouse (AAAI 2023). [paper]
ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks (AAAI 2023). [paper]
Exploring Temporal Information Dynamics in Spiking Neural Networks (AAAI 2023). [paper] [code]
Scaling Up Dynamic Graph Representation Learning via Spiking Neural Networks(AAAI 2023). [paper] [code]
Complex Dynamic Neurons Improved Spiking Transformer Network for Efficient Automatic Speech Recognition(AAAI 2023). [paper]

Arxiv

Spikingformer: Spike-driven Residual Learning for Transformer-based Spiking Neural Network [paper] [code]
Enhancing the Performance of Transformer-based Spiking Neural Networks by Improved Downsampling with Precise Gradient Backpropagation [paper] [code]
Training Full Spike Neural Networks via Auxiliary Accumulation Pathway [paper]
MSS-DepthNet: Depth Prediction with Multi-Step Spiking Neural Network [paper]
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks [paper] [code]
Auto-Spikformer: Spikformer Architecture Search [paper]
Advancing Spiking Neural Networks Towards Deep Residual Learning [paper]

2022

NeurIPS, CVPR, ICLR, AAAI, ICML, Nature Communications

Event-based Video Reconstruction via Potential-assisted Spiking Neural Network [paper] [code]
Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks [paper] [code]
Optimized Potential Initialization for Low-latency Spiking Neural Networks (AAAI 2022). [paper]
AutoSNN: Towards Energy-Efficient Spiking Neural Networks [paper]
Neural Architecture Search for Spiking Neural Networks [paper] [code]
Neuromorphic Data Augmentation for Training Spiking Neural Networks [paper] [code]
State Transition of Dendritic Spines Improves Learning of Sparse Spiking Neural Networks [paper] [code]
Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation [paper] [code]
Exploring Lottery Ticket Hypothesis in Spiking Neural Networks [paper] [code]
Spiking Graph Convolutional Networks [paper] [code]
A calibratable sensory neuron based on epitaxial VO2 for spike-based neuromorphic multisensory system [paper] [code]
Online Training Through Time for Spiking Neural Networks (NeurIPS 2022). [paper] [code]
Training Spiking Neural Networks with Event-driven Backpropagation [paper] [code]
GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks [paper] [code]
Temporal Effective Batch Normalization in Spiking Neural Networks [paper]
Training Spiking Neural Networks with Local Tandem Learning (NeurIPS 2022). [paper]
IM-Loss: Information Maximization Loss for Spiking Neural Networks (NeurIPS 2022). [paper]
Temporal Effective Batch Normalization in Spiking Neural Networks (NeurIPS 2022). [paper]
Biologically Inspired Dynamic Thresholds for Spiking Neural Networks (NeurIPS 2022). [paper]
Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks (ICLR 2022). [paper] [code]
Multi-Level Firing with Spiking DS-ResNet: Enabling Better and Deeper Directly-Trained Spiking Neural Networks (IJCAI 2022). [paper]

2021

NeurIPS, ICCV, IJCAI, ICML, AAAI

Deep Residual Learning in Spiking Neural Networks (NeurIPS 2021). [paper] [code]
Spiking Deep Residual Network[paper]
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks (ECCV 2021). [paper] [code]
Pruning of Deep Spiking Neural Networks through Gradient Rewiring [paper] [code]
A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration (ICML 2021). [paper] [code]
Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks [paper] [code]
Sparse Spiking Gradient Descent (NeurIPS 2021). [paper]
Training Spiking Neural Networks with Accumulated Spiking Flow (AAAI 2021). [paper]
Temporal-wise Attention Spiking Neural Networks for Event Streams Classification. (ECCV 2021). [paper]

zhouchenlin2096 / Awesome-Spiking-Neural-Networks