REVIEW 5 cited by
CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Spiking neural networks (SNNs) are promising brain-inspired energy-efficient models. Compared to conventional deep Artificial Neural Networks (ANNs), SNNs exhibit superior efficiency and capability to process temporal information. However, it remains a challenge to train SNNs due to their undifferentiable spiking mechanism. The surrogate gradients method is commonly used to train SNNs, but often comes with an accuracy disadvantage over ANNs counterpart. We link the degraded accuracy to the vanishing of gradient on the temporal dimension through the analytical and experimental study of the training process of Leaky Integrate-and-Fire (LIF) Neuron-based SNNs. Moreover, we propose the Complementary Leaky Integrate-and-Fire (CLIF) Neuron. CLIF creates extra paths to facilitate the backpropagation in computing temporal gradient while keeping binary output. CLIF is hyperparameter-free and features broad applicability. Extensive experiments on a variety of datasets demonstrate CLIF's clear performance advantage over other neuron models. Furthermore, the CLIF's performance even slightly surpasses superior ANNs with identical network structure and training conditions. The code is available at https://github.com/HuuYuLong/Complementary-LIF.
Forward citations
Cited by 5 Pith papers
-
SPEAR: Structured Pruning for Spiking Neural Networks via Synaptic Operation Estimation and Reinforcement Learning
SPEAR combines a linear-regression SynOps estimator with a target-aware reward to search structured pruning policies for spiking neural networks under a SynOps budget.
-
Improving Performance of Spike-based Deep Q-Learning using Ternary Neurons
An asymmetric ternary spiking neuron with a trainable negative threshold improves deep spiking Q-network scores on six of seven Atari games, but the theoretical explanation and the headline performance metric are not ...
-
SDSNN: A Single-Timestep Spiking Neural Network with Self-Dropping Neuron and Bayesian Optimization
A network using decay-triggered Self-Dropping neurons and Bayesian per-layer time-step search reports Fashion-MNIST 93.72%, CIFAR-10 92.20%, and CIFAR-100 69.45% accuracy with 21-56% energy savings versus multi-timestep LIF.
-
Optimization of Low-Latency Spiking Neural Networks Utilizing Historical Dynamics of Refractory Periods
A refractory period that adapts using the neuron's membrane potential derivative and its own history improves low-latency spiking network accuracy, cuts redundant spikes, and boosts noise robustness.
-
Integrating Complexity and Biological Realism: High-Performance Spiking Neural Networks for Breast Cancer Detection
Spiking neural networks combined with Lempel-Ziv complexity reach up to 98.25% accuracy on the Wisconsin breast cancer dataset, but the result lacks error bars, code, and a working threshold rule for the Levy-Baxter neuron.
Discussion (0). Continue with ORCID to comment.