REVIEW 2 cited by
MinimalRNN: Toward More Interpretable and Trainable Recurrent Neural Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We introduce MinimalRNN, a new recurrent neural network architecture that achieves comparable performance as the popular gated RNNs with a simplified structure. It employs minimal updates within RNN, which not only leads to efficient learning and testing but more importantly better interpretability and trainability. We demonstrate that by endorsing the more restrictive update rule, MinimalRNN learns disentangled RNN states. We further examine the learning dynamics of different RNN structures using input-output Jacobians, and show that MinimalRNN is able to capture longer range dependencies than existing RNN architectures.
Forward citations
Cited by 2 Pith papers
-
Context-aware Sparse Spatiotemporal Learning for Event-based Vision
A learned input-adaptive threshold gates neuron activations in event-based neural networks, delivering near-SOTA object detection and optical flow with 32-68% fewer synaptic operations.
-
Transformer Model for Alzheimer's Disease Progression Prediction Using Longitudinal Visit Sequences
A Transformer model predicts the next-visit Alzheimer's diagnosis from longitudinal visit sequences and outperforms RNN baselines on conversion cases, especially when few visits are available.
Discussion (0). Continue with ORCID to comment.