Langevin sampling on the modern Hopfield energy produces training-free stochastic attention that transitions from exact retrieval to generation as temperature rises, with an entropy inflection condition marking the shift.
Amit, Hanoch Gutfreund, and Haim Sompolinsky
6 Pith papers cite this work. Polarity classification is still indexing.
citation-role summary
citation-polarity summary
years
2026 6roles
background 1polarities
background 1representative citing papers
DenseAMs show tradeoffs between entropy production, retrieval accuracy, and speed at intermediate loads, with a new failure mode in higher-order networks at finite temperature.
Asynchronous sequential updates in KLR Hopfield networks produce statistically indistinguishable trajectories from synchronous dynamics, achieve empirical capacities near P/N=30, and converge with event counts close to initial Hamming distance.
TETRIS-ADAPT-VQE achieves fidelities above 99.3% for SYK (N=20) and 99.9998% for SK (L=18) but requires large resources for SYK models.
Thesis uses statistical mechanics to study DAM and RBM models for understanding memorization, low-dimensional learning, and adversarial robustness in neural networks.
citing papers explorer
-
Stochastic Attention via Langevin Dynamics on the Modern Hopfield Energy
Langevin sampling on the modern Hopfield energy produces training-free stochastic attention that transitions from exact retrieval to generation as temperature rises, with an entropy inflection condition marking the shift.
-
Stochastic Thermodynamics of Associative Memory
DenseAMs show tradeoffs between entropy production, retrieval accuracy, and speed at intermediate loads, with a new failure mode in higher-order networks at finite temperature.
-
Efficient event-driven retrieval in high-capacity kernel Hopfield networks
Asynchronous sequential updates in KLR Hopfield networks produce statistically indistinguishable trajectories from synchronous dynamics, achieve empirical capacities near P/N=30, and converge with event counts close to initial Hamming distance.
-
Ground state preparation of random all-to-all Hamiltonians using ADAPT-VQE
TETRIS-ADAPT-VQE achieves fidelities above 99.3% for SYK (N=20) and 99.9998% for SK (L=18) but requires large resources for SYK models.
-
Explaining Machine Learning and Memorization with Statistical Mechanics
Thesis uses statistical mechanics to study DAM and RBM models for understanding memorization, low-dimensional learning, and adversarial robustness in neural networks.
- Geometric and dynamical analysis of attractor boundaries and storage limits in kernel Hopfield networks