A neural-network Maxwell's demon learns cold damping for work extraction

Ludovic Bellon; Sergio Ciliberto; Stephen Whitelam

REVIEW 2 major objections 5 minor 28 references

A neural-network Maxwell's demon learns cold damping for work extraction

T0 review · 2 major / 5 minor · reviewed 2026-07-10 · grok-4.5

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read A neural-network Maxwell's demon trained on velocity learns cold damping and nearly saturates the power bound for work extraction from thermal noise.

desk verdict Velocity-input neural demon learns cold damping and nearly saturates the power bound; the numerical result is solid and the physical interpretation is clean. read the letter →

arxiv 2607.06822 v1 pith:6GR4NCQC submitted 2026-07-07 cond-mat.stat-mech

Stephen Whitelam , Sergio Ciliberto , Ludovic Bellon This is my paper · ORCID

classification cond-mat.stat-mech

keywords Maxwell'sdemoncolddampingworkextractionunderdampedoscillatorneural-networkcontrolstochasticthermodynamicsinformationenginefeedbackcooling

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper trains a neural-network controller (a Maxwell's demon) to extract work from thermal fluctuations of an underdamped micromechanical cantilever by periodically moving a harmonic trap. Given only position information the network refines a known protocol and improves performance by about 50 percent. Given velocity it invents a qualitatively different rule that extracts nearly the maximum power allowed by the heat current from the bath. The learned rule is approximately linear in velocity and is identical to cold damping: it raises the oscillator's effective friction and lowers its effective temperature, so that heat inflow (and therefore extractable work) approaches the theoretical ceiling. The result shows that near-optimal work extraction in this underdamped setting has a simple, previously known physical mechanism that machine learning rediscovers rather than invents from scratch.

What carries the argument

Cold damping via velocity-linear feedback: the continuous-time replacement x0 = −αv converts the driven oscillator into an undriven one with γeff = γ + kα > γ and Teff = (γ/γeff)T < T, so that the heat current ⟨Q̇⟩ = (γ/m)kB(T − Teff) approaches the power bound.

What would settle it

Train and evaluate the same velocity network at progressively larger feedback intervals; if extracted power falls far below the continuous-limit cold-damping prediction while a linear protocol still works, the continuous approximation is not the operative mechanism.

Watch

Extended reading notes

Core claim

When a neural-network demon is allowed to set trap position from oscillator velocity, it learns an approximately linear map x0 ≈ −αv that implements cold damping. The resulting effective Langevin dynamics has higher damping and lower kinetic temperature, so the average heat current from the bath nearly saturates the bound kBT/tr and the extracted power does likewise. Position-only networks only refine an existing threshold protocol and remain well below the bound.

Load-bearing premise

The continuous-feedback idealization used to derive the effective cold-damped Langevin equation and the analytic power formula still accurately describes the finite-interval simulations in which the network was actually trained.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The headline result is real: give the network velocity and it spontaneously implements cold damping, extracting ~0.98 kBT/tr and sitting right under the model-independent heat-current bound. That is new relative to the hand-designed position protocols and to the earlier ML work from this group. The position-input network is a useful secondary result—it refines the existing flip protocol and gains ~50%—but the velocity case is the one that matters.

What they do well is keep the story simple after the search. The learned map is approximately linear (x0+ ≈ −αv with α0 ≈ 7), the linear protocol itself recovers essentially the same power, and the effective Langevin equation then predicts Teff and the heat current without further fitting. The variance-gamma work distribution and the IFT checks for heat (and, more cautiously, entropy) are clean supporting material. Self-citations are mostly to their own methods papers; the cold-damping and fluctuation-theorem literature is cited properly.

The softest step is the continuous-feedback idealization used for the analytic reduction. They train and evaluate at finite tf = 0.02 tr, then take tf → 0 to write the effective equation. That is an interpretive convenience, not a load-bearing claim: the numerical power is measured directly at finite tf, and the strictly linear protocol already matches it. Fig. 1c also shows the expected decay of velocity-based power as tf grows, so they are not hiding the limitation. Code is not shipped, but the model and training setup are specified well enough to reimplement.

This is for people who care about information engines, underdamped control, or the practical value of learned protocols that turn out to be interpretable. It is not a conceptual revolution, but it is a clear, useful result that links two communities. I would send it to referees without hesitation.

Referee Report

2 major / 5 minor

Summary. The paper trains neural-network feedback controllers (Maxwell demons) by genetic algorithm to maximize steady-state work extraction from an underdamped Langevin oscillator modeling a micromechanical cantilever. With inputs (x, x0) the network refines a known threshold protocol and gains ~50% in power. With velocity input it learns an approximately linear map x0+ ≈ −αv that implements cold damping, raising γeff and lowering Teff so that extracted power reaches ~0.98 kBT/tr, near the model-independent bound P ≤ kBT/tr from the heat current. The authors derive the effective Langevin dynamics, an analytic power estimate, a variance-gamma form for work fluctuations under linear feedback, and check integral fluctuation theorems for heat and entropy production at finite feedback interval.

Significance. If the results hold, the work cleanly shows that evolutionary training of a neural demon can rediscover a known optomechanical cooling strategy and that this strategy nearly saturates the thermodynamic power bound for underdamped work extraction. Strengths include: direct finite-tf numerical power measurements for three protocols; an independent linear cold-damping protocol that reproduces the near-bound power; analytic matching of mean power (Eq. 14) and of the bulk of the work distribution; careful comparison of internal vs external force conventions for energetics; and numerical verification of the heat IFT at the simulation feedback rate. The interpretability of the learned solution is a genuine contribution beyond black-box optimization.

major comments (2)

[Section IV, Eqs. (9)–(14)] Section IV and Eqs. (9)–(14): the identification of cold damping and the analytic power estimate rest on replacing the learned discrete map by continuous feedback x0 = −αv (tf → 0). The central numerical claim P ≈ 0.98 kBT/tr is established at finite tf = 0.02 tr and does not require that limit, and the strictly linear protocol yields essentially the same power. Still, the manuscript would be stronger if it reported Teff (or ⟨v²⟩) measured directly in the finite-tf network and linear simulations and compared them to Eq. (13), so that the continuous approximation is quantified rather than assumed for the mechanism claim.
[Section V.B, Fig. 4] Section V.B and Fig. 4(c,d): the entropy-production IFT is shown to be practically unverifiable at the large α0 relevant to near-optimal extraction because fluctuations of −ln P(x,v) dominate. The heat IFT (Fig. 4a) is clean. The text should state more explicitly that the entropy IFT check is inconclusive at the operating point of interest and that the thermodynamic consistency argument for near-bound power therefore rests primarily on the heat current bound and the heat IFT, not on a verified entropy IFT at α0 ≈ 7.

minor comments (5)

[Abstract, Sections III–IV] Abstract and several body paragraphs contain run-together words (e.g. “implementscold”, “admon”, “netprotocol”) that appear to be extraction/typesetting artifacts; please clean for the journal version.
[Fig. 1(c)] Fig. 1(c) shows P(tf) only for the velocity network. Adding the position-based protocols (or at least the simple protocol) on the same axes would make the contrast with the equilibrium-limit behavior stated in the text more transparent.
[Appendix A, Fig. 3(a)] Appendix A: the short-time cutoff Δ is introduced as phenomenological because tf itself does not give the best fit. A brief statement of the value of Δ used for the dashed curve in Fig. 3(a) and a one-sentence sensitivity check would help reproducibility.
[Section IV, Eq. (9)] Notation: α0 is defined via α = α0 ω0−1; stating the numerical value α0 ≈ 7 once in the main text near Eq. (9) (it appears later) would reduce hunting for the slope used in all analytic estimates.
[Section II] The symmetry constraints fθ(−x,−x0)=−fθ(x,x0) and gθ(−v)=−gθ(v) are imposed after unconstrained training; a short remark on whether unconstrained nets ever found higher power (they did not, per the text) would close that loop for the reader.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: power is measured by direct finite-tf simulation of a GA-trained map; cold-damping analysis is post-hoc and independently validated.

full rationale

The central numerical claim (velocity-input network extracts P ≈ 0.98 kBT/tr) is obtained by direct evaluation of work increments Wn under the trained protocol at finite tf = 0.02 tr (Eq. 5, Fig. 1b). The thermodynamic upper bound P 一 kBT/tr follows from the model-independent heat-current expression ⟨Q̇⟩ = (1/tr) kB(T - Teff) (Eq. 8) and does not depend on the form of the feedback. The subsequent identification x0+ ≈ -αv (α0 ≈ 7) is read off the learned map (Fig. 2a, right) and used only for interpretation; substituting it into the continuous-feedback Langevin equation yields Teff and an analytic power (Eqs. 12–14) that matches the already-measured numerical value. The same linear protocol, when simulated independently, reproduces both the power and the variance-gamma work distribution, confirming the mechanism without circularity. Self-citations (Refs. 12, 13, 25) supply only the integrator and genetic-algorithm training procedure; the cold-damping literature cited for the physical interpretation is external. No equation reduces the reported power to a fitted input or to a self-citation of the result itself.

Assumptions & free parameters 4 free parameters · 5 assumptions · 0 invented entities

The central claim rests on standard underdamped Langevin dynamics and stochastic-thermodynamic definitions of work and heat, plus the modeling choice that a finite-tf neural protocol can be approximated by continuous linear velocity feedback. Free parameters are the optimized protocol coefficients (especially α0) and the phenomenological short-time cutoff used only for the work-distribution shape; no new physical entities are postulated.

free parameters (4)

α0 (linear cold-damping slope) = ≈7.0
Read off from the trained network output in Fig. 2(a,right) as α0≈7; used to obtain Teff and the analytic power (14). Central claim of near-saturation depends on α0 Qf ≫ 1.
simple-protocol parameters h, L = h≈0.451σ, L≈0.504σ
Optimized by the same genetic algorithm; baseline for the 50% improvement claim of the position-input network.
neural-network weights θ
Optimized by genetic algorithm to maximize steady-state power; define the functions fθ and gθ that constitute the learned demons.
short-time regularization Δ for work distribution = chosen for best visual match
Phenomenological cutoff introduced in Appendix A to make ⟨v̇²⟩ finite; affects only the analytic shape of P(W), not the mean-power claim.

assumptions (5)

domain assumption The cantilever is described by the underdamped Langevin equation (1) with experimental parameters Qf=10, tr≈1.4 ms, σ≈1 nm.
Section II; all training and analytic results are obtained inside this model.
domain assumption Work extracted at each feedback event equals the instantaneous change in potential energy U(x,x0) (Eqs. 5–6).
Standard stochastic-thermodynamic definition used throughout; mean power is shown independent of internal/external force convention.
standard math In steady state the extracted power cannot exceed the average heat current from the bath, so P ≤ kBT/tr when Teff→0 (Eq. 8).
Invoked to declare the velocity protocol near-optimal; follows from energy balance and the definition of Teff.
ad hoc to paper The continuous-feedback limit tf→0 is a faithful description of the finite-tf=0.02 tr simulations for the purpose of identifying cold damping and computing Teff.
Section IV; enables the reduction to Eqs. (11)–(14). Finite-tf effects are explored only numerically in Fig. 1c.
domain assumption A genetic algorithm maximizing long-trajectory power finds protocols that are near-global optima for the given input sets.
Training method of Section II; near-saturation of an independent bound supplies supporting evidence but is not a proof of optimality.

how reviews work

0 comments

Cite this review

Pith. "Pith review of A neural-network Maxwell's demon learns cold damping for work extraction." pith.science (2026). https://pith.science/paper/6GR4NCQC

@misc{pith2026260706822,
  author       = {Pith},
  title        = {Pith review of: A neural-network Maxwell's demon learns cold damping for work extraction},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/6GR4NCQC}},
  note         = {Machine review of arXiv:2607.06822}
}

read the original abstract

We train a neural-network Maxwell's demon to extract work from a model of an underdamped micromechanical cantilever subject to thermal noise. The demon, which periodically adjusts the position of a harmonic trap, is trained to maximize the power extracted under steady-state operation. When the demon is given the cantilever position and trap position as inputs it learns a refined version of an existing hand-designed protocol, yielding a substantial improvement in performance. When the demon receives the oscillator velocity as input it discovers a qualitatively different strategy that extracts substantially more work, close to the theoretical power bound. Analysis of the protocol shows that it implements {\em cold damping}: the trap position is displaced approximately linearly with velocity, producing an effective increase of the oscillator's damping coefficient and a reduction of its effective temperature. Thus a neural-network Maxwell's demon rediscovers a well-known cooling strategy from optomechanics, revealing a simple physical mechanism underlying near-optimal work extraction from thermal fluctuations in an underdamped system.

Figures

Figures reproduced from arXiv: 2607.06822 by the authors.

**Figure 2.** FIG. 2. For the three feedback-control protocols, Eq. ( [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗

**Figure 3.** FIG. 3. (a) Work distribution [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗

Figures from the paper (1 more)

**Figure 4.** Figure 4: FIG. 4. Fluctuation theorems for the cold-damped dynamics, [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

28 extracted references · 28 canonical work pages

[1]

(1−g v(∆)) .(A19) Note that for small ∆,σ2 a∆ diverges as 1/∆ andρvanishes as √ ∆: ρ≈ s ∆ω0 2 (1 +α2

work page
[2]

2(c, right)

(α0 + 1/Qf) .(A20) With these details in hand, we can derive insight into several of the features of the work distribution shown in Fig. 2(c, right). First, the mean instantaneous power extracted by the feedback follows from (A8), and is ⟨P⟩=−kα⟨y˙v⟩=αk kBTeff m (A21) = γ m kB T−T eff ,(A22) usingT eff ≡T γ/γ eff. This result agrees with Eq. (14) (the min...

work page
[3]

James Clerk Maxwell,Theory of Heat(Appleton, Lon- don, 1871)

work page
[4]

On the decrease of entropy in a thermody- namic system by the intervention of intelligent beings,

Leo Szilard, “On the decrease of entropy in a thermody- namic system by the intervention of intelligent beings,” Behavioral Science9, 301 (1964)

work page 1964
[5]

Information engine fueled by first- passage times,

Aubin Archambault, Caroline Crauste-Thibierge, Al- berto Imparato, Christopher Jarzynski, Sergio Ciliberto, and Ludovic Bellon, “Information engine fueled by first- passage times,” Phys. Rev. Lett.135, 147101 (2025)

work page 2025
[6]

Maximizing power and velocity of an information engine,

Tushar K Saha, Joseph NE Lucero, Jannik Ehrich, David A Sivak, and John Bechhoefer, “Maximizing power and velocity of an information engine,” Proc. Natl. Acad. Sci.118, e2023356118 (2021)

work page 2021
[7]

Generalized Jarzynski equality under nonequilibrium feedback control,

T Sagawa and M Ueda, “Generalized Jarzynski equality under nonequilibrium feedback control,” Phys. Rev. Lett. 104, 090602 (2010)

work page 2010
[8]

Thermodynamics of information,

Juan M. R. Parrondo, Jordan M. Horowitz, and Takahiro Sagawa, “Thermodynamics of information,” Nat. Phys. 11, 131 (2015)

work page 2015

Show all 28 references

[9]

Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski 9 equality,

S Toyabe, T Sagawa, M Ueda, E Muneyuki, and M Sano, “Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski 9 equality,” Nat. Phys.6, 988 (2010)

2010
[10]

Stochastic thermodynamics, fluctuation theorems and molecular machines,

Udo Seifert, “Stochastic thermodynamics, fluctuation theorems and molecular machines,” Rep. Prog. Phys.75, 126001 (2012)

2012
[11]

Steps minimize dissipation in rapidly driven stochastic systems,

Steven Blaber, Miranda D Louwerse, and David A Sivak, “Steps minimize dissipation in rapidly driven stochastic systems,” Phys. Rev. E104, L022101 (2021)

2021
[12]

Virtual double-well potential for an under- damped oscillator created by a feedback loop,

Salambˆ o Dago, Jorge Pereda, Sergio Ciliberto, and Lu- dovic Bellon, “Virtual double-well potential for an under- damped oscillator created by a feedback loop,” J. Stat. Mech.2022, 053209 (2022)

2022
[13]

Inertial effects in dis- crete sampling information engines,

Aubin Archambault, Caroline Crauste-Thibierge, Sergio Ciliberto, and Ludovic Bellon, “Inertial effects in dis- crete sampling information engines,” Europhysics Letters 148, 41002 (2024)

2024
[14]

Learning efficient erasure protocols for an underdamped memory,

Nicolas Barros, Stephen Whitelam, Sergio Ciliberto, and Ludovic Bellon, “Learning efficient erasure protocols for an underdamped memory,” Phys. Rev. E111, 044114 (2025)

2025
[15]

Demon in the machine: learning to extract work and absorb entropy from fluctuating nanosystems,

Stephen Whitelam, “Demon in the machine: learning to extract work and absorb entropy from fluctuating nanosystems,” Phys. Rev. X13, 021005 (2023)

2023
[16]

Op- tomechanical cooling of a macroscopic oscillator by ho- modyne feedback,

Stefano Mancini, David Vitali, and Paolo Tombesi, “Op- tomechanical cooling of a macroscopic oscillator by ho- modyne feedback,” Phys. Rev. Lett.80, 688 (1998)

1998
[17]

Feedback cooling of a cantilever’s fundamental mode be- low 5 mk,

M. Poggio, C. L. Degen, H. J. Mamin, and D. Rugar, “Feedback cooling of a cantilever’s fundamental mode be- low 5 mk,” Phys. Rev. Lett.99, 017201 (2007)

2007
[18]

Cavity optomechanics,

Markus Aspelmeyer, Tobias J. Kippenberg, and Florian Marquardt, “Cavity optomechanics,” Rev. Mod. Phys. 86, 1391 (2014)

2014
[19]

Entropy production and fluctuation theorems under feedback control: the molecular refrigerator model revisited,

T Munakata and M L Rosinberg, “Entropy production and fluctuation theorems under feedback control: the molecular refrigerator model revisited,” J. Stat. Mech. 2012, P05010 (2012)

2012
[20]

Stochas- tic thermodynamics of langevin systems under time- delayed feedback control. ii. nonequilibrium steady-state fluctuations,

M. L. Rosinberg, G. Tarjus, and T. Munakata, “Stochas- tic thermodynamics of langevin systems under time- delayed feedback control. ii. nonequilibrium steady-state fluctuations,” Phys. Rev. E95, 022123 (2017)

2017
[21]

Entropy production of Brownian macromolecules with inertia,

Kyung Hyuk Kim and Hong Qian, “Entropy production of Brownian macromolecules with inertia,” Phys. Rev. Lett.93, 120602 (2004)

2004
[22]

Fluctuation theorems for a molecular refrigerator,

Kyung Hyuk Kim and Hong Qian, “Fluctuation theorems for a molecular refrigerator,” Phys. Rev. E75, 022102 (2007)

2007
[23]

Non-markovian momentum computing: Thermodynamically efficient and computa- tion universal,

Kyle J Ray, Alexander B Boyd, Gregory W Wimsatt, and James P Crutchfield, “Non-markovian momentum computing: Thermodynamically efficient and computa- tion universal,” Phys. Rev. Res.3, 023164 (2021)

2021
[24]

Gigahertz sub- landauer momentum computing,

Kyle J Ray and James P Crutchfield, “Gigahertz sub- landauer momentum computing,” Phys. Rev. Appl.19, 014049 (2023)

2023
[25]

Virtual potential cre- ated by a feedback loop: Taming the feedback demon to explore stochastic thermodynamics of underdamped sys- tems,

Salambˆ o Dago, Nicolas Barros, Jorge Pereda, Sergio Ciliberto, and Ludovic Bellon, “Virtual potential cre- ated by a feedback loop: Taming the feedback demon to explore stochastic thermodynamics of underdamped sys- tems,” inCrossroad of Maxwell Demon, edited by Xavier Bouju a...

2024 arXiv
[26]

In this article, we use the engine convention for work and heat: work extracted from the system and heat coming from the bath are positive quantities
[27]

Benchmark control problems in nonequilibrium statistical mechanics,

Stephen Whitelam, Corneel Casert, Megan Engel, and Isaac Tamblyn, “Benchmark control problems in nonequilibrium statistical mechanics,” (2025), arXiv:2506.15122 [cond-mat.stat-mech]

2025 arXiv
[28]

The variance-gamma distribution: A review,

Adrian Fischer, Robert E Gaunt, and Andrey Sarantsev, “The variance-gamma distribution: A review,” Statist. Sci.40, 235 (2025)

2025

Pith tools

Reviewed July 10, 2026 · model on record in the stance chip above.

[1] [1]

(1−g v(∆)) .(A19) Note that for small ∆,σ2 a∆ diverges as 1/∆ andρvanishes as √ ∆: ρ≈ s ∆ω0 2 (1 +α2

work page

[2] [2]

2(c, right)

(α0 + 1/Qf) .(A20) With these details in hand, we can derive insight into several of the features of the work distribution shown in Fig. 2(c, right). First, the mean instantaneous power extracted by the feedback follows from (A8), and is ⟨P⟩=−kα⟨y˙v⟩=αk kBTeff m (A21) = γ m kB T−T eff ,(A22) usingT eff ≡T γ/γ eff. This result agrees with Eq. (14) (the min...

work page

[3] [3]

James Clerk Maxwell,Theory of Heat(Appleton, Lon- don, 1871)

work page

[4] [4]

On the decrease of entropy in a thermody- namic system by the intervention of intelligent beings,

Leo Szilard, “On the decrease of entropy in a thermody- namic system by the intervention of intelligent beings,” Behavioral Science9, 301 (1964)

work page 1964

[5] [5]

Information engine fueled by first- passage times,

Aubin Archambault, Caroline Crauste-Thibierge, Al- berto Imparato, Christopher Jarzynski, Sergio Ciliberto, and Ludovic Bellon, “Information engine fueled by first- passage times,” Phys. Rev. Lett.135, 147101 (2025)

work page 2025

[6] [6]

Maximizing power and velocity of an information engine,

Tushar K Saha, Joseph NE Lucero, Jannik Ehrich, David A Sivak, and John Bechhoefer, “Maximizing power and velocity of an information engine,” Proc. Natl. Acad. Sci.118, e2023356118 (2021)

work page 2021

[7] [7]

Generalized Jarzynski equality under nonequilibrium feedback control,

T Sagawa and M Ueda, “Generalized Jarzynski equality under nonequilibrium feedback control,” Phys. Rev. Lett. 104, 090602 (2010)

work page 2010

[8] [8]

Thermodynamics of information,

Juan M. R. Parrondo, Jordan M. Horowitz, and Takahiro Sagawa, “Thermodynamics of information,” Nat. Phys. 11, 131 (2015)

work page 2015