Pith. sign in

REVIEW 3 major objections 6 minor 57 references

Coupling Smoothed Particle Hydrodynamics with Multi-Agent Deep Reinforcement Learning for Cooperative Control of Point Absorbers

T0 review · 3 major / 6 minor · reviewed 2026-08-03 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Coordinated multi-agent damping control increases wave-energy array capture by 23.8% in 2D regular waves and 21.5% in 3D irregular waves, compared with constant PTO damping.

desk verdict A real step forward for SPH-coupled multi-agent RL in WEC arrays, but the headline efficiency gains rest on a baseline that is not properly verified in 3D and for multi-device layouts. read the letter →

arxiv 2601.06485 v1 pith:EKRTTT2B submitted 2026-01-10 eess.SY cs.SY

Yi Zhan , Iván Martínez-Estévez , Min Luo , Alejandro J.C. Crespo , Abbas Khayyer This is my paper
classification eess.SYcs.SY
keywords waveenergyconverterpointabsorberarraysmoothedparticlehydrodynamicsmulti-agentdeepreinforcementlearningsoftactor-criticpowertake-offdampingcooperativecontrolGPUacceleration
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to show that wave-energy point-absorber arrays can harvest significantly more power when each device's power take-off damping is tuned in real time by a cooperative reinforcement-learning agent, rather than held at a fixed value. The proposed system couples a high-fidelity particle-based fluid solver (smoothed particle hydrodynamics) with multi-agent deep reinforcement learning, so each training episode includes true nonlinear wave-body interactions. In 2D regular waves, the learned policies improve total absorbed energy by 9.2% for one device, 18.9% for two, and 23.8% for three; in 3D irregular waves, the total gain is 21.5%. If correct, this provides a reusable route to real-time, coordinated control for multi-body fluid-structure systems beyond wave-energy converters.

What carries the argument

The central mechanism is the two-way coupling loop between the SPH solver and the multi-agent soft actor-critic controller. Each agent builds its local observation from four wave-gauge elevations and their time derivatives, plus heave displacement, velocity, and acceleration; the policy outputs a normalized action mapped to a damping coefficient by k_p,i = k_base + o_i·Δk_max, with Δk_max = 0.9·k_base and k_base set to the best constant value. The reward mixes each device's instantaneous power with the array-averaged power, using γ_p = 0.7, so agents learn to sacrifice individual gains for total array output. Training uses centralised critics that see joint actions while execution relies onl

What would settle it

Re-run the 3D irregular-wave three-device case with a sweep of constant PTO damping coefficients (for example 200-1200 Ns/m) and find the true best fixed k0. If the best fixed coefficient yields total absorbed energy close to or above the 168.42 J achieved by the learned policy over the same 40 s evaluation window, then the claim that learned coordination beats constant damping fails; if the learned policy still wins by a wide margin, the claim survives.

Watch

Extended reading notes

Core claim

The central discovery is that a learnable, per-device damping policy, trained inside the SPH simulation itself, can beat the best constant damping coefficient for point-absorber arrays. Agents receive local wave elevations and their derivatives plus the heave motion of their own device, and output a continuous adjustment to the PTO damping coefficient. The trained policy tends to raise damping just before wave crests and troughs, when heave velocity is high, and lower it between, yielding larger heave velocities and lower downstream wave energy. Quantitatively, in the 2D regular-wave three-device array the policy raises total energy capture by 23.8% over the constant baseline, and in the 3D

Load-bearing premise

The comparison assumes the fixed PTO damping coefficient used as the baseline is the right reference: in 2D it is verified by a parameter sweep, but in 3D it is taken from earlier studies without checking that it is optimal for this geometry, water depth, and wave spectrum; if the 3D baseline is suboptimal, part of the reported 21.5% gain is an artifact of the baseline choice.

Editorial extensions

If this is right

  • If the central claim holds, constant-damping point-absorber arrays leave substantial energy on the table; coordinated adaptive damping is a practical way to increase array output without changing device geometry.
  • The improvement grows with array size in the 2D regular-wave tests (9.2%, 18.9%, 23.8%), suggesting that cooperative policies become more valuable as hydrodynamic interactions between devices intensify.
  • In the 3D irregular-wave case, most of the gain comes from upstream devices, with the downstream device losing 4.0% of its individual energy; array-level reward shaping can intentionally redistribute absorption away from the last device.
  • Because the controller uses only each device's local observations at execution time, the trained policies can in principle be deployed on distributed hardware without a central communication channel.
  • The unified GPU-accelerated implementation makes the SPH-MADRL loop fast enough for three-dimensional training and could be extended to other real-time multi-body fluid-structure control problems.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The reported 21.5% gain in 3D may be sensitive to the choice of the constant-damping baseline; if the 3D baseline coefficient is not optimal for this exact geometry and spectrum, a re-optimized baseline would shrink the measured advantage. A fairer comparison would sweep constant damping in 3D, as was done in 2D.
  • The reward's global-sum weighting (γ_p = 0.7) is the likely driver of the downstream device's -4.0% individual result; an alternative per-device fairness term or a constraint on minimum individual energy might yield a different distribution of array output, possibly with higher total if unused downstream energy can be exploited.
  • The two-peak-per-wave-period damping pattern resembles phase-matched damping control; a direct comparison against latching or bang-bang damping in the same SPH environment could isolate how much of the gain comes from continuous adaptation versus simple phase alignment.
  • Because SPH resolves nonlinear and viscous effects, a plausible next test is to train under larger wave heights or broader spectra to see whether the learned policy transfers to conditions beyond those in the training distribution.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. The paper presents a coupled SPH–MADRL framework for adaptive PTO damping control of point-absorber arrays. The SPH solver (an extended DualSPHysics+ code) is linked in a unified C++/CUDA environment to LibTorch, and MASAC with CTDE is used to train agents that output continuous PTO damping adjustments based on local wave-elevation and heave-kinematic observations. The SPH model is validated against experimental single-body heave data for three constant damping values and against theoretical wave generation. The RL framework is then applied to 1–3 point absorbers in 2D regular waves and to a 3-PA array in 3D irregular waves. Headline results are energy gains of 9.2% (one PA, 2D), 18.9% (two PAs), 23.8% (three PAs) in 2D regular waves, and 21.5% total in the 3D irregular-wave case, all relative to a constant-PTO-damping baseline.

Significance. If the quantitative claims hold, this is a useful contribution: it is, to my knowledge, the first fully integrated, GPU-accelerated 3D SPH–MADRL platform with two-way coupling, and it extends prior single-agent CFD-DRL work to cooperative multi-body array control. The SPH validation against Zang et al. (2018) at three damping values is reasonable, the 2D constant-damping baseline is at least established by a single-PA sweep, and the decision to train each configuration three times is good practice. The authors also honestly report the decrease in PA3 output in the 3D case and attribute it to the global reward design, which lends credibility. However, the headline percentages are only meaningful if the constant-damping baselines are representative, and the absence of any reported variability across the three training runs makes the quantitative claims impossible to assess statistically. The significance of the paper rests on the integration and the 3D demonstration, not on algorithmic novelty in either SPH or RL.

major comments (3)
  1. [§3.2, Table 4] The 3D irregular-wave baseline k0 = 400 Ns/m is 'adopted based on existing numerical studies' (Ropero-Giralda et al., 2020; Manawadu et al., 2024) without a sweep for the present geometry, water depth, flume width, or JONSWAP spectrum. Since the 21.5% headline gain is measured against this constant-damping reference, a suboptimal reference would inflate the reported improvement. Please add a 3D constant-kp sweep (at least for the single PA, ideally for the three-PA array) or provide quantitative evidence that 400 Ns/m is near-optimal for the present configuration, and temper the headline claim if the evidence is not available.
  2. [§3.2, Tables 3 and 4] The text states that each configuration is trained three independent times ('following a standard practice'), but the tables report only single-point energy values with no mean, standard deviation, or per-seed spread. The abstract's 23.8%/21.5% figures are therefore not accompanied by any measure of variability, despite the visibly shaded standard deviations in Figs. 7 and 14. Report E_DRL (and ideally E0 and the improvement percentage) as mean±std over the three seeds, state which seed is shown in the time-history figures, and indicate whether the improvements are stable relative to seed-to-seed variation.
  3. [§3.2, Fig. 6, Table 3] The 2D baseline k0 = 700 Ns/m is obtained from a single-PA parametric sweep, but it is then applied as a uniform constant damping to the two- and three-PA arrays. Hydrodynamic interactions (wave shadowing, radiation, re-reflection) can shift the optimal constant damping per device and per array; the non-monotonic per-PA gains in Table 3 (33.7%, 8.9%, 19.1%) suggest the baseline may be better matched for some devices than others. Please justify transferring the single-PA optimum to the array configurations, or run a coarse array-level sweep (uniform and per-PA constant k0) to confirm the baseline is representative.
minor comments (6)
  1. [Table A.6] The table labels the last row '3-D regular wave', but Section 3.2.2 describes the 3D case as irregular waves generated with a JONSWAP spectrum. Please correct the label (or clarify if a different 3D case is meant).
  2. [§3.2.2] The text says the comparison covers 'the total captured energy within 50 s', while the Table 4 caption says 'over a 40 s simulation' and Fig. 17 shows the interval 10–50 s. Unify the time interval statement.
  3. [§2.3] The control frequency is not specified: the text says actions are fed back to the SPH solver but does not state the interval between successive agent decisions, nor the meaning of 'between two consecutive training intervals' in the kp interpolation. State whether actions are taken every SPH step, every Δt, or every fixed number of steps.
  4. [§1 and §4] The introduction describes the platform as 'open-source', but the text only says the code 'will be released'. Please add a code/data availability statement with a repository link or a clear statement of availability; this matters for the reproducibility promise.
  5. [Throughout] Minor language issues: 'term β denotes' (p. 3), 'reward entropy maximisations' (p. 6), 'reproduces with accuracy' (p. 27), and 'by how the DRL-trained policy enhances ... in this 2-D cases' (p. 16). Please copyedit.
  6. [§3.2 §3.2.2] The relation to DRLinSPH (Ye et al., 2025a) should be clarified: if DRLinSPH already couples SPH and DRL in a single-agent 2D setting, the 'first' claim should be specifically about the multi-agent, 3D, unified-C++/CUDA integration, not about SPH–DRL coupling in general.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the DRL gains are measured training outcomes against a fixed damping baseline; the only concerns (3D baseline optimality) are correctness risks, not circular reductions.

full rationale

The energy-improvement claim is a measured outcome of RL training, not a fit renamed as a prediction. The reward (Eq. 34) sums absorbed power, the policy is trained with MASAC to maximize it, and the improvement is evaluated by comparing accumulated energy in Tables 3 and 4. The 2D baseline k0=700 Ns/m is found by an explicit parametric sweep (Section 3.2, Fig. 6) and then held fixed; this is a benchmark choice, and the learned policy's admissible range [0.1k0, 1.9k0] does not force the reported 23.8% gain. The 3D baseline k0=400 is adopted from prior numerical studies (Ropero-Giralda et al., 2020; Manawadu et al., 2024); if that value is not optimal for the present geometry/spectrum, part of the +21.5% gain could be an artifact of comparing against a weak baseline, but this is an experimental-design/correctness risk, not a circular reduction: no equation in the paper defines the output in terms of the fitted baseline. The self-citations (DualSPHysics+; Zhan et al., 2025; and Ropero-Giralda et al., 2020, which shares an author) supply the numerical solver and a baseline constant, respectively; the solver is independently validated against the experiments of Zang et al. (2018), and the baseline value is not used to prove the framework's core mechanism. No 'prediction' equals an input by construction.

Assumptions & free parameters 4 free parameters · 5 assumptions · 0 invented entities

The paper introduces no new physical entities. The free parameters are baseline damping values, reward weights, and action-range multipliers; the axioms are domain assumptions about SPH fidelity, PTO modeling, MARL convergence, episode reset, and 2D-to-3D transfer. The central results depend on these choices, and the 3D baseline in particular is not verified in situ.

free parameters (4)
  • k0 (constant PTO damping baseline, 2D) = 700 Ns/m
    Determined by parametric sweep of kp in [200,1800] Ns/m (§3.2, Fig. 6) and used as kbase and comparison baseline; the reported energy gain depends on this choice.
  • k0 (constant PTO damping baseline, 3D) = 400 Ns/m
    Adopted from Ropero-Giralda et al. (2020) and Manawadu et al. (2024) without an in-situ sweep; if not optimal for the presented 3D irregular-wave array, the baseline comparison is favorable to the learned controller.
  • Reward cooperation weight gamma_p = 0.7
    Set by hand in Eq. (34) to balance individual and collective reward; changes how much agents sacrifice local power for array total.
  • Action range multiplier Delta k_max / k_base = 0.9
    Chosen to allow exploration; constrains how far the adaptive damping can deviate from kbase in Eq. (32).
assumptions (5)
  • domain assumption deltaR-SPH with weakly compressible equation of state (beta=7) accurately captures nonlinear wave-structure interaction and PTO loads relevant to point absorber arrays.
    Used throughout §2.1; validated only for a single heaving cylinder under one regular wave condition (Fig. 4), not for multi-device irregular 3D arrays.
  • domain assumption Instantaneous absorbed power equals P_i = kp,i v_z,i^2 (Eqs. 33/35) and the linear damper F_t = -kp v (Eq. 13) represents a real PTO.
    This is the reward/objective and the controlled quantity; real PTOs have reactive, rate, and efficiency limits.
  • domain assumption CTDE multi-agent SAC with centralized critics conditioned on joint actions stabilizes learning and the learned decentralized policies cooperate in deployment.
    Standard MARL assumption; not proven for this fluid-structure setting.
  • domain assumption Resetting the SPH domain to the particle configuration at te at each episode reproduces identical incident waves and allows fair policy evaluation.
    Episode design in §3.2; depends on determinism of the SPH solver and wave maker.
  • domain assumption 2D narrow-flume results and periodic regular-wave policies carry over to 3D irregular ocean conditions.
    The paper's extrapolation from regular 2D validation to 3D irregular cases; not directly validated.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Coupling Smoothed Particle Hydrodynamics with Multi-Agent Deep Reinforcement Learning for Cooperative Control of Point Absorbers." pith.science (2026). https://pith.science/paper/EKRTTT2B

@misc{pith2026260106485,
  author       = {Pith},
  title        = {Pith review of: Coupling Smoothed Particle Hydrodynamics with Multi-Agent Deep Reinforcement Learning for Cooperative Control of Point Absorbers},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/EKRTTT2B}},
  note         = {Machine review of arXiv:2601.06485}
}
read the original abstract

Wave Energy Converters, particularly point absorbers, have emerged as one of the most promising technologies for harvesting ocean wave energy. Nevertheless, achieving high conversion efficiency remains challenging due to the inherently complex and nonlinear interactions between incident waves and device motion dynamics. This study develops an optimal adaptive damping control model for the power take-off (PTO) system by coupling Smoothed Particle Hydrodynamics (SPH) with multi-agent deep reinforcement learning. The proposed framework enables real-time communication between high-fidelity SPH simulations and intelligent control agents that learn coordinated policies to maximise energy capture. In each training episode, the SPH-based environment provides instantaneous hydrodynamic states to the agents, which output continuous damping actions and receive rewards reflecting power absorption. The Multi-Agent Soft Actor Critic algorithm is employed within a centralised-training and decentralised-execution scheme to ensure stable learning in continuous, multi-body systems. The entire platform is implemented in a unified GPU-accelerated C++ environment, allowing long-horizon training and large-scale three-dimensional simulations. The approach is validated through a series of two-dimensional and three-dimensional benchmark cases under regular and irregular wave conditions. Compared with constant PTO damping, the learned control policy increases overall energy capture by 23.8% and 21.5%, respectively, demonstrating the strong potential of intelligent control for improving the performance of wave energy converter arrays. The developed three-dimensional GPU-accelerated multi-agent platform in computational hydrodynamics, is extendable to other fluid-structure interaction engineering problem that require real-time, multi-body coordinated control.

Figures

Figures reproduced from arXiv: 2601.06485 by the authors.

Figure 1
Figure 1. Coupling workflow between the SPH solver and the MADRL model. [PITH_FULL_IMAGE:figures/full_fig_p010_1.png] view at source ↗
Figure 2
Figure 2. Numerical wave tank configuration and body dimensions. [PITH_FULL_IMAGE:figures/full_fig_p011_2.png] view at source ↗
Figure 3
Figure 3. Comparison between SPH simulations and theoretical solutions for wave generation: (a) free-surface [PITH_FULL_IMAGE:figures/full_fig_p012_3.png] view at source ↗
Figures from the paper (14 more)
Figure 4
Figure 4. Figure 4: Time histories of the simulated heave displacement and velocity of the point absorber together [PITH_FULL_IMAGE:figures/full_fig_p013_4.png]
Figure 5
Figure 5. Figure 5: Numerical wave tank setup and point absorber array layout. [PITH_FULL_IMAGE:figures/full_fig_p014_5.png]
Figure 6
Figure 6. Figure 6: Variation of average power output with respect to PTO coefficient for a PA under 2-D regular wave [PITH_FULL_IMAGE:figures/full_fig_p015_6.png]
Figure 7
Figure 7. Figure 7: Time history of the training rewards for the one-, two-, and three-PAs cases. [PITH_FULL_IMAGE:figures/full_fig_p017_7.png]
Figure 8
Figure 8. Figure 8: Time histories of the wave elevations at 0.05 m upstream ( [PITH_FULL_IMAGE:figures/full_fig_p018_8.png]
Figure 9
Figure 9. Figure 9: Snapshots of the fluid velocity field and the PA heave velocity at four typical time instants. [PITH_FULL_IMAGE:figures/full_fig_p019_9.png]
Figure 10
Figure 10. Figure 10: Time histories of the wave elevations at 0.05 m upstream ( [PITH_FULL_IMAGE:figures/full_fig_p020_10.png]
Figure 11
Figure 11. Figure 11: Time histories of the wave elevations at 0.05 m upstream ( [PITH_FULL_IMAGE:figures/full_fig_p021_11.png]
Figure 12
Figure 12. Figure 12: Snapshots of the wave-induced kinetic energy distribution around the two PAs at two representative [PITH_FULL_IMAGE:figures/full_fig_p022_12.png]
Figure 13
Figure 13. Figure 13: Snapshots of the wave-induced kinetic energy distribution around the three PAs at three repre [PITH_FULL_IMAGE:figures/full_fig_p023_13.png]
Figure 14
Figure 14. Figure 14: Time histories of the rewards for three PAs under 3-D irregular wave conditions. [PITH_FULL_IMAGE:figures/full_fig_p024_14.png]
Figure 15
Figure 15. Figure 15: Time histories of the wave elevations at 0.05 m upstream ( [PITH_FULL_IMAGE:figures/full_fig_p025_15.png]
Figure 16
Figure 16. Figure 16: Snapshots of the kinetic energy distribution around the three PAs at three representative time [PITH_FULL_IMAGE:figures/full_fig_p026_16.png]
Figure 17
Figure 17. Figure 17: Time histories of the accumulated energy for three PAs under 3-D irregular wave conditions. [PITH_FULL_IMAGE:figures/full_fig_p026_17.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

57 extracted references · 22 canonical work pages

  1. [1]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in ":" * " " * FUNCTION f...

  2. [2]

    , author Hu, X.Y

    author Adami, S. , author Hu, X.Y. , author Adams, N.A. , year 2012 . title A generalized wall boundary condition for smoothed particle hydrodynamics . journal Journal of Computational Physics volume 231 , pages 7057--7075 . :10.1016/j.jcp.2012.05.005

    work page doi:10.1016/j.jcp.2012.05.005 2012

  3. [3]

    , author Dom \'i nguez, J.M

    author Altomare, C. , author Dom \'i nguez, J.M. , author Crespo, A.J.C. , author Gonz \'a lez-Cao , J. , author Suzuki, T. , author G \'o mez-Gesteira , M. , author Troch, P. , year 2017 . title Long-crested wave generation and absorption for SPH-based DualSPHysics model . journal Coastal Engineering volume 127 , pages 37--54 . :10.1016/j.coastaleng.2017.06.004

    work page doi:10.1016/j.coastaleng.2017.06.004 2017

  4. [4]

    , year 2024

    author Amato, C. , year 2024 . title An Introduction to Centralized Training for Decentralized Execution in Cooperative Multi-Agent Reinforcement Learning . :10.48550/arXiv.2409.03052, http://arxiv.org/abs/2409.03052 arXiv:2409.03052

    arXiv doi:10.48550/arxiv.2409.03052 2024

  5. [5]

    , author Forehand, D.I.M

    author Anderlini, E. , author Forehand, D.I.M. , author Stansell, P. , author Xiao, Q. , author Abusara, M. , year 2016 . title Control of a Point Absorber Using Reinforcement Learning . journal IEEE Transactions on Sustainable Energy volume 7 , pages 1681--1690 . :10.1109/TSTE.2016.2568754

    arXiv 2016

  6. [6]

    , author Husain, S

    author Anderlini, E. , author Husain, S. , author Parker, G.G. , author Abusara, M. , author Thomas, G. , year 2020 . title Towards Real-Time Reinforcement Learning Control of a Wave Energy Converter . journal Journal of Marine Science and Engineering volume 8 , pages 845 . :10.3390/jmse8110845

    work page doi:10.3390/jmse8110845 2020

  7. [7]

    , author Colagrossi, A

    author Antuono, M. , author Colagrossi, A. , author Marrone, S. , author Molteni, D. , year 2010 . title Free-surface flows solved by means of SPH schemes with numerical diffusive terms . journal Computer Physics Communications volume 181 , pages 532--549 . :10.1016/j.cpc.2009.11.002

    work page doi:10.1016/j.cpc.2009.11.002 2010

  8. [8]

    , author Cl \'e ment, A.H

    author Babarit, A. , author Cl \'e ment, A.H. , year 2006 . title Optimal latching control of a wave energy device in regular and irregular waves . journal Applied Ocean Research volume 28 , pages 77--91 . :10.1016/j.apor.2006.05.002

    work page doi:10.1016/j.apor.2006.05.002 2006

Show all 57 references
  1. [9]

    , year 1995

    author Baird, L. , year 1995 . title Residual Algorithms : Reinforcement Learning with Function Approximation , in: booktitle Machine Learning Proceedings 1995 . publisher Elsevier , pp. pages 30--37 . :10.1016/B978-1-55860-377-6.50013-X

    1995 doi

  2. [10]

    , author Young, A.D

    author Batchelor, G.K. , author Young, A.D. , year 1968 . title An Introduction to Fluid Mechanics . journal Journal of Applied Mechanics volume 35 , pages 624 . :10.1115/1.3601282

    1968 doi

  3. [11]

    , author Wang, C

    author Bowes, B.D. , author Wang, C. , author Ercan, M.B. , author Culver, T.B. , author Beling, P.A. , author Goodall, J.L. , year 2022 . title Reinforcement learning-based real-time control of coastal urban stormwater systems to mitigate flooding and improve water quality . ...

    2022 doi

  4. [12]

    , author Babu s ka, R

    author Bu s oniu, L. , author Babu s ka, R. , author De Schutter, B. , year 2010 . title Multi-agent Reinforcement Learning : An Overview , in: editor Srinivasan, D. , editor Jain, L.C. (Eds.), booktitle Innovations in Multi-Agent Systems and Applications - 1 . publisher Sprin...

    2010 doi

  5. [13]

    , author Dom \'i nguez, J

    author Crespo, A. , author Dom \'i nguez, J. , author Rogers, B. , author G \'o mez-Gesteira , M. , author Longshaw, S. , author Canelas, R. , author Vacondio, R. , author Barreiro, A. , author Garc \'i a-Feal , O. , year 2015 . title DualSPHysics : Open-source parallel CFD so...

    2015 doi

  6. [14]

    , author Guan, W

    author Cui, Z. , author Guan, W. , author Zhang, X. , year 2025 . title Gated transformer-based proximal policy optimization for multiple marine autonomous surface ships collision avoidance decision-making strategy . journal Engineering Applications of Artificial Intelligence ...

    2025

  7. [15]

    , author Fourtakas, G

    author Dom \'i nguez, J.M. , author Fourtakas, G. , author Altomare, C. , author Canelas, R.B. , author Tafuni, A. , author Garc \'i a-Feal , O. , author Mart \'i nez-Est \'e vez , I. , author Mokos, A. , author Vacondio, R. , author Crespo, A.J.C. , author Rogers, B.D. , auth...

    2022 doi

  8. [16]

    , author Whitlam, C

    author Edwards, E.C. , author Whitlam, C. , author Chapman, J. , author Hughes, J. , author Redfearn, B. , author Brown, S. , author Draper, S. , author Borthwick, A.G.L. , author Foster, G. , author Yue, D.K.P. , author Hann, M. , author Greaves, D. , year 2025 . title The ef...

    2025 doi

  9. [17]

    , author Olaya, S

    author Faedo, N. , author Olaya, S. , author Ringwood, J.V. , year 2017 . title Optimal control, MPC and MPC-like algorithms for wave energy systems: An overview . journal IFAC Journal of Systems and Control volume 1 , pages 37--56 . :10.1016/j.ifacsc.2017.07.001

    2017 doi

  10. [18]

    , author Yang, L

    author Fan, D. , author Yang, L. , author Wang, Z. , author Triantafyllou, M.S. , author Karniadakis, G.E. , year 2020 . title Reinforcement learning for bluff body active flow control in experiments and simulations . journal Proceedings of the National Academy of Sciences vol...

    2020 doi

  11. [19]

    , author Dominguez, J.M

    author Fourtakas, G. , author Dominguez, J.M. , author Vacondio, R. , author Rogers, B.D. , year 2019 . title Local uniform stencil ( LUST ) boundary condition for arbitrary 3- D boundaries in parallel smoothed particle hydrodynamics ( SPH ) models . journal Computers & Fluids...

    2019 doi

  12. [20]

    , author Vacondio, R

    author Fourtakas, G. , author Vacondio, R. , author Rogers, B. , year 2025 . title Divergence cleaning for weakly compressible smoothed particle hydrodynamics . journal Computers & Fluids volume 295 , pages 106638 . :10.1016/j.compfluid.2025.106638

    2025

  13. [21]

    , author Zhou, A

    author Haarnoja, T. , author Zhou, A. , author Abbeel, P. , author Levine, S. , year 2018 . title Soft Actor-Critic : Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor , in: booktitle Proceedings of the 35th International Conference on Machine Lear...

    2018

  14. [22]

    , author Zhou, A

    author Haarnoja, T. , author Zhou, A. , author Hartikainen, K. , author Tucker, G. , author Ha, S. , author Tan, J. , author Kumar, V. , author Zhu, H. , author Gupta, A. , author Abbeel, P. , author Levine, S. , year 2019 . title Soft Actor-Critic Algorithms and Applications ...

    2019 doi arXiv

  15. [23]

    , author Asai, T

    author Haraguchi, R. , author Asai, T. , year 2020 . title Enhanced power absorption of a point absorber wave energy converter using a tuned inertial mass . journal Energy volume 202 , pages 117740 . :10.1016/j.energy.2020.117740

    2020

  16. [24]

    , author Dunckel, M

    author Hasselmann, D.E. , author Dunckel, M. , author Ewing, J.A. , year 1980 . title Directional Wave Spectra Observed during JONSWAP 1973 . journal Journal of Physical Oceanography volume 10 , pages 1264--1280 . :10.1175/1520-0485(1980)010<1264:DWSODJ>2.0.CO;2

    1980 doi

  17. [25]

    , author Luan, Z

    author He, G. , author Luan, Z. , author Zhang, W. , author He, R. , author Liu, C. , author Yang, K. , author Yang, C. , author Jing, P. , author Zhang, Z. , year 2023 . title Review on research approaches for multi-point absorber wave energy converters . journal Renewable En...

    2023

  18. [26]

    , author Gato, L.M.C

    author Henriques, J.C.C. , author Gato, L.M.C. , author Falc \ a o, A.F.O. , author Robles, E. , author Fa \"y , F.X. , year 2016 . title Latching control of a floating oscillating-water-column wave energy converter . journal Renewable Energy volume 90 , pages 229--241 . :10.1...

    2016 doi

  19. [27]

    , author Xu, H

    author Jia, W. , author Xu, H. , year 2025 . title Strategies for energy-efficient flow control leveraging deep reinforcement learning . journal Engineering Applications of Artificial Intelligence volume 156 , pages 111125 . :10.1016/j.engappai.2025.111125

    2025

  20. [28]

    , author Shimizu, Y

    author Khayyer, A. , author Shimizu, Y. , author Gotoh, T. , author Gotoh, H. , year 2023 . title Enhanced resolution of the continuity equation in explicit weakly compressible SPH simulations of incompressible free-surface fluid flows . journal Applied Mathematical Modelling ...

    2023 doi

  21. [29]

    , author Di Maio, L.F

    author Kolios, A. , author Di Maio, L.F. , author Wang, L. , author Cui, L. , author Sheng, Q. , year 2018 . title Reliability assessment of point-absorber wave energy converters . journal Ocean Engineering volume 163 , pages 40--50 . :10.1016/j.oceaneng.2018.05.048

    2018 doi

  22. [30]

    , author Meghjani, M

    author Kouzehgar, M. , author Meghjani, M. , author Bouffanais, R. , year 2020 . title Multi- Agent Reinforcement Learning for Dynamic Ocean Monitoring by a Swarm of Buoys , in: booktitle Global Oceans 2020: Singapore -- U . S . Gulf Coast , pp. pages 1--8 . :10.1109/IEEECONF3...

    2020

  23. [31]

    , author Reich, S

    author Leimkuhler, B.J. , author Reich, S. , author Skeel, R.D. , year 1996 . title Integration Methods for Molecular Dynamics , in: editor Friedman, A. , editor Gulliver, R. , editor Mesirov, J.P. , editor Schulten, K. , editor Sumners, D.W. (Eds.), booktitle Mathematical App...

    1996 doi

  24. [32]

    , author Qin, H

    author Liang, H. , author Qin, H. , author Su, H. , author Wen, Z. , author Mu, L. , year 2024 . title Environmental- Sensing and adaptive optimization of wave energy converter based on deep reinforcement learning and computational fluid dynamics . journal Energy volume 297 , ...

    2024

  25. [33]

    , author Wu, Y

    author Lowe, R. , author Wu, Y. , author Tamar, A. , author Harb, J. , author Abbeel, P. , author Mordatch, I. , year 2017 . title Multi- Agent Actor-Critic for Mixed Cooperative-Competitive Environments . journal Advances in neural information processing systems volume 30 . :...

    2017 doi arXiv

  26. [34]

    , author Nissanka, I

    author Manawadu, N. , author Nissanka, I. , author Karunasena, H. , year 2024 . title SPH-based numerical modelling and performance analysis of a heaving point absorber type wave energy converter with a novel buoy geometry . journal Renewable Energy volume 228 , pages 120595 ....

    2024

  27. [35]

    , author Guy, A

    author Mania, H. , author Guy, A. , author Recht, B. , year 2018 . title Simple random search of static linear policies is competitive for reinforcement learning . journal Advances in neural information processing systems volume 31

    2018

  28. [36]

    , author Tagliafierro, B

    author Mart \'i nez-Est \'e vez , I. , author Tagliafierro, B. , author El Rahi, J. , author Dom \'i nguez, J. , author Crespo, A. , author Troch, P. , author G \'o mez-Gesteira , M. , year 2023 . title Coupling an SPH-based solver with an FEA structural solver to simulate fre...

    2023

  29. [37]

    , author Gross, S

    author Paszke, A. , author Gross, S. , author Massa, F. , author Lerer, A. , author Bradbury, J. , author Chanan, G. , author Killeen, T. , author Lin, Z. , author Gimelshein, N. , author Antiga, L. , author Desmaison, A. , author Kopf, A. , author Yang, E. , author DeVito, Z....

    2019

  30. [38]

    , author Benassai, G

    author Piscopo, V. , author Benassai, G. , author Cozzolino, L. , author Della Morte, R. , author Scamardella, A. , year 2016 . title A new optimization procedure of heaving point absorber hydrodynamic performances . journal Ocean Engineering volume 116 , pages 242--259 . :10....

    2016 doi

  31. [39]

    , author Su, H

    author Qin, H. , author Su, H. , author Wen, Z. , author Liang, H. , year 2025 . title Latching control of a point absorber wave energy converter in irregular wave environments coupling computational fluid dynamics and deep reinforcement learning . journal Applied Energy volum...

    2025

  32. [40]

    , author Crespo, A.J.C

    author Ropero-Giralda , P. , author Crespo, A.J.C. , author Tagliafierro, B. , author Altomare, C. , author Dom \'i nguez, J.M. , author G \'o mez-Gesteira , M. , author Viccione, G. , year 2020 . title Efficiency and survivability analysis of a point-absorber wave energy conv...

    2020 doi

  33. [41]

    , author Gundecha, V

    author Sarkar, S. , author Gundecha, V. , author Shmakov, A. , author Ghorbanpour, S. , author Babu, A.R. , author Faraboschi, P. , author Cocho, M. , author Pichard, A. , author Fievez, J. , year 2022 . title Multi- Agent Reinforcement Learning Controller to Maximize Energy E...

    2022 doi

  34. [42]

    , author Yeung, R.W

    author Son, D. , author Yeung, R.W. , year 2017 . title Optimizing ocean-wave energy extraction of a dual coaxial-cylinder WEC using nonlinear model predictive control . journal Applied Energy volume 187 , pages 746--757 . :10.1016/j.apenergy.2016.11.068

    2017 doi

  35. [43]

    , author Barto, A

    author Sutton, R.S. , author Barto, A. , year 2014 . title Reinforcement Learning: An Introduction . Adaptive Computation and Machine Learning. edition nachdruck ed., publisher The MIT Press , address Cambridge, Massachusetts

    2014

  36. [44]

    , author Price, D.J

    author Tricco, T.S. , author Price, D.J. , author Bate, M.R. , year 2016 . title Constrained hyperbolic divergence cleaning in smoothed particle magnetohydrodynamics with variable cleaning speeds . journal Journal of Computational Physics volume 322 , pages 326--344 . :10.1016...

    2016 doi

  37. [45]

    , author Wijaya, V

    author Wang, H. , author Wijaya, V. , author Zeng, T. , author Zhang, Y. , year 2024 . title Deep reinforcement learning-based non-causal control for wave energy conversion . journal Ocean Engineering volume 311 , pages 118860 . :10.1016/j.oceaneng.2024.118860

    2024

  38. [46]

    , year 1995

    author Wendland, H. , year 1995 . title Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree . journal Advances in Computational Mathematics volume 4 , pages 389--396 . :10.1007/BF02123482

    1995 doi

  39. [47]

    , author Zhao, X

    author Xie, Y. , author Zhao, X. , year 2021 . title Sloshing suppression with active controlled baffles through deep reinforcement learning--expert demonstrations--behavior cloning process . journal Physics of Fluids volume 33 , pages 017115 . :10.1063/5.0037334

    2021 doi

  40. [48]

    , author Zhao, X

    author Xie, Y. , author Zhao, X. , author Liu, Z. , year 2023 . title A simple approach for wave absorbing control of plunger wavemakers using machine learning: Numerical study . journal Coastal Engineering volume 179 , pages 104253 . :10.1016/j.coastaleng.2022.104253

    2023

  41. [49]

    , author Wang, S

    author Xue, B. , author Wang, S. , author Peng, Y. , author Zhang, A. , year 2022 . title A novel coupled Riemann SPH -- RKPM model for the simulation of weakly compressible fluid--structure interaction problems . journal Ocean Engineering volume 266 , pages 112447 . :10.1016/...

    2022

  42. [50]

    , author Ma, H

    author Ye, M. , author Ma, H. , author Ren, Y. , author Zhang, C. , author Haidn, O.J. , author Hu, X. , year 2025 a. title DRLinSPH : An open-source platform using deep reinforcement learning and SPHinXsys for fluid-structure-interaction problems . journal Engineering Applica...

    2025

  43. [51]

    , author Zhang, C

    author Ye, M. , author Zhang, C. , author Ren, Y. , author Liu, Z. , author Haidn, O.J. , author Hu, X. , year 2025 b. title Adaptive optimization of wave energy conversion in oscillatory wave surge converters via SPH simulation and deep reinforcement learning . journal Renewa...

    2025

  44. [52]

    , author Zhang, Q

    author Zang, Z. , author Zhang, Q. , author Qi, Y. , author Fu, X. , year 2018 . title Hydrodynamic responses and efficiency analyses of a heaving-buoy wave energy converter with PTO damping in regular and irregular waves . journal Renewable Energy volume 116 , pages 527--542 ...

    2018 doi

  45. [53]

    , author Ringwood, J.V

    author Zhan, S. , author Ringwood, J.V. , year 2024 . title Model- Free Linear Noncausal Optimal Control of Wave Energy Converters via Reinforcement Learning . journal IEEE Transactions on Control Systems Technology volume 32 , pages 2164--2177 . :10.1109/TCST.2024.3401863

    2024

  46. [54]

    , author Luo, M

    author Zhan, Y. , author Luo, M. , author Khayyer, A. , year 2025 . title DualSPHysics +: An enhanced DualSPHysics with improvements in accuracy, energy conservation and resolution of the continuity equation . journal Computer Physics Communications volume 306 , pages 109389 ....

    2025

  47. [55]

    , author Hu, X

    author Zhang, C. , author Hu, X. , author Adams, N. , year 2017 . title A weakly compressible SPH method based on a low-dissipation Riemann solver . journal Journal of Computational Physics volume 335 , pages 605--620 . :10.1016/j.jcp.2017.01.027

    2017 doi

  48. [56]

    , author Xu, Y

    author Zhang, K. , author Xu, Y. , author Zhao, M. , author Jiang, Y. , year 2025 . title Sample-efficient planning-control framework for autonomous underwater vehicle docking using lightweight Cross Q-Learning . journal Engineering Applications of Artificial Intelligence volu...

    2025

  49. [57]

    , author Zhou, X

    author Zou, S. , author Zhou, X. , author Khan, I. , author Weaver, W.W. , author Rahman, S. , year 2022 . title Optimization of the electricity generation of a wave energy converter using deep reinforcement learning . journal Ocean Engineering volume 244 , pages 110363 . :10....

    2022

Pith tools

Reviewed August 3, 2026 · model on record in the stance chip above.