REVIEW 4 major objections 5 minor 69 references
Equivariant Action Sampling for Reinforcement Learning and Planning
T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read The paper shows that expanding each sampled action into its group orbit makes sampling-based action selection exactly equivariant for any finite sample count, and that an equivariant model-based planner built on this operation learns…
desk verdict G-augmented sampling is a clean, correct mechanism for exact finite-sample equivariance, but the paper overclaims on 'always better' and leaves the finite-subgroup implementation gap unquantified. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the $G$-augmented sample set (the $G$-sample): for each drawn action $a$, the sampler also evaluates every transformed action $g\cdot a$ with $g$ in the symmetry group $G$, so the candidate set is $GA = \{g\cdot a_i : i=1,\dots,N,\ g\in G\}$. Because the scoring function $E(s,a)$ is $G$-invariant, evaluating $\arg\min$ over this orbit-expanded set makes the selection commute with the group action; a rotated state picks the rotated winner. Around this, the paper assembles a geometric MDP formalism: transition dynamics must be $G$-equivariant, reward and value functions $G$-invariant, the policy $G$-equivariant, and the MPPI return functional $G$-invariant, which together make the whole planning procedure equivariant. The other mechanism is the weak/strong equivariance distinction, which diagnoses why finite-sample averages fail and what operation restores the symmetry exactly.
What would settle it
Take a task with $SO(2)$ or $O(2)$ symmetry, implement $G$-augmented sampling with $D_8$ as in the paper, and measure equivariance error for state rotations by angles that are not multiples of $45^\circ$ (e.g., $15^\circ$) using a small fixed sample count; if the selected action fails to rotate by that angle, or the equivariance error jumps above machine precision, the exact-equivariance claim holds only for the discrete subgroup, not for the task's true continuous symmetry.
Extended reading notes
Core claim
The central claim is that the stochasticity of sampling, not the learned model, is what breaks symmetry in sampling-based control, and that this can be repaired exactly. The paper defines weak equivariance (holding only after averaging over samples) versus strong equivariance (holding for every finite sample set), and shows that a weakly equivariant estimator can be converted into a strongly equivariant one by symmetrization. Concretely, for action selection $a_0 = \arg\min_{a\in A} E(s,a)$, replacing the sample set $A$ with the $G$-augmented set $GA = \{g\cdot a : a\in A,\ g\in G\}$ makes the map $s\mapsto a_0$ $G$-equivariant whenever $E$ is $G$-invariant: rotating the state rotates the selected action, for any sample budget. The paper extends this to trajectory planning by requiring $G$-equivariant dynamics, $G$-invariant reward and value networks, a $G$-equivariant policy, and $G$-augmented sampling inside MPPI; Proposition 1 states that the return is $G$-invariant and the $G$-sample procedure is $G$-equivariant. Empirically, an equivariant TD-MPC built from these ingredients matches or beats the non-equivariant TD-MPC and reaches near-optimal reward 2 to 3 times faster (in interaction steps) on PointMass, Reacher, 3D PointMass variants, and MetaWorld Reach. A further claim, proved in the appendix, is that a symmetrized policy or estimator is never worse, in $G$-averaged error, than the unsymmetrized one.
Load-bearing premise
The load-bearing premise is the paper's own stated choice (Section 6.1) to replace each task's true continuous symmetry group with a finite discrete subgroup ($D_4$, $D_8$, $C_8$, icosahedral, or octahedral); the exact equivariance guarantee and the empirical gains are proven only for those discrete group elements, and the derivations in Sections 4.4 and 5.3 assume the full group $G$ with no error bound for the discretization.
Editorial extensions
If this is right
- With a $G$-invariant score, $G$-augmented sampling gives exact equivariance for any finite sample count, including a single sample, so the usual infinite-sample asymptotic is not needed.
- An equivariant TD-MPC instantiated with discrete subgroups ($D_4$, $D_8$, $C_8$, icosahedral, octahedral) learns near-optimal goal-reaching policies 2 to 3 times faster in interaction steps than non-equivariant TD-MPC on the tested tasks.
- In coordinate regression, combining a $G$-invariant energy with $G$-augmented sampling enables spatial extrapolation beyond the training region's convex hull, where the non-equivariant baseline fails.
- The symmetrized estimator is provably no worse than the raw estimator in $G$-averaged error, so enforcing symmetry in the sampler does not sacrifice expected accuracy.
- Larger discrete subgroups (e.g., $D_{16}$ vs. $D_8$) plateau in performance while increasing cost, suggesting the chosen subgroups already capture the task-relevant symmetry.
Reading between the lines
- The $G$-augmentation recipe is generic: any sampling-based optimizer that scores candidates by an invariant function can be made strongly equivariant by orbit expansion, so the result should transfer to planners beyond the TD-MPC instantiation the paper tests.
- A direct test of the finite-subgroup assumption would measure equivariance error for rotations not in the implemented subgroup (e.g., $15^\circ$ for $D_8$); the paper's guarantees only cover the discrete group elements, so intermediate angles may reveal how much the surrogate matters.
- Because symmetrization multiplies the candidate set by $|G|$, the computational cost grows with group size; on large-symmetry problems one might trade exactness for cost by subsampling the orbit, a trade-off the paper does not analyze.
- The paper's own ablation shows that on kinematically constrained tasks with global reference frames, equivariance can hurt; the practical benefit likely depends on representing features in the right local frame rather than on equivariance alone.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes G-augmented sampling for sampling-based action selection in reinforcement learning and planning. Instead of evaluating only N sampled actions, the method evaluates all group transforms of each sample, i.e., the orbit set GA = {g·a_i}, and then selects the best action from this orbit. The authors show that, for an invariant energy/return function E, this selection rule is exactly G-equivariant for any finite number of samples, provided the argmin is unique or ties are handled equivariantly. They apply the idea to an energy-based coordinate regression task and to an equivariant version of TD-MPC with MPPI planning on several continuous control tasks, reporting that the equivariant version reaches near-optimal performance 2 to 3 times faster in training interactions. The appendix contains proofs of equivariance of the Bellman operator for geometric MDPs, a 'symmetrized policy is always better' argument, and additional ablations.
Significance. The core algebraic observation is elegant and useful: for a fixed finite sample set, enlarging it to the full group orbit makes the argmin-based selection equivariant by construction, with no dependence on the number of samples. If the remaining gaps are closed, the paper would provide a practical recipe for adding symmetry to sampling-based planners such as CEM and MPPI, and the benchmark suite is relevant to the RL and robotics communities. The paper is also honest in reporting ablations on the equivariant components, the choice of finite subgroups, and the warm-up sensitivity. However, the theoretical claims currently outrun the proofs in three load-bearing places: the finite-subgroup implementation, the 'always better' statement, and the treatment of randomness in the sampling procedure.
major comments (4)
- [Section 6.1, Proposition 1 (Section 5.3), Eq. (5)] The theory is developed for the full symmetry group G (O(2), SO(2), SO(3)), but Section 6.1 states that all equivariant MLPs are implemented with finite subgroups H in {D4, D8, C8, icosahedral, octahedral}. For any h in G\H, the networks are not exactly equivariant and the orbit set HA is not closed under h, so Eq. (5) and Proposition 1 do not hold for h. The paper provides no bound on the equivariance error as a function of how densely H approximates G, the Lipschitz constant of E, or the sample count. Please either prove an approximation guarantee or explicitly restate the theoretical results as H-equivariance rather than G-equivariance.
- [Section 4.3, Appendices D.1 and D.2] The claim in Section 4.3 that the strongly equivariant estimator 'is guaranteed to be a better estimator' and the title of Appendix D.2, 'Equivariant Sampling Is Always Better', are stronger than what the proofs establish. Appendix D.1 proves only the group-averaged inequality ∫_G |H(gx)−Ĥ^G(gx)|dg ≤ ∫_G |H(gx)−Ĥ(gx)|dg, and Appendix D.2 similarly shows that the symmetrized policy is closer on average over group orbits. These results do not imply pointwise improvement for each input x. The main text should either qualify the claim as an improvement in the group-averaged sense or state and prove additional assumptions that yield pointwise dominance.
- [Eq. (5), Section 5.3, Appendix E] The proof of Eq. (5) fixes the sample set GA and shows that g·argmin_{a∈GA} E(s,a) equals argmin_{a∈GA} E(g·s,a). In the actual CEM and MPPI procedures described in Sections 4.4 and 5.3, however, the base samples are drawn anew for each state. For a transformed state g·s, the new sample set is only equidistributed with the transformed old set g·GA, not equal to it, so one does not obtain g·a0(s) = a0(g·s) on individual runs unless the random noise itself is transformed as part of an explicitly coupled equivariant map. Please specify the stochastic inputs of the algorithm and prove the exact property that holds; if only distributional (weak) equivariance is achieved, the claim that the procedure 'always preserves equivariance' should be weakened accordingly.
- [Eq. (5), Appendix E] The equivariance identity for argmin also assumes a unique minimizer or an equivariant tie-breaking rule. With multiple minimizers, g·argmin and argmin after transformation may select different elements unless tie-breaking is chosen compatibly with the group action. This assumption should be stated explicitly in Proposition 1 and reflected in the algorithm description, since ties are not impossible with finite sample sets and learned energy functions.
minor comments (5)
- [Section 1] There is a typo in 'reinforcment learning' in the sentence about equivariant reinforcement learning methods; it should be 'reinforcement learning'.
- [Appendix D.3, Eq. (16)-(21)] In step (3) of the Bellman-operator proof, after substituting a = g^{-1}ā, the transition probability still contains g^{-1}a instead of g^{-1}ā; this appears to be a typographical error in an otherwise valid proof sketch.
- [Appendix F.2] The paragraph describing the 'sqrt strategy' and 'linear strategy' is garbled: the sentence 'We use two strategies: sqrt strategy ... we use linear strategy ...' is incomplete and the two strategies are described in an overlapping way. Please rewrite this passage for clarity.
- [Section 6.2, Figure 6] The claim that equivariant methods achieve near-optimal performance '2 to 3 times faster' is not supported by all panels; for example, the PointMass 2D panel shows only a modest advantage for D8-equivariant TD-MPC. Please quantify the speedup across tasks with confidence intervals or specify which panels support the 2-3x statement.
- [Bibliography] Several bibliographic entries contain typos or incomplete metadata, e.g., 'Markov Deision Proesses', 'reinforcment', and the Domshlak entry lacking a year/venue. These should be corrected before publication.
Circularity Check
No significant circularity: the central equivariance statements are derived from explicit symmetry assumptions and validated against external benchmarks; the finite-subgroup implementation is an approximation gap, not a circular argument.
full rationale
The paper's theoretical chain is self-contained. The equivariance of G-augmented sampling (Eq. 5 and Proposition 1) follows directly from the stated assumptions that the energy/Q function is G-invariant and the augmented sample set GA is G-invariant; the proof in Appendix E supplies the algebraic reduction. The 'always better' lemma in Appendix D.2 is a triangle-inequality consequence of the G-averaged policy definition under the cited equivariant-optimal-policy result from van der Pol et al., which is external and not authored by the present authors. Theorem 1 on the equivariant Bellman operator is proved in Appendix D.3 using the GMDP symmetry equations and Haar invariance; the cited prior work by Zhao et al. is contextual, not load-bearing. Empirical claims are made against non-equivariant TD-MPC and naive sampling baselines on standard benchmarks, so no fitted parameter is renamed as a prediction. The main caveat—use of finite subgroups (D4, D8, C8, icosahedral, octahedral) to implement continuous symmetries (Section 6.1)—means the implemented method is exactly H-equivariant rather than exactly G-equivariant, and no error bound is given. That is a correctness/robustness limitation, not circularity, because the implemented algorithm's behavior is not forced by a self-citation or by a parameter fitted to the target result.
Assumptions & free parameters
free parameters (3)
- Symmetry group choice (D4, D8, C8, icosahedral, octahedral) =
D8 for 2D tasks, icosahedral for 3D tasks (from ablation in App F.3)
- Hidden dimension scaling (sqrt strategy) =
hidden units divided by sqrt(|G|)
- Warmup seed_steps =
1 (no warmup) in the main curves
assumptions (5)
- domain assumption The MDP is a Geometric MDP: transition is G-equivariant and reward is G-invariant (Equations 1 and 2).
- domain assumption The optimal policy satisfies pi*(g·a | g·s) = pi*(a | s), taken from van der Pol et al. 2020b.
- standard math Haar measure on the compact group G is invariant, and the measure on state/action spaces satisfies d(gs) = ds for g in E(d).
- ad hoc to paper The learned networks (dynamics, reward, value, policy) are exactly G-equivariant or G-invariant as implemented with the escnn package for the chosen finite subgroup.
- ad hoc to paper The energy or return function has a unique argmin/argmax, or ties are broken consistently across group transforms.
Cite this review
Pith. "Pith review of Equivariant Action Sampling for Reinforcement Learning and Planning." pith.science (2026). https://pith.science/paper/TDG7D3E2
@misc{pith2026241212237,
author = {Pith},
title = {Pith review of: Equivariant Action Sampling for Reinforcement Learning and Planning},
year = {2026},
howpublished = {\url{https://pith.science/paper/TDG7D3E2}},
note = {Machine review of arXiv:2412.12237}
}
read the original abstract
Reinforcement learning (RL) algorithms for continuous control tasks require accurate sampling-based action selection. Many tasks, such as robotic manipulation, contain inherent problem symmetries. However, correctly incorporating symmetry into sampling-based approaches remains a challenge. This work addresses the challenge of preserving symmetry in sampling-based planning and control, a key component for enhancing decision-making efficiency in RL. We introduce an action sampling approach that enforces the desired symmetry. We apply our proposed method to a coordinate regression problem and show that the symmetry aware sampling method drastically outperforms the naive sampling approach. We furthermore develop a general framework for sampling-based model-based planning with Model Predictive Path Integral (MPPI). We compare our MPPI approach with standard sampling methods on several continuous control tasks. Empirical demonstrations across multiple continuous control environments validate the effectiveness of our approach, showcasing the importance of symmetry preservation in sampling-based action selection.
Figures
Figures from the paper (9 more)
Reference graph
Works this paper leans on
-
[1]
An algebraic approach to abstraction in reinforcement learning
Balaraman Ravindran and Andrew G Barto. An algebraic approach to abstraction in reinforcement learning. PhD thesis, University of Massachusetts at Amherst, 2004
work page 2004
-
[2]
Symmetry in Markov decision processes and its implications for single agent and multi agent learning
Martin Zinkevich and Tucker Balch. Symmetry in Markov decision processes and its implications for single agent and multi agent learning. In In Proceedings of the 18th International Conference on Machine Learning , pages 632--640. Morgan Kaufmann, 2001
work page 2001
-
[3]
Mdp homomorphic networks: Group symmetries in reinforcement learning
Elise van der Pol, Daniel Worrall, Herke van Hoof, Frans Oliehoek, and Max Welling. Mdp homomorphic networks: Group symmetries in reinforcement learning. Advances in Neural Information Processing Systems, 33, 2020 a
work page 2020
-
[4]
Group Equivariant Deep Reinforcement Learning
Arnab Kumar Mondal, Pratheeksha Nair, and Kaleem Siddiqi. Group Equivariant Deep Reinforcement Learning . arXiv:2007.03437 [cs, stat], June 2020. URL http://arxiv.org/abs/2007.03437. arXiv: 2007.03437
arXiv 2007
-
[5]
\ mathrm\ SO \ (2)\ - Equivariant Reinforcement Learning
Dian Wang, Robin Walters, and Robert Platt. \ mathrm\ SO \ (2)\ - Equivariant Reinforcement Learning . September 2021. URL https://openreview.net/forum?id=7F9cOhdvfk_
work page 2021
-
[6]
Linfeng Zhao, Xupeng Zhu, Lingzhi Kong, Robin Walters, and Lawson L. S. Wong. Integrating Symmetry into Differentiable Planning . In ICLR 2023 . ICLR, June 2022 a . doi:10.48550/arXiv.2206.03674. URL http://arxiv.org/abs/2206.03674. arXiv:2206.03674 [cs] type: article
-
[7]
Worrall, Herke van Hoof, Frans A
Elise van der Pol, Daniel E. Worrall, Herke van Hoof, Frans A. Oliehoek, and Max Welling. MDP Homomorphic Networks : Group Symmetries in Reinforcement Learning . arXiv:2006.16908 [cs, stat], June 2020 b . URL http://arxiv.org/abs/2006.16908. arXiv: 2006.16908
arXiv 2006
-
[8]
Rehg, Byron Boots, and Evangelos A
Grady Williams, Nolan Wagener, Brian Goldfain, Paul Drews, James M. Rehg, Byron Boots, and Evangelos A. Theodorou. Information theoretic MPC for model-based reinforcement learning. In 2017 IEEE International Conference on Robotics and Automation ( ICRA ) , pages 1714--1721, Singapore, May 2017 a . IEEE. ISBN 978-1-5090-4633-1. doi:10/ggdv8n. URL https://i...
Show all 69 references
-
[9]
Temporal Difference Learning for Model Predictive Control
Nicklas Hansen, Xiaolong Wang, and Hao Su. Temporal Difference Learning for Model Predictive Control . Technical Report arXiv:2203.04955, arXiv, March 2022. URL http://arxiv.org/abs/2203.04955. arXiv:2203.04955 [cs] type: article
2022 arXiv
-
[10]
Balaraman Ravindran and Andrew G. Barto. Symmetries and Model Minimization in Markov Deision Proesses
-
[11]
Fourier transporter: Bi-equivariant robotic manipulation in 3d, 2024
Haojie Huang, Owen Howell, Dian Wang, Xupeng Zhu, Robin Walters, and Robert Platt. Fourier transporter: Bi-equivariant robotic manipulation in 3d, 2024. URL https://arxiv.org/abs/2401.12046
2024 arXiv
-
[12]
On-robot learning with equivariant models, 2022
Dian Wang, Mingxi Jia, Xupeng Zhu, Robin Walters, and Robert Platt. On-robot learning with equivariant models, 2022. URL https://arxiv.org/abs/2203.04923
2022 arXiv
-
[13]
Clara De Paolis Kaluza, Linfeng Zhao, Lawson Wong, and Rose Yu
Fan Xie, Alexander Chowdhury, M. Clara De Paolis Kaluza, Linfeng Zhao, Lawson Wong, and Rose Yu. Deep imitation learning for bimanual robotic manipulation. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Sys...
2020
-
[14]
Open-vocabulary pick and place via patch-level semantic maps
Mingxi Jia, Haojie Huang, Zhewen Zhang, Chenghao Wang, Linfeng Zhao, Dian Wang, Jason Xinyu Liu, Robin Walters, Robert Platt, and Stefanie Tellex. Open-vocabulary pick and place via patch-level semantic maps. 2024. URL https://openreview.net/forum?id=cY3jXubzpR&referrer=
2024
-
[15]
Sample efficient modeling of drag coefficients for satellites with symmetry
Neel Sortur, Linfeng Zhao, and Robin Walters. Sample efficient modeling of drag coefficients for satellites with symmetry. In NeurIPS 2023 Workshop on Symmetry and Geometry in Neural Representations, 2023. URL https://openreview.net/forum?id=u7r2160QiP
2023
-
[16]
Linfeng Zhao, Owen Howell, Jung Yeon Park, Xupeng Zhu, Robin Walters, and Lawson L. S. Wong. Can euclidean symmetry be leveraged in reinforcement learning and planning? arXiv preprint arXiv: 2307.08226, 2023 a
2023 arXiv
-
[17]
Learning Symmetric Embeddings for Equivariant World Models
Jung Yeon Park, Ondrej Biza, Linfeng Zhao, Jan Willem van de Meent, and Robin Walters. Learning Symmetric Embeddings for Equivariant World Models . arXiv:2204.11371 [cs], April 2022. URL http://arxiv.org/abs/2204.11371. arXiv: 2204.11371
2022 arXiv
-
[18]
Bronstein, Joan Bruna, Taco Cohen, and Petar Veličković
Michael M. Bronstein, Joan Bruna, Taco Cohen, and Petar Veličković. Geometric Deep Learning : Grids , Groups , Graphs , Geodesics , and Gauges . arXiv:2104.13478 [cs, stat], April 2021. URL http://arxiv.org/abs/2104.13478. arXiv: 2104.13478
2021 arXiv
-
[20]
Du, Ken-ichi Kawarabayashi, and Stefanie Jegelka
Keyulu Xu, Jingling Li, Mozhi Zhang, Simon S. Du, Ken-ichi Kawarabayashi, and Stefanie Jegelka. What Can Neural Networks Reason About ? May 2019. URL https://arxiv.org/abs/1905.13211v4
2019 arXiv
-
[21]
Graph Neural Networks are Dynamic Programmers
Andrew Dudzik and Petar Veličković. Graph Neural Networks are Dynamic Programmers . arXiv:2203.15544 [cs, math, stat], March 2022. URL http://arxiv.org/abs/2203.15544. arXiv: 2203.15544
2022 arXiv
-
[22]
A Wigner - Eckart Theorem for Group Equivariant Convolution Kernels
Leon Lang and Maurice Weiler. A Wigner - Eckart Theorem for Group Equivariant Convolution Kernels . September 2020. URL https://openreview.net/forum?id=ajOrOhQOsYx
2020
-
[23]
General \ E (2)\ - Equivariant Steerable CNNs
Maurice Weiler and Gabriele Cesa. General \ E (2)\ - Equivariant Steerable CNNs . arXiv:1911.08251 [cs, eess], April 2021. URL http://arxiv.org/abs/1911.08251. arXiv: 1911.08251
1911 arXiv
-
[24]
Cohen and Max Welling
Taco S. Cohen and Max Welling. Group Equivariant Convolutional Networks . arXiv:1602.07576 [cs, stat], June 2016 a . URL http://arxiv.org/abs/1602.07576. arXiv: 1602.07576
2016 arXiv
-
[25]
Cohen and Max Welling
Taco S. Cohen and Max Welling. Steerable CNNs . November 2016 b . URL https://openreview.net/forum?id=rJQKYt5ll
2016
-
[26]
Bekkers, and Max Welling
Johannes Brandstetter, Rob Hesselink, Elise van der Pol, Erik J. Bekkers, and Max Welling. Geometric and Physical Quantities Improve E (3) Equivariant Message Passing . arXiv:2110.02905 [cs, stat], March 2022. URL http://arxiv.org/abs/2110.02905. arXiv: 2110.02905
2022 arXiv
-
[27]
E(n) Equivariant Graph Neural Networks
Victor Garcia Satorras, Emiel Hoogeboom, and Max Welling. E(n) Equivariant Graph Neural Networks . arXiv:2102.09844 [cs, stat], February 2021. URL http://arxiv.org/abs/2102.09844. arXiv: 2102.09844
2021 arXiv
-
[28]
On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups
Risi Kondor and Shubhendu Trivedi. On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups . arXiv:1802.03690 [cs, stat], November 2018. URL http://arxiv.org/abs/1802.03690. arXiv: 1802.03690
2018 arXiv
-
[29]
A General Theory of Equivariant CNNs on Homogeneous Spaces
Taco Cohen, Mario Geiger, and Maurice Weiler. A General Theory of Equivariant CNNs on Homogeneous Spaces . arXiv:1811.02017 [cs, stat], January 2020. URL http://arxiv.org/abs/1811.02017. arXiv: 1811.02017
2020 arXiv
-
[30]
Image to sphere: Learning equivariant features for efficient pose prediction
David Klee, Ondrej Biza, Robert Platt, and Robin Walters. Image to sphere: Learning equivariant features for efficient pose prediction. In International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=_2bDpAtr7PI
2023
-
[31]
Equivariant single view pose prediction via induced and restriction representations
Owen Howell, David Klee, Ondrej Biza, Linfeng Zhao, and Robin Walters. Equivariant single view pose prediction via induced and restriction representations. In A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, editors, Advances in Neural Information Processin...
2023
-
[32]
Mastering Atari , Go , Chess and Shogi by Planning with a Learned Model
Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, Laurent Sifre, Simon Schmitt, Arthur Guez, Edward Lockhart, Demis Hassabis, Thore Graepel, Timothy Lillicrap, and David Silver. Mastering Atari , Go , Chess and Shogi by Planning with a Learned Model . ar...
1911 arXiv
-
[33]
Theodorou
Grady Williams, Andrew Aldrich, and Evangelos A. Theodorou. Model Predictive Path Integral Control : From Theory to Parallel Computation . Journal of Guidance, Control, and Dynamics, 40 0 (2): 0 344--357, February 2017 b . ISSN 0731-5090, 1533-3884. doi:10/f9vx74. URL https://...
2017 doi
-
[34]
Sutton and Andrew G
Richard S. Sutton and Andrew G. Barto. Reinforcement learning: an introduction. Adaptive computation and machine learning series. The MIT Press, Cambridge, Massachusetts, second edition edition, 2018. ISBN 978-0-262-03924-6
2018
-
[35]
Integrated Task and Motion Planning
Caelan Reed Garrett, Rohan Chitnis, Rachel Holladay, Beomjoon Kim, Tom Silver, Leslie Pack Kaelbling, and Tomás Lozano-Pérez. Integrated Task and Motion Planning . arXiv:2010.01083 [cs], October 2020. URL http://arxiv.org/abs/2010.01083. arXiv: 2010.01083
2010 arXiv
-
[36]
Practice makes perfect: Planning to learn skill parameter policies
Nishanth Kumar, Tom Silver, Willie McClinton, Linfeng Zhao, Stephen Proulx, Tomás Lozano-Pérez, Leslie Pack Kaelbling, and Jennifer Barry. Practice makes perfect: Planning to learn skill parameter policies. In Robotics: Science and Systems (RSS), 2024
2024
-
[37]
Linfeng Zhao and Lawson L.S. Wong. Learning to navigate in mazes with novel layouts using abstract top-down maps. Reinforcement Learning Journal, 5: 0 2359--2372, 2024
2024
-
[38]
An Error - State Model Predictive Control on Connected Matrix Lie Groups for Legged Robot Control , January 2023
Sangli Teng, Dianhao Chen, William Clark, and Maani Ghaffari. An Error - State Model Predictive Control on Connected Matrix Lie Groups for Legged Robot Control , January 2023. URL http://arxiv.org/abs/2203.08728. arXiv:2203.08728 [cs, eess]
2023 arXiv
-
[39]
E(2)-equivariant graph planning for navigation
Linfeng Zhao, Hongyu Li, Ta s k n Pad r, Huaizu Jiang, and Lawson LS Wong. E(2)-equivariant graph planning for navigation. IEEE Robotics and Automation Letters, 2024
2024
-
[40]
Value Iteration Networks
Aviv Tamar, YI WU, Garrett Thomas, Sergey Levine, and Pieter Abbeel. Value Iteration Networks . In Advances in Neural Information Processing Systems , volume 29. Curran Associates, Inc., 2016. URL https://proceedings.neurips.cc/paper/2016/hash/c21002f464c5fc5bee3b98ced83963b8-...
2016
-
[41]
Sample Efficient Grasp Learning Using Equivariant Models
Xupeng Zhu, Dian Wang, Ondrej Biza, Guanang Su, Robin Walters, and Robert Platt. Sample Efficient Grasp Learning Using Equivariant Models . arXiv:2202.09468 [cs], February 2022. URL http://arxiv.org/abs/2202.09468. arXiv: 2202.09468
2022 arXiv
-
[42]
DeepMind Control Suite , January 2018
Yuval Tassa, Yotam Doron, Alistair Muldal, Tom Erez, Yazhe Li, Diego de Las Casas, David Budden, Abbas Abdolmaleki, Josh Merel, Andrew Lefrancq, Timothy Lillicrap, and Martin Riedmiller. DeepMind Control Suite , January 2018. URL http://arxiv.org/abs/1801.00690. arXiv:1801.00690 [cs]
2018 arXiv
-
[43]
Gated Path Planning Networks
Lisa Lee, Emilio Parisotto, Devendra Singh Chaplot, Eric Xing, and Ruslan Salakhutdinov. Gated Path Planning Networks . arXiv:1806.06408 [cs, stat], June 2018. URL http://arxiv.org/abs/1806.06408. arXiv: 1806.06408
2018 arXiv
-
[44]
On- Manifold Model Predictive Control for Trajectory Tracking on Robotic Systems
Guozheng Lu, Wei Xu, and Fu Zhang. On- Manifold Model Predictive Control for Trajectory Tracking on Robotic Systems . IEEE Transactions on Industrial Electronics, 70 0 (9): 0 9192--9202, September 2023. ISSN 1557-9948. doi:10.1109/TIE.2022.3212397. Conference Name: IEEE Transa...
2023
-
[45]
QT - Opt : Scalable Deep Reinforcement Learning for Vision - Based Robotic Manipulation
Dmitry Kalashnikov, Alex Irpan, Peter Pastor, Julian Ibarz, Alexander Herzog, Eric Jang, Deirdre Quillen, Ethan Holly, Mrinal Kalakrishnan, Vincent Vanhoucke, and Sergey Levine. QT - Opt : Scalable Deep Reinforcement Learning for Vision - Based Robotic Manipulation . arXiv:180...
2018 arXiv
-
[46]
Implicit Behavioral Cloning , August 2021
Pete Florence, Corey Lynch, Andy Zeng, Oscar Ramirez, Ayzaan Wahid, Laura Downs, Adrian Wong, Johnny Lee, Igor Mordatch, and Jonathan Tompson. Implicit Behavioral Cloning , August 2021. URL http://arxiv.org/abs/2109.00137. arXiv:2109.00137 [cs]
2021 arXiv
-
[47]
Kroese, Shie Mannor, and Reuven Y
Pieter-Tjerk de Boer, Dirk P. Kroese, Shie Mannor, and Reuven Y. Rubinstein. A Tutorial on the Cross - Entropy Method . Annals of Operations Research, 134 0 (1): 0 19--67, February 2005. ISSN 0254-5330, 1572-9338. doi:10/fkbjf3. URL http://link.springer.com/10.1007/s10479-005-5724-z
2005 doi
-
[48]
Model Predictive Path Integral Control using Covariance Variable Importance Sampling
Grady Williams, Andrew Aldrich, and Evangelos Theodorou. Model Predictive Path Integral Control using Covariance Variable Importance Sampling . arXiv:1509.01149 [cs], October 2015. URL http://arxiv.org/abs/1509.01149. arXiv: 1509.01149
2015 arXiv
-
[49]
Rehg, and Evangelos A
Grady Williams, Paul Drews, Brian Goldfain, James M. Rehg, and Evangelos A. Theodorou. Aggressive driving with model predictive path integral control. In 2016 IEEE International Conference on Robotics and Automation ( ICRA ) , pages 1433--1440, May 2016. doi:10/gf9knc
2016
-
[50]
Meta- World : A Benchmark and Evaluation for Multi - Task and Meta Reinforcement Learning
Tianhe Yu, Deirdre Quillen, Zhanpeng He, Ryan Julian, Karol Hausman, Chelsea Finn, and Sergey Levine. Meta- World : A Benchmark and Evaluation for Multi - Task and Meta Reinforcement Learning . arXiv:1910.10897 [cs, stat], October 2019. URL http://arxiv.org/abs/1910.10897. arX...
1910 arXiv
-
[51]
DDPG - Deep Deterministic Policy Gradient
Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. DDPG - Deep Deterministic Policy Gradient . page 14, 2016. ZSCC: NoCitationData[s0]
2016
-
[52]
The Detection and Exploitation of Symmetry in Planning Problems
Maria Fox and Derek Long. The Detection and Exploitation of Symmetry in Planning Problems . In In IJCAI , pages 956--961. Morgan Kaufmann, 1999
1999
-
[53]
Extending the exploitation of symmetries in planning
Maria Fox and Derek Long. Extending the exploitation of symmetries in planning. In In Proceedings of AIPS ’02 , pages 83--91, 2002
2002
-
[54]
Rosenschein
Nir Pochter, Aviv Zohar, and Jeffrey S. Rosenschein. Exploiting Problem Symmetries in State - Based Planners . In Twenty- Fifth AAAI Conference on Artificial Intelligence , August 2011. URL https://www.aaai.org/ocs/index.php/AAAI/AAAI11/paper/view/3732
2011
-
[55]
Enhanced Symmetry Breaking in Cost - Optimal Planning as Forward Search
Carmel Domshlak, Michael Katz, and Alexander Shleyfman. Enhanced Symmetry Breaking in Cost - Optimal Planning as Forward Search . page 5. doi:10/gq5m5r
-
[56]
Heuristics and Symmetries in Classical Planning
Alexander Shleyfman, Michael Katz, Malte Helmert, Silvan Sievers, and Martin Wehrle. Heuristics and Symmetries in Classical Planning . Proceedings of the AAAI Conference on Artificial Intelligence, 29 0 (1), March 2015. ISSN 2374-3468. doi:10/gq5m5s. URL https://ojs.aaai.org/i...
2015
-
[57]
An Empirical Case Study on Symmetry Handling in Cost - Optimal Planning as Heuristic Search
Silvan Sievers, Martin Wehrle, Malte Helmert, and Michael Katz. An Empirical Case Study on Symmetry Handling in Cost - Optimal Planning as Heuristic Search . In Steffen Hölldobler, Rafael Peñaloza, and Sebastian Rudolph, editors, KI 2015: Advances in Artificial Intelligence , ...
2015 doi
-
[58]
Structural Symmetries of the Lifted Representation of Classical Planning Tasks
Silvan Sievers. Structural Symmetries of the Lifted Representation of Classical Planning Tasks . page 8
-
[59]
Theoretical Foundations for Structural Symmetries of Lifted PDDL Tasks
Silvan Sievers, Gabriele Röger, Martin Wehrle, and Michael Katz. Theoretical Foundations for Structural Symmetries of Lifted PDDL Tasks . Proceedings of the International Conference on Automated Planning and Scheduling, 29: 0 446--454, 2019. ISSN 2334-0843. doi:10/gq5m5t. URL ...
2019
-
[60]
Operator Mutexes and Symmetries for Simplifying Planning Tasks
Daniel Fiser, Alvaro Torralba, and Alexander Shleyfman. Operator Mutexes and Symmetries for Simplifying Planning Tasks . Proceedings of the AAAI Conference on Artificial Intelligence, 33 0 (01): 0 7586--7593, July 2019. ISSN 2374-3468. doi:10/ghkkbq. URL https://ojs.aaai.org/i...
2019
-
[61]
On the hardness of finding symmetries in Markov decision processes
Shravan Matthur Narayanamurthy and Balaraman Ravindran. On the hardness of finding symmetries in Markov decision processes. In Proceedings of the 25th international conference on Machine learning - ICML '08 , pages 688--695, Helsinki, Finland, 2008. ACM Press. ISBN 978-1-60558...
2008
-
[62]
Ferns, P
N. Ferns, P. Panangaden, and Doina Precup. Metrics for Finite Markov Decision Processes . In AAAI , 2004
2004
-
[63]
Walsh, and M
Lihong Li, Thomas J. Walsh, and M. Littman. Towards a Unified Theory of State Abstraction for MDPs . In AI & M , 2006
2006
-
[64]
Linfeng Zhao, Lingzhi Kong, Robin Walters, and Lawson L. S. Wong. Toward Compositional Generalization in Object - Oriented World Modeling . In ICML 2022 , April 2022 b . URL http://arxiv.org/abs/2204.13661. arXiv: 2204.13661
2022 arXiv
-
[65]
Linfeng Zhao, Huazhe Xu, and Lawson L. S. Wong. Scaling up and Stabilizing Differentiable Planning with Implicit Differentiation . In ICLR 2023 , February 2023 b . URL https://openreview.net/forum?id=PYbe4MoHf32
2023
-
[66]
Provably Strict Generalisation Benefit for Equivariant Models
Bryn Elesedy and Sheheryar Zaidi. Provably Strict Generalisation Benefit for Equivariant Models . In Proceedings of the 38th International Conference on Machine Learning , pages 2959--2969. PMLR, July 2021. URL https://proceedings.mlr.press/v139/elesedy21a.html. ISSN: 2640-3498
2021
-
[67]
J. P. Serre. Groupes finis, 2005. URL https://arxiv.org/abs/math/0503154
2005 arXiv
-
[68]
A. Zee. Group Theory in a Nutshell for Physicists. In a Nutshell. Princeton University Press, 2016. ISBN 9780691162690. URL https://books.google.com/books?id=FWkujgEACAAJ
2016
-
[69]
, " * write output.state after.block = add.period write
ENTRY address author booktitle chapter doi edition editor eid howpublished institution journal key month note number organization pages publisher school series title type url volume year label INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION in...
-
[70]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.