Pith. sign in

REVIEW 2 cited by

Consolidation via Policy Information Regularization in Deep RL for Multi-Agent Games

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2011.11517 v1 pith:RWXMS4M6 submitted 2020-11-23 cs.AI

classification cs.AI
keywords learningmulti-agentapproachpolicycapacity-limiteddeepenvironmentmaddpg
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This paper introduces an information-theoretic constraint on learned policy complexity in the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithm. Previous research with a related approach in continuous control experiments suggests that this method favors learning policies that are more robust to changing environment dynamics. The multi-agent game setting naturally requires this type of robustness, as other agents' policies change throughout learning, introducing a nonstationary environment. For this reason, recent methods in continual learning are compared to our approach, termed Capacity-Limited MADDPG. Results from experimentation in multi-agent cooperative and competitive tasks demonstrate that the capacity-limited approach is a good candidate for improving learning performance in these environments.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Position: Theory of Mind Benchmarks are Broken for Large Language Models

    cs.AI 2024-12 conditional novelty 6.0 of 10

    The paper proposes that LLM theory-of-mind evaluation should measure functional adaptation to partners, not just literal prediction of their behavior, and shows the two can diverge sharply in simple games.

  2. Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference

    cs.LG 2024-12 conditional novelty 6.0 of 10

    Staggered asynchronous inference lets reinforcement learning agents with large, slow models act at every time step in realtime environments, at the cost of delay regret that grows with environment stochasticity.

Pith tools