REVIEW 6 cited by
NAVIX: Scaling MiniGrid Environments with JAX
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
As Deep Reinforcement Learning (Deep RL) research moves towards solving large-scale worlds, efficient environment simulations become crucial for rapid experimentation. However, most existing environments struggle to scale to high throughput, setting back meaningful progress. Interactions are typically computed on the CPU, limiting training speed and throughput, due to slower computation and communication overhead when distributing the task across multiple machines. Ultimately, Deep RL training is CPU-bound, and developing batched, fast, and scalable environments has become a frontier for progress. Among the most used Reinforcement Learning (RL) environments, MiniGrid is at the foundation of several studies on exploration, curriculum learning, representation learning, diversity, meta-learning, credit assignment, and language-conditioned RL, and still suffers from the limitations described above. In this work, we introduce NAVIX, a re-implementation of MiniGrid in JAX. NAVIX achieves over 200 000x speed improvements in batch mode, supporting up to 2048 agents in parallel on a single Nvidia A100 80 GB. This reduces experiment times from one week to 15 minutes, promoting faster design iterations and more scalable RL model development.
Forward citations
Cited by 6 Pith papers
-
Assistax: A Multi-Agent Hardware-Accelerated Reinforcement Learning Benchmark for Assistive Robotics
Assistax provides fast JAX-based assistive robotics environments with trainable humanoid partners, and shows current RL baselines have a coordination gap when facing unseen human preferences.
-
Octax: Accelerated CHIP-8 Arcade Environments for Reinforcement Learning in JAX
Octax is a JAX-based CHIP-8 emulator that runs thousands of parallel arcade environments on GPUs (350k steps/s) and supports LLM-generated games for RL training.
-
In-Context Reinforcement Learning via Communicative World Models
CORAL trains an information agent as a world model that sends concise messages to a control agent, improving in-context reinforcement learning and zero-shot adaptation.
-
Benchmarking Partial Observability in Reinforcement Learning with a Suite of Memory-Improvable Domains
A JAX benchmark suite of nine memory-improvable partially observable RL environments, with evidence that recurrent and transformer agents beat memoryless baselines but fall short of state-augmented ceilings.
-
Chargax: A JAX Accelerated EV Charging Simulator
Chargax is a JAX-based EV charging simulator that accelerates reinforcement learning training by 100x to 1000x compared to existing environments, with modular real-world scenarios.
-
Information-Based Exploration via Random Features for Reinforcement Learning
Random-feature Gaussian-process information gain is turned into a closed-form exploration bonus for PPO that matches RND/VIME/#Explo on 12 control, navigation, and sparse-locomotion tasks, with error bounds on the app...
Discussion (0). Sign in to comment.