REVIEW 8 cited by
Translating Natural Language to Planning Goals with Large-Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Recent large language models (LLMs) have demonstrated remarkable performance on a variety of natural language processing (NLP) tasks, leading to intense excitement about their applicability across various domains. Unfortunately, recent work has also shown that LLMs are unable to perform accurate reasoning nor solve planning problems, which may limit their usefulness for robotics-related tasks. In this work, our central question is whether LLMs are able to translate goals specified in natural language to a structured planning language. If so, LLM can act as a natural interface between the planner and human users; the translated goal can be handed to domain-independent AI planners that are very effective at planning. Our empirical results on GPT 3.5 variants show that LLMs are much better suited towards translation rather than planning. We find that LLMs are able to leverage commonsense knowledge and reasoning to furnish missing details from under-specified goals (as is often the case in natural language). However, our experiments also reveal that LLMs can fail to generate goals in tasks that involve numerical or physical (e.g., spatial) reasoning, and that LLMs are sensitive to the prompts used. As such, these models are promising for translation to structured planning languages, but care should be taken in their use.
Forward citations
Cited by 8 Pith papers
-
Hypothesis-driven Model Expansion under Uncertainty for Open-World Robot Planning
HUME lets robots generate, plan over, and actively verify object-centric hypotheses from foundation models so incomplete symbolic models become usable for open-world household tasks.
-
Decompose and Reorganize: Planning with Primitives and Visuomotor Policies Learned from Demonstrations
DR-LfD decomposes demonstrations into contact-level skills, learns them as equivariant primitives and visuomotor policies, and uses TAMP to recombine them for long-horizon tasks.
-
Prime the search: Using large language models for guiding geometric task and motion planning by warm-starting tree search
STaLM warm-starts a hybrid-action Monte Carlo tree search with task plans generated by a single LLM query, outperforming pure search and prior LLM planners on six geometric task and motion planning problems.
-
Learning Compositional Behaviors from Demonstration and Language
BLADE learns structured, planable action representations from language-annotated demonstrations and composes them with a symbolic planner, outperforming latent and LLM/VLM baselines on new manipulation tasks.
-
FlashDP: Private Training Large Language Models with Efficient DP-SGD
FlashDP fuses per-sample gradient computation, norm calculation, clipping, and noise addition into a cache-friendly block-wise all-reduce workflow that avoids explicit per-sample gradient storage and redundant recomputation.
-
Hallucination Detection with Small Language Models
A multi-small-model ensemble with sentence splitting, z-score normalization, and harmonic mean detects hallucinations in RAG answers with a reported 10% F1 gain over single-model baselines.
-
Language-Grounded Hierarchical Planning and Execution with Multi-Robot 3D Scene Graphs
A multi-robot team fuses open-set object maps and 3D scene graphs, translates natural-language commands into PDDL goals with an LLM, and executes them in a large outdoor environment.
-
Large Language Models for Planning: A Comprehensive and Systematic Survey
A structured survey of LLM planning methods, benchmarks, and interpretability work, organized around a three-way taxonomy.
Discussion (0). Continue with ORCID to comment.