Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-11T17:50:06.496418Z
Paper Citation Record · LEDGER
As of 18 August 2026, this Paper Citation Record lists 69 of 69 outbound references and 5 inbound Pith citation observations for arXiv:2412.08542.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-11T17:50:06.496418Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-16T11:36:11.391633Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-05-25T05:00:21.648976Z
69 of 69 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 58cfd567-bace-4ebf-800e-0855d8b672b6 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 137bb165-34c6-4539-9282-818027a12a80 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Modular multitask reinforcement learning with policy sketches
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation d396c276-d027-4a34-ab81-f2e5ff80b9db · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Senthil, and George Dimitri Konidaris
Reference 3
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a58f98c9-f3a4-4a0a-b3b6-ccbe83e485ec · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Bellemare, Sriram Srinivasan, Georg Ostrovski, Tom Schaul, David Saxton, and R \'e mi Munos
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation c024aa11-85af-4a27-98bd-fd06892f0b7a · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4cda2ca2-63e1-4678-acf1-6892541d3ccc · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Deep reinforcement learning from human preferences
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f8bf0ad2-3eae-4966-874c-7b3826d98809 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a3e71b35-88ec-4be5-bad2-cfbfbc9bf390 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Active reward learning
Reference 8
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 2fe29d7e-3dfc-46a0-8382-6b8c28229f27 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Feudal reinforcement learning
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation f9f3dd4d-7826-44fc-a441-4a139b69556b · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Drescher
Reference 10
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation e87da5df-3086-4d12-8a65-f5f9e5ca3bf0 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback PaLM-E: An Embodied Multimodal Language Model
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8381b071-cda7-4d3a-848c-a0b31aa62227 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback The Llama 3 Herd of Models
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 736d0f78-8f4f-4f21-b084-caa495e58e4c · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Minedojo: Building open-ended embodied agents with internet-scale knowledge
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9a433a8e-88eb-4a4f-839b-38d789c1320d · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Hart, and Nils J
Reference 14
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation c967e085-3cf0-45cc-8d01-c892a1bd063d · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Variational intrinsic control
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 6258b150-4377-4a54-b181-21a646b85509 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback u ttler, Taehwon Kwon, Donghoon Lee, Vegard Mella, Nantas Nardelli, Ivan Nazarov, Nikita Ovsov, Jack Holder, Roberta Raileanu, Karolis Ramanauskas, Tim Rockt \
Reference 16
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 825399fc-fc59-4d19-adbb-6043b2211222 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Dungeons and data: A large-scale nethack dataset
Reference 17
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation bc0b6704-6e62-4635-bd98-45973b0765ad · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback When Waiting is not an Option : Learning Options with a Deliberation Cost
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fb84a863-430b-4439-952e-2295f123ac18 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Exploration via elliptical episodic bonuses
Reference 19
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a18b4ca7-2838-4a8b-a077-ba32edaf0af1 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 20
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 3bee4fe8-bb36-4a22-988f-2115b4ed6d84 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Open-endedness is essential for artificial superhuman intelligence, 06 2024
Reference 21
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation e990c377-7225-4081-af6f-e8912b474127 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 6711e68a-137c-44ff-96ac-5c8b362deb8f · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Options of interest: Temporal abstraction with interest functions
Reference 23
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 64eb8769-ca71-4adc-9880-3ba01a4cf1c5 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 24
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 1fc87d47-db2f-4926-b6c2-cdbb31bdb224 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Motif: Intrinsic motivation from artificial intelligence feedback
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 914032c9-ad51-4f15-808c-50011e2a8f9b · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Keep your options open: An information-based driving principle for sensorimotor systems
Reference 26
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 7f331168-b01b-445c-8738-fff879ea7452 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Interactively shaping agents via human reinforcement: The tamer framework
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 060cb00f-3593-4a44-b224-55f1cabc66f4 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback From skills to symbols: Learning symbolic representations for abstract high-level planning
Reference 28
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 67cfa847-3ac3-4374-957d-56e0c425eabd · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Practice makes perfect: Planning to learn skill parameter policies
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 66c0ba1c-9fe4-427f-a50e-9aa05329953f · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback u ttler, Nantas Nardelli, Alexander H. Miller, Roberta Raileanu, Marco Selvatici, Edward Grefenstette, and Tim Rockt \
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6ddcd9fd-3060-4456-8f03-c66ec95e385f · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Gonzalez, Hao Zhang, and Ion Stoica
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4cbe3cbe-b9b4-4914-8abd-a9e93af5e7e2 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Code as policies: Language model programs for embodied control
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 51bdf37e-afd1-4fc6-932a-1412f4cb66e2 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback LLM+P: Empowering Large Language Models with Optimal Planning Proficiency
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a153dfa8-2807-45ae-a59f-19a3b5c41397 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Goal-conditioned reinforcement learning: Problems and solutions
Reference 34
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 159ac966-efa9-41af-a8b4-dcf577d5b637 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback A laplacian framework for option discovery in reinforcement learning
Reference 35
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation f2290405-1187-4902-9ebd-e631078d6ec7 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Machado, Andr \'e Barreto, and Doina Precup
Reference 36
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation d1883cf2-22b1-458e-83c1-da7ca0e2bb9a · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Self-Refine: Iterative Refinement with Self-Feedback
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cb0f5c7b-b459-4184-8d78-219be8b5d5aa · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Concurrent hierarchical reinforcement learning
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation cb4782cf-d8fe-4b23-84b5-5ddf4b847f6c · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Howe, Craig A
Reference 39
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 02efb005-5ddf-4603-b9c6-5dc1be3884b3 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 7ab2bc44-2ad8-4b6d-9475-c8d6bcf5bf6c · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Q-cut - dynamic discovery of sub-goals in reinforcement learning
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 1e7fcc68-6323-4854-9c59-08bac42ce7e0 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Embodied lifelong learning for task and motion planning
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 6d52731a-f09e-4e5c-8c26-cb6ca188c23d · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback nle-sample-factory-baseline, 2022
Reference 43
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 7aa0d318-7163-4f1f-96aa-de87c7503870 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Nethack: an illustrated guide to the mazes of menace, dec 2022
Reference 44
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 7f4b56c5-a0ac-4ffe-96d6-d64cfe14125e · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Courville
Reference 45
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation d0726826-1054-4226-bbb3-f5782a1bfe97 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Sukhatme, and Vladlen Koltun
Reference 46
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 290c1b5b-f223-4a35-9d6d-07323d1b1f60 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback diff history for neural language agents, 2023 a
Reference 47
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation d8b61072-7d39-4baa-8e71-0860a909afed · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Nethack is hard to hack, 2023 b
Reference 48
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 2aa3c6f0-8ea0-4125-bf91-4afd1a9dd0f6 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Temporal Abstraction in Reinforcement Learning
Reference 49
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation b2b4dd38-44df-41b9-bbc3-70f94f6d17e8 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Proximal Policy Optimization Algorithms
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 62fe808b-6720-489a-b511-6c819663d1d6 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Reflexion: language agents with verbal reinforcement learning
Reference 51
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 2e33b19f-8649-43dd-97ad-46cdcfbe71fd · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Tenenbaum, Leslie Pack Kaelbling, and Michael Katz
Reference 52
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 821e2848-6d8b-4513-a18c-dbf647b41f48 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Learning options in reinforcement learning
Reference 53
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 20731ef9-84cd-4a4f-94c1-294cc7b334f6 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 54
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 4ec9dc09-481a-45bd-b0bc-791c239cbf39 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Sutton, Doina Precup, and Satinder Singh
Reference 55
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation b391c326-2e30-4cf5-b5fd-ba74910b3128 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Autoascend -- 1st place nethack agent for the nethack challenge at neurips 2021
Reference 56
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a3faedc5-bc65-45eb-8ffb-1fe2904d2a42 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Reinforcement learning with human teachers: Evidence of feedback and guidance with implications for learning performance
Reference 57
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 9ca69d07-8aa2-4091-8106-a53243740010 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Does zero-shot reinforcement learning exist? In The Eleventh International Conference on Learning Representations, 2023
Reference 58
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation ac99ff11-84ca-489e-9fa4-8d1beaff95d8 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Python tutorial, volume 620
Reference 59
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 4389f62e-b837-4b8f-a3b7-09800ce198c9 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Feudal networks for hierarchical reinforcement learning
Reference 60
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 0785c02a-8e1d-46f2-9cd7-6990b9d3d309 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Voyager: An open-ended embodied agent with large language models
Reference 61
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 0a074345-0ba5-40c0-a3ba-e6ab1fcd5cc5 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Chain-of-thought prompting elicits reasoning in large language models
Reference 62
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e09f9c08-f7f2-49ef-8014-a744ecfef580 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Fine-tuning Reinforcement Learning Models is Secretly a Forgetting Mitigation Problem
Reference 63
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 15162f35-fc65-4bc2-9b97-ed6e66e2a274 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback ReAct: Synergizing Reasoning and Acting in Language Models
Reference 64
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4c8cd7bd-24a2-44a5-be15-edc10e0377d3 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Noveld: A simple yet effective exploration criterion
Reference 65
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 5e230a5c-e34d-4a87-be1a-5a88680b59fd · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback write newline
Reference 66
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5720ff46-3fcf-4189-9450-16e4606d7d07 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback @esa (Ref
Reference 67
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fc778430-d7a7-4baa-a838-0dc3ce3fd0d8 · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 68
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5f034dd9-0daf-408a-8d16-9a277611284a · outbound
MaestroMotif: Skill Design from Artificial Intelligence Feedback Unresolved cited work
Reference 69
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ffe85de8-775e-47e8-96cb-5b6c8bb0ff93 · inbound
A Self-Improving Coding Agent MaestroMotif: Skill Design from Artificial Intelligence Feedback
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 95e1046d-2733-43be-832c-05820eaa8411 · inbound
LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilities MaestroMotif: Skill Design from Artificial Intelligence Feedback
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7cf223ad-0ca7-4803-bddd-95b9d7d0ca99 · inbound
Hierarchical Behaviour Spaces MaestroMotif: Skill Design from Artificial Intelligence Feedback
Reference 8
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 0150f5a1-ed7a-4c53-be4b-88a5ce04855e · inbound
Agentick: A Unified Benchmark for General Sequential Decision-Making Agents MaestroMotif: Skill Design from Artificial Intelligence Feedback
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 868116f4-dc41-43b7-a744-ee1ee21c8bbc · inbound
Goal-Conditioned Agents that Learn Everything All at Once MaestroMotif: Skill Design from Artificial Intelligence Feedback
Reference 37
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.