The reviewed record of science sign in
Pith

arxiv: 2409.14191 · v4 · pith:O5KBZL5U · submitted 2024-09-21 · cs.AI · cs.HC

Addressing and Visualizing Misalignments in Human Task-Solving Trajectories

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:O5KBZL5Urecord.jsonopen to challenge →

classification cs.AI cs.HC
keywords humanmisalignmentstrajectoriesalignmenttask-solvingdemonstrateintentionsmodels
0
0 comments X
read the original abstract

Understanding misalignments in human task-solving trajectories is crucial for enhancing AI models trained to closely mimic human reasoning. This study categorizes such misalignments into three types: (1) lack of functions to express intent, (2) inefficient action sequences, and (3) incorrect intentions that cannot solve the task. To address these issues, we first formalize and define these three misalignment types in a unified framework. We then propose a heuristic algorithm to detect misalignments in ARCTraj trajectories and analyze their impact hierarchically and quantitatively. We also present an intention estimation method based on our formalism that infers missing alignment between user actions and intentions. Through trajectory alignment, we experimentally demonstrate that AI models trained on human task-solving trajectories improve performance in mimicking human reasoning. Based on hierarchical analysis and experiments, we highlight the importance of trajectory-intention alignment and demonstrate the effectiveness of intention-aligned training.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.