Pith. sign in

REVIEW 1 cited by

PaperToPlace: Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality Experiences

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2308.13924 v1 pith:MYSZY62Y submitted 2023-08-26 cs.HC

classification cs.HC
keywords pipelineinstructioninstructionsauthoringconsumptionpapertoplaceparticipantssteps
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

While paper instructions are one of the mainstream medium for sharing knowledge, consuming such instructions and translating them into activities are inefficient due to the lack of connectivity with physical environment. We present PaperToPlace, a novel workflow comprising an authoring pipeline, which allows the authors to rapidly transform and spatialize existing paper instructions into MR experience, and a consumption pipeline, which computationally place each instruction step at an optimal location that is easy to read and do not occlude key interaction areas. Our evaluations of the authoring pipeline with 12 participants demonstrated the usability of our workflow and the effectiveness of using a machine learning based approach to help extracting the spatial locations associated with each steps. A second within-subject study with another 12 participants demonstrates the merits of our consumption pipeline by reducing efforts of context switching, delivering the segmented instruction steps and offering the hands-free affordances.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. CARING-AI: Towards Authoring Context-aware Augmented Reality INstruction through Generative Artificial Intelligence

    cs.HC 2025-01 conditional novelty 6.0 of 10

    CARING-AI combines ChatGPT text generation, environment scanning, and smoothed text-to-motion diffusion to let authors create spatially grounded AR avatar instructions without coding or motion capture.

Pith tools