{"id":"130f378f-b0e9-4594-8b4c-a3dc440dbdc1","arxiv_id":"2411.10192","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"The paper introduces Tangi, a tool that converts 360-degree video frames into flat and polyhedral paper artifacts, and reports an initial qualitative study suggesting these artifacts support collaborative design analysis.","lead":"A new open-source web tool lets designers print frames from 360-degree videos as flat or foldable 3D paper artifacts for design workshops. Early tests with nine designers suggest the artifacts help people keep their bearings and link small details to the full surrounding scene.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The evaluation's one-on-one reflection sessions do not support the claim that Tangi artifacts 'enable tangible interactions found in collaborative workshops'; the data show individual anticipation, not observed group collaboration.","rationale":"The reader's weakest assumption is exactly the gap I identify: one-on-one sessions with the lead researcher, using snowball sampling, cannot establish how artifacts function in real multi-person workshops. My reading of Sections 5.1, 5.2, 6, and 7.4 confirms that the evidence consists of individual reflection and researcher-guided prototyping, not observed collaborative sense-making. This is the load-bearing weakness in the strongest claim. I do not see a fatal internal error: the design rationale, artifact classes, and qualitative themes are coherent, and the tool appears functional as described, though source-code URLs are removed. The F2 issue (context-detail link being 'missing' in sphere-ish artifacts) is a real secondary qualification, but it reinforces rather than replaces the main external-validity concern. Since the reader already issued CONDITIONAL, I would keep that verdict unchanged: the paper is a plausible early design study whose central claim needs real workshop evaluation before 'demonstrates' is warranted.","tokens_in":16785,"tokens_out":4053,"duration_ms":39038,"concrete_test":"Run a workshop study with groups of 3-4 designers who are given a real 360° video analysis task and either (a) Tangi-generated flat and sphere-ish artifacts or (b) conventional flat 360° screenshots / an existing paper-cube tool. Video-record the sessions and code for the collaborative interactions named in Buur et al. (pointing, rotating, arranging, annotating, aligning) plus occurrences of orientation talk and context-detail linking. If Tangi artifacts do not yield more or different collaborative interaction events than the control, or if the two claimed new capabilities only appear when a researcher demonstrates them, the abstract's 'demonstrates' claim fails and should be weakened to 'elicits designer-reported utility.'","verdict_should_be":"UNCHANGED","load_bearing_attack":"The abstract's central claim is that the evaluation 'demonstrates' that Tangi's artifacts enable tangible interactions found in collaborative workshops and introduce two new capabilities (orientation; context-detail link). The load-bearing evidence would have to be observed use of the artifacts by multiple designers in collaborative sense-making. Section 5.1 states that 'the 2 to 3 hour sessions were conducted one-on-one with a participant and the lead researcher' and Section 5.2 shows the lead researcher explained, demonstrated, and 'guided' a reflection. No session involved a group of designers collaborating with each other; the 'tangible interactions' reported in Section 6 (pointing, rotating, annotating, arranging) appear as participants' descriptions or individual prototypes, not as observed multi-party workshop behavior. The authors themselves limit the work in Section 7.4 to 'a limited number of designers ... for a single session' and call for future evaluation in 'different design contexts.' Consequently, the verb 'demonstrates' overstates what the data can establish; at most the sessions elicit designers' judgments about expected utility. A secondary internal inconsistency strengthens this: in F2, the context-detail link is described as 'crucially ... missing in the sphere-ish artifacts' and as a need that participants addressed by inventing external booklets, flags, or QR-code annotations, so attributing that capability to 'the artifacts Tangi creates' is not directly supported by the tool's output.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper presents Tangi, a web-based tool that converts equirectangular 360° video frames into tangible paper artifacts, either as flat artifacts with a mini-map orientation aid or as foldable 'sphere-ish' polyhedra (cube and cuboctahedron). The authors motivate the tool by arguing that 360° video's spherical nature prevents designers from creating the tangible video artifacts (storyboards, frame clusters) that support collaborative sense-making in Video Design Ethnography. They describe a design space of 360° video artifacts, three design considerations, the tool implementation, and a qualitative evaluation with nine experienced designers in one-on-one sessions. The reported results include four themes: differences between artifact classes, two functions specific to tangible 360° artifacts (orientation and context-detail link), participants' extensions beyond single frames, and observations about tangibility and time. The paper claims that the evaluation demonstrates that Tangi's artifacts enable tangible interactions found in collaborative workshops and introduce two new capabilities.","tokens_in":17119,"tokens_out":4094,"duration_ms":44414,"significance":"If the central claims hold, Tangi addresses a real gap: it makes 360° video content amenable to paper-based artifacts, which prior work identifies as important for collaborative design analysis. The paper's strengths include a clear design-space framing, a working open-source tool with printable templates, and a qualitative study that documents experienced designers' reactions with quotes and artifact photos. The two candidate capabilities—orientation in 360° space and linking details to a broader context—are plausible and interesting. However, the evaluation design supports a more modest conclusion than the abstract states. Because the sessions were one-on-one reflections rather than observed group collaboration, and because the 'context-detail link' emerged only through participants' externally added annotations, the paper's strongest claims need to be scaled back or re-evidenced. The contribution remains useful as an exploratory tool study, but the current wording overstates what the data can demonstrate.","major_comments":[{"comment":"The abstract claims that the evaluation 'demonstrates that the artifacts Tangi creates enable tangible interactions found in collaborative workshops,' but the study did not observe collaborative workshops. As stated in §5.1, 'the 2 to 3 hour sessions were conducted one-on-one with a participant and the lead researcher,' and §5.2 describes the lead researcher demonstrating, sharing, and guiding reflection rather than multiple designers collaborating with one another. The 'tangible interactions' reported in §6 (pointing, rotating, annotating, arranging) appear as participants' descriptions or individual prototypes, not as observed multi-party behavior. The authors' own §7.4 limits the findings to 'a limited number of designers ... for a single session.' The verb 'demonstrates' therefore overstates the evidence; at most the study elicits designers' judgments about expected utility. I recommend reframing the central claim as providing initial evidence or suggesting potential, and explicitly distinguishing anticipated from observed collaborative interactions.","section":"Abstract; §5.1; §5.2; §7.4"},{"comment":"The second claimed new capability, 'linking specific details to the broader 360° context,' is not directly attributable to the artifacts Tangi creates. In F2, the authors note that this linking function was 'missing in the sphere-ish artifacts,' and participants addressed the shortcoming by creating external booklets, flags, magnetic notes, QR-code stickers, and other meta-frame additions (M1). Thus the data show that unmodified Tangi artifacts leave this capability lacking, and that users invent supplementary attachments to achieve it. Attributing the capability to 'the artifacts Tangi creates' conflates the tool's output with participants' modifications. The paper should either reframe this as a design requirement that emerged from the study, or provide evidence that the base artifacts themselves support the context-detail link without modification.","section":"§6, F2; §6, M1; Abstract"},{"comment":"The evaluation was designed, facilitated, and analyzed by the same team that built Tangi, with the lead researcher acting as a 'fellow designer' and guiding participants through reflection. While this is common in exploratory HCI tool evaluations, it raises a risk that the two 'new capabilities' are partly researcher-led framings rather than independent discoveries. For instance, the reflective prompts in §5.2 explicitly ask about functions unique to 360° video, and the lead researcher demonstrated pre-assembled artifacts before eliciting reactions. The paper would be strengthened by acknowledging this interpretive risk, reporting the specific prompts used, and ideally including independent coding or member checking to support the claimed themes.","section":"§5.2; §5.3; §6"}],"minor_comments":[{"comment":"The recruitment sentence is grammatically incomplete: 'We used snowball sampling to recruit participants (shown in Table 1) that to conduct a 2-3 hour in-person sessions...' should be rewritten.","section":"§5"},{"comment":"There is a duplicated word: 'both of which can can be quickly created with Tangi's online interface.'","section":"§4"},{"comment":"The sentence 'This tangibility also supports provides the practical benefits...' contains a typo ('supports provides').","section":"§3.1"},{"comment":"The phrase 'modify modify 360° video' contains a duplicated word.","section":"§7.1"},{"comment":"Typos: 'flexibilty' should be 'flexibility' and 'Therefor' should be 'Therefore.'","section":"§7.3.2"},{"comment":"'orthagonal' should be 'orthogonal.'","section":"§4.1"},{"comment":"Figure 10 is captioned 'geodesic octahedron artifact,' but the text consistently refers to the polyhedron as a 'cuboctahedron.' The caption and terminology should be made consistent.","section":"Appendix B"},{"comment":"The footnote text appears truncated and repeated: 'this term has been used by Ylirisku and Buur [51] to describe similar boundary objects made from video.' Should be cleaned up.","section":"Footnotes 2 and 4"}],"recommendation":"major_revision","confidential_remarks":"The paper is a reasonable systems/qualitative-evaluation submission for an HCI venue. The tool and the qualitative data are potentially useful, and the design-space framing is a strength. The main issue is that the abstract and contributions overclaim what one-on-one reflection sessions can show, especially regarding 'collaborative workshops' and the 'context-detail link' capability. These overclaims are correctable by softening the language and strengthening the interpretation of the qualitative evidence. I do not see a need for rejection; the central idea is sound and the manuscript's scope can accommodate the necessary revisions."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Colleague,\n\nThis is a solid HCI toolkit paper with an abstract that overstates the evidence. What's actually new: Tangi, a web tool that converts equirectangular 360° frames into paper cut-and-fold artifacts, with a flat variant that pairs a perspective view with a minimap. The projection onto polyhedra is known (they cite SAYA360, Hurbain, PazuCraft), but the flat-plus-minimap design and the empirical focus on design ethnography are the contributions. The study with nine experienced designers surfaces two candidate capabilities—spatial orientation in the 360° scene and linking specific details to the broader context—and the participant quotes and artifact photos give those ideas real substance.\n\nThe soft spot is the word “demonstrates.” Section 5.1 says the 2–3 hour sessions were one-on-one between the participant and the lead researcher; the researcher shared artifacts and guided reflection. No session involved multiple designers collaborating with each other. So the data support individual designers' judgments about expected utility, not observed collaborative workshop behavior. The authors' own limitations section (7.4) says they only had a limited number of designers for a single session and calls for future evaluation in different design contexts. The abstract's second claimed capability also has an attribution problem: participants invented external booklets, flags, and QR stickers to annotate the sphere-ish artifacts, so the context-detail link is more a need the tool surfaced than a capability the tool itself provides.\n\nOther weaknesses—small snowball sample, same-team analysis, no baseline comparison—are typical for early qualitative HCI and not fatal. The citation pattern is honest, and the paper is structured clearly. My recommendation: send it to peer review, but the authors should soften the abstract from “demonstrates” to “suggests” and ideally add a collaborative session or explicitly frame the findings as exploratory. The tool is open-source and the two capabilities are testable, which makes this worth referee time.","headline":"Useful tool paper with an overclaimed abstract: one-on-one reflection sessions are not evidence of collaborative workshops.","tokens_in":17569,"tokens_out":2778,"would_cite":false,"duration_ms":28049,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"A web tool converts 360° video frames into printable paper artifacts that support collaborative sense-making in design workshops, adding spatial orientation and detail-to-context linking.","keywords":["360° Video","Tangible Interaction","Video Design Ethnography","Contextual Inquiry","Boundary Objects","Collaborative Sense-Making","Paper Artifacts"],"falsifier":"Run real collaborative workshops with groups of three or more designers analyzing the same 360° video, half using Tangi artifacts and half using conventional flat screenshots or a shared VR view. If the Tangi teams show no systematic improvement in agreeing on spatial orientation and in linking details to the whole scene, or if groups ignore the facets and mini-map and treat the artifacts as flat images, the central claim fails.","tokens_in":16553,"feed_emoji":"📄","tokens_out":8589,"duration_ms":79416,"temperature":0.7,"pith_summary":"The paper argues that 360° video can be moved from the screen into collaborative design workshops by turning single frames into printable paper artifacts. The authors built Tangi, a web tool that converts equirectangular 360° frames into two classes of artifact: flat prints pairing an undistorted perspective view with a context mini-map, and sphere-ish cube or cuboctahedron cut-and-fold models that show the full spherical scene with modest distortion. In sessions with nine designers experienced with 360° video, the artifacts supported the pointing, rotating, annotating, and rearranging interactions that prior work identifies as essential to collaborative video analysis. The paper's new claims are two capabilities specific to 360°: artifacts give groups a shared spatial orientation in the spherical scene, and they let designers link a specific detail to the surrounding context. The authors present Tangi as an open-source starting point rather than a finished solution.","feed_headline":"360° video becomes tangible with foldable paper artifacts","feed_subtitle":"Nine designers used flat and polyhedral prints to orient themselves in 360° scenes and tie details to context.","key_machinery":"The central object is the Tangible 360° Frame artifact, generated by Tangi from a single equirectangular 360° frame, the standard flat format that maps the spherical image onto a rectangle. It comes in two classes: the flat artifact, which combines an undistorted perspective screenshot of the area of interest with a mini-map showing the full spherical context and cartographic graticules (a grid of lines that gives coordinate information) to orient the crop within the sphere, and the sphere-ish artifact, a cut-and-fold template of a cube or cuboctahedron (a polyhedron with square and triangular faces) onto which the full frame is projected. The mechanism that carries the argument is the projection onto a polyhedral net: it moves spherical visual information into the tangible domain without the severe distortion of a flat equirectangular print, and its facets give collaborators a shared set of sides for orienting discussion.","core_discovery":"Tangi demonstrates that the spherical format of 360° video does not have to be abandoned when designers leave the screen. By projecting a frame onto either a flat composite print or a foldable polyhedron, the tool produces tangible artifacts that retain the full visual context of the 360° scene while keeping distortion low enough to work with. The evaluation with nine experienced designers found that the artifacts enable the tangible interactions used in collaborative video analysis, and two new functions unique to 360° content: orientation, using the facets and mini-map to agree on spatial relations and direction, and context-detail linking, connecting a specific element to the wider scene. Participants also modified the paper artifacts into meta-frame booklets, multi-cube timelines, and motion-overlay models, which the authors read as evidence that paper-based 360° artifacts act as emergent boundary objects that adapt to a team's needs.","pith_inferences":["Beyond the paper's workshop framing, the orientation function suggests a testable use in multi-person training contexts, such as firefighter or medical instruction, where a group must agree on where in a 360° scene an event happened.","A natural next test is whether the two claimed capabilities survive in real multi-person workshops, since the evaluation was conducted one-on-one with the lead researcher acting as a design partner.","The participants' split reactions to the cube versus the cuboctahedron imply a measurable trade-off: cube artifacts may support faster detail-finding because they isolate single faces, while cuboctahedra may support a more holistic overview by inviting continuous rotation.","The design space the paper sketches, with spherical-flat and digital-tangible as axes, could serve as a coordinate system for classifying future artifact types beyond 360° video, such as tangible outputs from volumetric or panoramic recordings."],"forward_implications":["Design teams can run collaborative sense-making on 360° video without VR headsets or special displays, using paper prints that support pointing, annotation, and rearrangement.","The two new capabilities, orientation and context-detail linking, give tangible 360° artifacts a distinct advantage over conventional storyboards for spatially complex scenes such as cycling, orchestral performance, or emergency training.","Because the artifacts are paper, designers can quickly cut, fold, and annotate them, allowing a workshop's artifacts to evolve into bespoke boundary objects rather than remaining fixed outputs.","Paper artifacts persist after a session, so they can serve as documentation that later teams or stakeholders can re-engage with.","Open-sourcing Tangi lets practitioners generate and share new artifact types, supporting a community-driven exploration of tangible 360° video artifacts."],"supporting_citations":[{"why":"Defines Video Design Ethnography and the concept of video artifacts as boundary objects, the practice Tangi is designed to support.","marker":"[51]"},{"why":"Supplies the tangible interactions essential to collaborative video analysis that the evaluation checks against.","marker":"[6]"},{"why":"Establishes why tangible cards rather than digital tools support collaborative sense-making, the premise for paper artifacts.","marker":"[8]"},{"why":"Explains the affordances of tangible cards, including pointing, rotating, annotating, and persistence, that justify the paper's tangibility requirement.","marker":"[27]"},{"why":"Provides the emergent boundary objects concept used to interpret participants' modifications and evolving artifacts.","marker":"[9]"},{"why":"Generalizes the frame, meta-frame, and multi-frame artifact categories that Tangi's artifacts are designed to extend.","marker":"[14]"},{"why":"Earlier work identifying the challenges and opportunities of 360° video in collaborative design workshops, the problem Tangi addresses.","marker":"[30]"},{"why":"The original boundary objects theory that grounds the role of video artifacts in collaborative work.","marker":"[44]"}],"fun_headline_variants":["Foldable 360° video artifacts boost design workshops","Paper polyhedra turn 360° video into tangible data","Tangi prints 360° scenes for collaborative insight","360° insights, now tangible with Tangi","From screen to paper: Tangi makes 360° video graspable"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that one-on-one reflection sessions with the lead researcher can stand in for real multi-person design workshops, so the interactions observed with nine designers predict how the artifacts will function when a team shares, points, and negotiates around them.","fun_headline_variants_meta":{"raw":{"variants":["Foldable 360° video artifacts boost design workshops","Paper polyhedra turn 360° video into tangible data","Tangi prints 360° scenes for collaborative insight","360° insights, now tangible with Tangi","From screen to paper: Tangi makes 360° video graspable"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000622,"raw_usage":{"total_tokens":2865,"prompt_tokens":908,"completion_tokens":1957,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":524,"completion_tokens_details":{"reasoning_tokens":1876}},"tokens_in":524,"tokens_out":1957,"duration_ms":14024,"temperature":1.0,"reasoning_tokens":1876,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-12T19:51:26.302367+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run real collaborative workshops with groups of three or more designers analyzing the same 360° video, half using Tangi artifacts and half using conventional flat screenshots or a shared VR view. If the Tangi teams show no systematic improvement in agreeing on spatial orientation and in linking details to the whole scene, or if groups ignore the facets and mini-map and treat the artifacts as flat images, the central claim fails.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Defines Video Design Ethnography and the concept of video artifacts as boundary objects, the practice Tangi is designed to support."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the tangible interactions essential to collaborative video analysis that the evaluation checks against."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Explains the affordances of tangible cards, including pointing, rotating, annotating, and persistence, that justify the paper's tangibility requirement."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Provides the emergent boundary objects concept used to interpret participants' modifications and evolving artifacts."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Earlier work identifying the challenges and opportunities of 360° video in collaborative design workshops, the problem Tangi addresses."},{"cited_title":"Griesemer","cited_arxiv_id":null,"evidence_quote":"The original boundary objects theory that grounds the role of video artifacts in collaborative work."}],"review_version":1}