arxiv: 2604.11538 · v1 · submitted 2026-04-13 · 💻 cs.HC

Recognition: unknown

ResearchCube: Multi-Dimensional Trade-off Exploration for Research Ideation

Fenghai Li, Joel Chan, Zijian Ding, Ziyi Wang

Authors on Pith no claims yet

Pith reviewed 2026-05-10 15:52 UTC · model grok-4.3

classification 💻 cs.HC

keywords research ideationbipolar dimensions3D visualizationspatial interactiontrade-off explorationAI-assisted toolshuman-computer interactioncognitive scaffolding

0 comments

The pith

ResearchCube represents ideas as draggable points inside a 3D cube whose axes are user-chosen bipolar trade-off spectra rather than one-sided scales.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents a system that turns research ideation into spatial navigation across multiple evaluative dimensions by letting users define up to three bipolar axes and place candidate ideas as points inside the resulting cube. Bipolar pairs such as theory-driven versus data-driven replace unipolar scales and serve as external scaffolds that reduce the mental effort of juggling trade-offs. Four direct-manipulation techniques allow researchers to generate dimensions, navigate the cube, steer ideas by dragging, and synthesize new points from existing ones. A study with eleven researchers found that the spatial view created a stronger sense of agency than text-only chatbots and that participants wanted easy ways to move between one, two, three, or more dimensions. The work concludes with design implications for keeping AI suggestions visible yet subordinate to user control.

Core claim

By re-expressing evaluation dimensions as bipolar spectra and rendering ideas as movable points in a three-dimensional space, ResearchCube lets researchers explore and refine multi-dimensional trade-offs through direct spatial interaction instead of sequential text prompts, externalizing evaluative reasoning and restoring user agency over the ideation process.

What carries the argument

The user-constructed 3D evaluation cube whose axes are bipolar dimension pairs, with ideas shown as manipulable points and supported by AI-suggested dimensions plus four spatial interactions: dimension generation, face-snapping navigation, drag-based steering, and drag-based synthesis.

Load-bearing premise

The observed benefits of bipolar spatial representation will generalize beyond the eleven participants, across research domains, and will produce better actual research outcomes rather than merely different interaction experiences.

What would settle it

A between-subjects experiment that measures whether participants using the cube generate research ideas rated higher on novelty, feasibility, and explicit trade-off coverage than participants using a comparable text-only chatbot, with the same starting prompt and time limit.

Figures

Figures reproduced from arXiv: 2604.11538 by Fenghai Li, Joel Chan, Zijian Ding, Ziyi Wang.

**Figure 1.** Figure 1: ResearchCube renders research ideas as interactive nodes in a 3D evaluation space. Each axis represents a user-selected [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗

**Figure 2.** Figure 2: Usage senario of ResearchCube’s four primary interactions, using data from P02 exploring “wearable data for health [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗

read the original abstract

Research ideation requires navigating trade-offs across multiple evaluative dimensions, yet most AI-assisted ideation tools leave this multi-dimensional reasoning unsupported, or reducing evaluation to unipolar scales where "more is better". We present ResearchCube, a system that reframes evaluation dimensions as bipolar trade-off spectra (e.g., theory-driven vs. data-driven) and renders research ideas as manipulable points in a user-constructed 3D evaluation space. Given a research intent, the system proposes candidate bipolar dimension pairs; users select up to three to define the axes of a personalized evaluation cube. Four spatial interactions -- AI-scaffolded dimension generation, 3D navigation with face snapping, drag-based idea steering, and drag-based synthesis -- enable researchers to explore and refine ideas through direct manipulation rather than text prompts. A qualitative study with 11 researchers revealed that (1) bipolar dimensions served as cognitive scaffolds that externalized evaluative thinking and offloaded working memory, (2) the spatial representation provided a sense of agency absent in chatbot-based AI tools, (3) participants desired fluid transitions across dimensionality levels -- from single-dimension focus to more than three dimensions, and (4) a productive tension emerged between AI-suggested starting dimensions and users' evolving desire for control. We distill these findings into design implications for multi-dimensional research ideation tools, including progressive dimensional control, fluid dimensionality, and transparent synthesis with provenance.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

ResearchCube presents a spatial 3D cube for multi-dimensional research ideation with four new interactions, supported by modest qualitative feedback from 11 users.

read the letter

This paper introduces ResearchCube, a system for exploring research ideas in a 3D cube built from user-selected bipolar dimensions. The punchline is that it offers a spatial way to handle trade-offs instead of reducing everything to single scales or relying on text chats. The new part is the combination of features: the system suggests bipolar pairs based on intent, users pick up to three to form the cube, then they navigate with snapping to faces, drag ideas to steer them along dimensions, and drag to synthesize new ideas from existing ones. This direct manipulation approach is described clearly and seems like a step beyond existing ideation tools. The study with 11 researchers provides some useful observations. People reported that the dimensions acted as scaffolds for thinking through pros and cons, and the 3D space gave them a sense of agency they didn't get from chatbots. They also wanted options to move between different numbers of dimensions easily. The soft spots are in the evaluation. With only 11 participants in single sessions and no baseline comparisons or objective metrics like idea quality ratings, the findings on cognitive offloading and agency are based purely on self-reports. This makes it hard to know how much is due to the design versus just trying something new, and whether it leads to better research ideas in practice. This is for HCI folks working on AI tools for creative and knowledge work. A reader interested in spatial interfaces or multi-dimensional decision support would pick up some design ideas from the implications section. The work shows honest engagement with how users actually interact with such systems. It deserves peer review because the core idea is fresh and the observations point to practical design directions, even if more evidence would strengthen it. I would send it to referees.

Referee Report

2 major / 1 minor

Summary. The paper introduces ResearchCube, an interactive system that represents research ideas as points in a user-defined 3D space whose axes are bipolar trade-off dimensions (e.g., theory-driven vs. data-driven). Users select up to three such dimensions proposed by the AI, then explore and refine ideas via four spatial interactions: AI-scaffolded dimension generation, 3D navigation with face snapping, drag-based idea steering, and drag-based synthesis. A qualitative study with 11 researchers reports that bipolar axes externalized evaluative thinking and offloaded working memory, that the spatial representation conferred a sense of agency missing from chatbot interfaces, that participants wanted fluid transitions across dimensionality levels, and that a tension existed between AI-suggested dimensions and user control; the authors distill these observations into design implications for progressive dimensional control, fluid dimensionality, and transparent synthesis.

Significance. If the reported user experiences generalize, the work supplies concrete evidence that spatial, multi-dimensional representations can scaffold complex evaluative reasoning in research ideation more effectively than linear text-based AI tools. The emphasis on bipolar spectra rather than unipolar scales and the call for fluid dimensionality transitions offer actionable design guidance for the HCI community working on human-AI co-ideation systems.

major comments (2)

[Abstract / Evaluation] Abstract and Evaluation section: the abstract supplies no information on participant recruitment, interview protocol, analysis method, or inter-rater reliability, and the provided manuscript excerpt likewise omits these details; without them the strength of the four thematic findings on cognitive scaffolding and agency cannot be assessed.
[Evaluation] Evaluation section: the claims that bipolar dimensions externalized thinking and that 3D manipulation uniquely provided agency rest entirely on single-session self-reports from 11 participants; the absence of a baseline condition, pre/post cognitive-load instruments, or expert-rated idea quality leaves open whether the observed benefits exceed novelty effects or translate into better research outputs.

minor comments (1)

[Abstract] The abstract states that four spatial interactions are provided but does not enumerate them; a brief parenthetical list would improve immediate readability.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive feedback on our evaluation and abstract. We address each major comment below, proposing targeted revisions to improve clarity and transparency while preserving the exploratory qualitative nature of the work.

read point-by-point responses

Referee: [Abstract / Evaluation] Abstract and Evaluation section: the abstract supplies no information on participant recruitment, interview protocol, analysis method, or inter-rater reliability, and the provided manuscript excerpt likewise omits these details; without them the strength of the four thematic findings on cognitive scaffolding and agency cannot be assessed.

Authors: We agree that the abstract and Evaluation section require additional methodological details to allow readers to assess the findings. In the revised manuscript, we will expand the abstract to include a concise description of the study (qualitative with 11 researchers recruited via university mailing lists and personal networks, semi-structured interviews lasting 45-60 minutes, and inductive thematic analysis). The Evaluation section will be updated with a dedicated Methods subsection detailing the interview protocol (e.g., think-aloud tasks followed by debrief questions on cognitive processes and agency), analysis approach (following Braun & Clarke's six-phase thematic analysis with team discussions for consensus), and clarification that formal inter-rater reliability was not calculated as the analysis was interpretive rather than quantitative. These changes will strengthen the manuscript without altering the study design. revision: yes
Referee: [Evaluation] Evaluation section: the claims that bipolar dimensions externalized thinking and that 3D manipulation uniquely provided agency rest entirely on single-session self-reports from 11 participants; the absence of a baseline condition, pre/post cognitive-load instruments, or expert-rated idea quality leaves open whether the observed benefits exceed novelty effects or translate into better research outputs.

Authors: We acknowledge that the study is exploratory and qualitative, relying on single-session self-reports and observations from 11 participants without a baseline condition, standardized cognitive-load measures, or external expert ratings of idea quality. This design was chosen to prioritize depth in understanding novel spatial interactions rather than comparative quantification. We cannot retroactively introduce a baseline or quantitative instruments to the existing data. However, we will add an explicit Limitations subsection in the revised Evaluation or Discussion to address potential novelty effects, the self-report basis of claims, and the need for future controlled studies measuring research output quality. We will also moderate language in the findings to frame them as participant-reported experiences supported by quotes and session observations, while retaining the design implications as valuable for the HCI community. revision: partial

Circularity Check

0 steps flagged

No circularity; system description and qualitative findings rest on direct observations without derivations or self-referential reductions

full rationale

The paper presents ResearchCube as an interactive system for multi-dimensional research ideation and reports thematic findings from a qualitative study with 11 researchers. No equations, fitted parameters, predictions, or mathematical derivations exist in the provided text. Claims about bipolar dimensions as cognitive scaffolds, spatial agency, and design implications are stated as outcomes of participant interviews and analysis, not reduced by construction to prior inputs or self-citations. No load-bearing self-citation chains, ansatzes, or renamings of known results appear; the work is self-contained as an empirical HCI contribution.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The work rests on the domain assumption that bipolar trade-off spectra are a natural and useful way to represent research evaluation criteria; no free parameters, mathematical axioms, or invented physical entities are introduced.

axioms (1)

domain assumption Bipolar dimensions effectively capture the evaluative trade-offs researchers navigate during ideation
This premise underpins the choice of axes, the AI dimension suggestion feature, and the interpretation of study results.

pith-pipeline@v0.9.0 · 5550 in / 1328 out tokens · 43527 ms · 2026-05-10T15:52:26.577089+00:00 · methodology

discussion (0)

Reference graph

Works this paper leans on

30 extracted references · 19 canonical work pages

[1]

Jinheon Baek, Sujay Kumar Jauhar, Silviu Cucerzan, and Sung Ju Hwang
[2]

arXiv preprint arXiv:2404.07738

ResearchAgent: Iterative Research Idea Generation over Scientific Lit- erature with Large Language Models. https://doi.org/10.48550/arXiv.2404.07738 arXiv:2404.07738 [cs]

work page doi:10.48550/arxiv.2404.07738
[3]

Kortum, and James T

Aaron Bangor, Philip T. Kortum, and James T. Miller. 2009. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale.Journal of Usability Studies4, 3 (2009), 114–123

2009
[4]

Virginia Braun and Victoria Clarke. 2006. Using Thematic Analysis in Psychology. Qualitative Research in Psychology3, 2 (2006), 77–101. https://doi.org/10.1191/ 1478088706qp063oa

2006
[5]

John Brooke. [n.d.]. SUS - A quick and dirty usability scale. ([n. d.])
[6]

Joel Chan, Zijian Ding, Eesh Kamrah, and Mark Fuge. 2024. Formulating or Fixating: Effects of Examples on Problem Solving Vary as a Function of Exam- ple Presentation Interface Design. https://doi.org/10.48550/arXiv.2401.11022 arXiv:2401.11022 [cs]

work page doi:10.48550/arxiv.2401.11022 2024
[7]

John Joon Young Chung and Max Kreminski. 2024. Patchview: LLM-powered Worldbuilding with Generative Dust and Magnet Visualization. InProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology. ACM, Pittsburgh PA USA, 1–19. https://doi.org/10.1145/3654777.3676352

work page doi:10.1145/3654777.3676352 2024
[8]

John Joon Young Chung, Melissa Roemmele, and Max Kreminski. 2025. Toyteller: AI-powered Visual Storytelling Through Toy-Playing with Character Symbols. https://doi.org/10.1145/3706598.3713435 arXiv:2501.13284 [cs]

work page doi:10.1145/3706598.3713435 2025
[9]

Zijian Ding, Fenghai Li, Haofei Yu, and Joel Chan. 2025. Towards Direct Intent Manipulation: Drag-Based Research Ideation, Evaluation and Evolution. InThe 38th Annual ACM Symposium on User Interface Software and Technology (UIST Adjunct ’25). ACM, New York, NY, USA, 1–3. https://doi.org/10.1145/3746058. 3758453

work page doi:10.1145/3746058 2025
[10]

Dow, Alana Glassco, Jonathan Kass, Melissa Schwarz, Daniel L

Steven P. Dow, Alana Glassco, Jonathan Kass, Melissa Schwarz, Daniel L. Schwartz, and Scott R. Klemmer. 2010. Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-efficacy.ACM Trans. Comput.-Hum. Interact.17, 4 (Dec. 2010), 18:1–18:24. https://doi.org/10.1145/1879831.1879836

work page doi:10.1145/1879831.1879836 2010
[11]

Alex Endert, Patrick Fiaux, and Chris North. 2012. Semantic Interaction for Visual Text Analytics. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). ACM, New York, NY, USA, 473–482. https: //doi.org/10.1145/2207676.2207741

work page doi:10.1145/2207676.2207741 2012
[12]

2004.Conceptual spaces: The geometry of thought

Peter Gardenfors. 2004.Conceptual spaces: The geometry of thought. MIT press

2004
[13]

Jeffrey Heer. 2019. Agency plus automation: Designing artificial intelligence into interactive systems.Proceedings of the National Academy of Sciences116, 6 (Feb. 2019), 1844–1850. https://doi.org/10.1073/pnas.1807184115

work page doi:10.1073/pnas.1807184115 2019
[14]

Hutchins, James D

Edwin L. Hutchins, James D. Hollan, and Donald A. Norman. 1985. Direct Manipulation Interfaces.Human–Computer Interaction1, 4 (Dec. 1985), 311–338. https://doi.org/10.1207/s15327051hci0104_2 Publisher: Taylor & Francis _eprint: https://doi.org/10.1207/s15327051hci0104_2

work page doi:10.1207/s15327051hci0104_2 1985
[15]

Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael S

Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ash- win Paranjape, Ines Gerard-Ursin, Xiang Lisa Li, Faisal Ladhak, Frieda Rong, Rose E. Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael Bernstein, and Percy Liang. 2024. Evaluating Human- Language Model Interaction.Transactions on Machine Learning R...

work page arXiv 2024
[16]

Jingyi Li, Eric Rawn, Jacob Ritchie, Jasper Tran O’Leary, and Sean Follmer. 2023. Beyond the Artifact: Power as a Lens for Creativity Support Tools. InProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. ACM. https://doi.org/10.1145/3586183.3606831

work page doi:10.1145/3586183.3606831 2023
[17]

Bryan Min, Allen Chen, Yining Cao, and Haijun Xia. 2025. Malleable Overview- Detail Interfaces. InProceedings of the 2025 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–25. https://doi.org/10.1145/ 3706598.3714164

work page arXiv 2025
[18]

Kevin Pu, K. J. Kevin Feng, Tovi Grossman, Tom Hope, Bhavana Dalvi Mishra, Matt Latzke, Jonathan Bragg, Joseph Chee Chang, and Pao Siangliulue. 2024. IdeaSynth: Iterative Research Idea Development Through Evolving and Compos- ing Idea Facets with Literature-Grounded Feedback. https://doi.org/10.48550/ arXiv.2410.04025 arXiv:2410.04025 [cs]

work page arXiv 2024
[19]

Marissa Radensky, Simra Shahid, Raymond Fok, Pao Siangliulue, Tom Hope, and Daniel S. Weld. 2025. Scideator: Human-LLM Scientific Idea Generation Grounded in Research-Paper Facet Recombination. https://doi.org/10.48550/ arXiv.2409.14634 arXiv:2409.14634 [cs]

work page arXiv 2025
[20]

Arvind Satyanarayan and Graham M. Jones. 2024. Intelligence as Agency: Eval- uating the Capacity of Generative AI to Empower or Constrain Human Action. An MIT Exploration of Generative AI(2024). https://mit-genai.pubpub.org/pub/ 94y6e0f8/release/2

2024
[21]

Jeff Sauro and James R. Lewis. 2016. Quantifying the User Experience: Practical Statistics for User Research. (2016)

2016
[22]

Ben Shneiderman. 1982. The future of interactive systems and the emergence of direct manipulation.Behaviour & Information Technology1, 3 (1982), 237–256

1982
[23]

Chenglei Si, Diyi Yang, and Tatsunori Hashimoto. 2024. Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers. http://arxiv.org/abs/2409.04109 arXiv:2409.04109 [cs]

work page arXiv 2024
[24]

Arvind Srinivasan and Joel Chan. 2024. Improving Selection of Analogical Inspira- tions through Chunking and Recombination. InProceedings of the 16th Conference on Creativity & Cognition (C&C ’24). Association for Computing Machinery, New York, NY, USA, 374–397. https://doi.org/10.1145/3635636.3656207

work page doi:10.1145/3635636.3656207 2024
[25]

Sangho Suh, Meng Chen, Bryan Min, Toby Jia-Jun Li, and Haijun Xia. 2024. Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation. InProceedings of the CHI Confer- ence on Human Factors in Computing Systems. 1–26. https://doi.org/10.1145/ 3613904.3642400 arXiv:2310.12953 [cs]

work page arXiv 2024
[26]

Sangho Suh, Hai Dang, Ryan Yen, Josh Pollock, Ian Arawjo, Rubaiat Habib Kazi, Hariharan Subramonyam, Jingyi Li, Nazmus Saquib, and Arvind Satyanarayan
[27]

InAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology

Dynamic Abstractions: Building the Next Generation of Cognitive Tools and Interfaces. InAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology. ACM. https://doi.org/10.1145/3672539.3686706

work page doi:10.1145/3672539.3686706
[28]

Sangho Suh, Bryan Min, Srishti Palani, and Haijun Xia. 2023. Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models. InProceed- ings of the 36th Annual ACM Symposium on User Interface Software and Technology. ACM, San Francisco CA USA, 1–18. https://doi.org/10.1145/3586183.3606756

work page doi:10.1145/3586183.3606756 2023
[29]

Zonglin Yang, Xinya Du, Junxian Li, Jie Zheng, Soujanya Poria, and Erik Cambria
[30]

Name”, “Title

Large Language Models for Automated Open-domain Scientific Hypotheses Discovery. InFindings of the Association for Computational Linguistics: ACL 2024, Lun-Wei Ku, Andre Martins, and Vivek Srikumar (Eds.). Association for Computational Linguistics, Bangkok, Thailand, 13545–13565. https://doi.org/10. 18653/v1/2024.findings-acl.804 11 Zijian Ding, Fenghai L...

2024