pith. sign in

arxiv: 2604.15330 · v1 · submitted 2026-03-09 · 💻 cs.HC

Making It Work Is the Work: Engineering Maturity as Epistemic Work

Danny Leen , Stig Konings , Raf Ramakers , Kris Luyten This is my paper

Pith reviewed 2026-05-15 15:27 UTC · model grok-4.3

classification 💻 cs.HC
keywords HCI fabricationengineering maturityepistemic worktransferabilityprototypingreproducibilitysystems researchFab-ilities
0
0 comments X

The pith

The knowledge needed to transfer HCI fabrication systems across materials, machines, and users rarely exists at publication because the engineering work to create it is not incentivized.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Many HCI fabrication prototypes look promising in papers but prove difficult to reuse, extend, or move beyond their original lab. The paper claims this happens because the concrete knowledge of how these systems behave with new materials, different machines, and varied users is almost never generated during the initial prototyping phase. That missing knowledge is produced only through sustained engineering effort, which the authors call epistemic work and which current incentives do not reward. They introduce six dimensions, called Fab-ilities, to name what parts of a fabrication artifact have become reliable and what parts remain unknown. Case studies from their own projects show how commercialization attempts and other dissemination efforts exposed these specific gaps between published prototypes and transferable systems.

Core claim

Engineering maturity is epistemic work: sustained effort that generates knowledge about how fabrication systems behave across different materials, machines, and users. This knowledge cannot be revealed by prototyping alone and is rarely produced because it is not incentivized or rewarded in research publication. The authors propose six Fab-ilities dimensions as a vocabulary to distinguish established knowledge from tacit gaps: buildability, executability, reliability, maintainability, transferability, and scalability. Their five projects illustrate how dissemination efforts repeatedly revealed that published prototypes lacked the maturity needed for transfer.

What carries the argument

The six Fab-ilities dimensions (buildability, executability, reliability, maintainability, transferability, scalability) as a vocabulary that distinguishes which aspects of a fabrication artifact have become established knowledge and which remain tacit.

If this is right

  • HCI fabrication research must treat sustained engineering effort as a distinct and necessary contribution rather than optional follow-up work.
  • Publication and funding incentives should explicitly reward the production of transferability knowledge across materials, machines, and users.
  • Attempts to disseminate prototypes through commercialization or spin-offs will continue to expose gaps unless the Fab-ilities dimensions are addressed during research.
  • Systems-oriented HCI can develop more reusable artifacts if engineering maturity is recognized as epistemic work that prototyping cannot replace.
  • The distinction between what is published and what is actually transferable applies to any fabrication system that must move beyond its original lab setting.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Research communities could create shared test protocols or benchmark suites that measure the six dimensions across different fabrication projects.
  • Funding programs might add dedicated maturation tracks that support engineering work after initial prototypes are published.
  • Similar gaps between prototyping and transferable knowledge likely exist in other areas of systems HCI such as tangible interfaces or interactive hardware.
  • Graduate training could include explicit practice in generating and documenting the behavioral knowledge required for transfer.

Load-bearing premise

The specific gaps observed in the authors five projects are representative of broader HCI fabrication work and the six dimensions capture the full range of epistemic work needed for transferability.

What would settle it

A systematic review of HCI fabrication papers that achieved successful transfer or commercialization without additional post-publication engineering effort to generate the missing behavioral knowledge.

Figures

Figures reproduced from arXiv: 2604.15330 by Danny Leen, Kris Luyten, Raf Ramakers, Stig Konings.

Figure 1
Figure 1. Figure 1: JigFab helps makers design and fabricate custom woodworking jigs. Commercialization exposed gaps in robustness, docu￾mentation, cross-context reliability, and multi-institution IP complexity [PITH_FULL_IMAGE:figures/full_fig_p005_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: StoryStick++ is a phone clip on for measuring and marking without mental arithmetic. Market research highlighted tacit build knowledge, unclear manufacturing effort, and missing cost and viability answers. StoryStick++[7] is a phone clip on that guides measuring and marking with minimal reliance on numbers, units, or mental arithmetic. This reduces common errors. StoryStick++ is currently in market researc… view at source ↗
Figure 3
Figure 3. Figure 3: Silicone Devices enables DIY stretchable electronics in cast silicone using a CO2 laser cutter and liquid metal. Transfer required process control and industrialization knowledge beyond the published workflow. valorization funding to attempt to set up a spin-off company on stretcheable electronics. We received funding for a two year trajectory to translate the technique into an industrial process. During t… view at source ↗
Figure 4
Figure 4. Figure 4: PaperPulse enables interactive paper devices with printed conductive traces. Valorization attempts surfaced high upfront costs, market uncertainty, and limited transfer when repositioning a user-specific HCI contribution. well suited as training material for students. However, that same complexity is also a barrier to use outside the lab. What is acceptable as open ended exploration in research and educati… view at source ↗
Figure 5
Figure 5. Figure 5: LamiFold embeds mechanisms by cutting and laminating stacked sheets, resulting in zero-effort assembly. Reproducibility is fragile because performance depends on tightly coupled machine and material parameters. 4 Conclusion HCI×fabrication has developed a comfortable hypocrisy. We regret that our prototypes do not reach the real world, yet we systematically devalue the very work that would make them travel… view at source ↗
read the original abstract

Many HCIxfabrication systems are compelling as prototypes but remain difficult to reuse, extend, or transfer beyond their original publication. A common explanation is that adoption simply takes time. We argue that the issue is more fundamental. The knowledge needed to make fabrication systems transferable, namely how they behave across different materials, machines, and users, usually does not exist at the time of publication because the work required to generate this knowledge is rarely incentivized or rewarded. Drawing on engineering epistemology and prior debates in systems-oriented HCI, we reframe engineering maturity as epistemic work: sustained engineering effort that produces knowledge which prototyping alone cannot reveal. We propose six dimensions, Fab-ilities, as a vocabulary to describe what aspects of fabrication artifacts have become established and what knowledge remains tacit: (1) buildability, (2) executability, (3) reliability, (4) maintainability, (5) transferability, and (6) scalability. We describe five of our own projects (JigFab, StoryStick++, Silicone Devices, LamiFold, and PaperPulse), where varied attempts at dissemination, such as commercialization, spin-offs, and market exploration, each exposed different gaps between what we published and what transfer actually required.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

1 major / 2 minor

Summary. The paper claims that HCI fabrication systems are often compelling as prototypes but difficult to reuse, extend, or transfer because the epistemic knowledge required for transferability—how systems behave across materials, machines, and users—usually does not exist at publication time, as the engineering work to generate it is rarely incentivized. It reframes engineering maturity as epistemic work drawing on engineering epistemology and prior HCI debates, and introduces six 'Fab-ilities' dimensions (buildability, executability, reliability, maintainability, transferability, scalability) as a vocabulary for what knowledge is established versus tacit. The argument is grounded in five detailed case studies from the authors' projects (JigFab, StoryStick++, Silicone Devices, LamiFold, PaperPulse) where dissemination attempts (commercialization, spin-offs) exposed specific gaps between published descriptions and transfer requirements.

Significance. If the argument holds, the paper offers a useful conceptual framework and vocabulary for addressing a systemic issue in HCI systems research: the under-incentivization of engineering effort beyond prototyping. The self-reflective case studies provide concrete illustrations that could influence how fabrication papers are reviewed and rewarded, building productively on established engineering epistemology without introducing free parameters or circular definitions.

major comments (1)
  1. [Section 5 (the five projects)] Section 5 (the five projects): The central claim that the required epistemic knowledge 'usually does not exist at the time of publication' is load-bearing on the representativeness of the five selected projects (JigFab, StoryStick++, etc.). These were chosen precisely because they involved dissemination attempts; without a broader sample, comparison set of non-dissemination papers, or explicit discussion of selection criteria, it remains unclear whether the observed gaps in the six Fab-ilities are typical of HCI fabrication work or an artifact of the sample.
minor comments (2)
  1. The six Fab-ilities dimensions are clearly motivated but would be easier to apply if presented in a summary table that also notes overlaps or distinctions with related terms from engineering literature.
  2. [Introduction] A few sentences in the introduction and discussion are long and could be split for readability; additionally, ensure all referenced prior HCI debates on systems work receive explicit citations in the related-work section.

Simulated Author's Rebuttal

1 responses · 0 unresolved

Thank you for the positive assessment of the paper and the recommendation for minor revision. We address the referee's concern about the representativeness of the case studies below.

read point-by-point responses

  1. Referee: Section 5 (the five projects): The central claim that the required epistemic knowledge 'usually does not exist at the time of publication' is load-bearing on the representativeness of the five selected projects (JigFab, StoryStick++, etc.). These were chosen precisely because they involved dissemination attempts; without a broader sample, comparison set of non-dissemination papers, or explicit discussion of selection criteria, it remains unclear whether the observed gaps in the six Fab-ilities are typical of HCI fabrication work or an artifact of the sample.

    Authors: We appreciate the referee's observation on this methodological point. The five projects were intentionally selected because they are the authors' own efforts in which dissemination beyond publication was actively pursued (commercialization, spin-offs, or market exploration). This choice enabled direct, first-hand reflection on the specific epistemic gaps that emerged only after publication. We acknowledge that this selection criterion may bias toward cases where transfer challenges were encountered and does not constitute a random or comprehensive sample of HCI fabrication papers. In the revised manuscript we will add an explicit paragraph at the start of Section 5 stating the selection rationale, clarifying that the cases are illustrative rather than representative, and noting this as a limitation of the work. We will also indicate that the Fab-ilities vocabulary is offered as an analytical lens that others can apply to additional projects. revision: partial

Circularity Check

0 steps flagged

No significant circularity in the derivation chain

full rationale

The paper derives its central claim—that transferable knowledge for fabrication systems usually does not exist at publication—from established engineering epistemology, prior systems-oriented HCI debates, and inductive observations across five independent projects (JigFab, StoryStick++, etc.). The six Fab-ilities dimensions are proposed as an organizing vocabulary for observed gaps rather than being defined in terms of one another or fitted to data. No step reduces by construction to its inputs, no self-citation is load-bearing for the uniqueness of the framework, and the argument remains self-contained against external benchmarks without tautological renaming or ansatz smuggling.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 1 invented entities

The paper introduces the six Fab-ilities as new descriptive entities and relies on the domain assumption that sustained engineering effort beyond prototyping is the primary missing ingredient for transferability, supported by the authors project experiences.

axioms (1)
  • domain assumption Engineering maturity requires sustained epistemic work beyond initial prototyping to generate transferable knowledge.
    Invoked as the central reframing drawn from engineering epistemology and prior HCI debates.
invented entities (1)
  • Fab-ilities (six dimensions) no independent evidence
    purpose: Vocabulary to distinguish established versus tacit aspects of fabrication artifacts.
    Newly proposed framework illustrated through case studies but without independent external validation.

pith-pipeline@v0.9.0 · 5524 in / 1318 out tokens · 41226 ms · 2026-05-15T15:27:05.754559+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

19 extracted references · 19 canonical work pages

  1. [1]

    Bill Buxton. 2008. The Long Nose of Innovation. https://www.billbuxton.com/longnose.pdf. Accessed: 2025-01-15

    work page 2008

  2. [2]

    -ilities

    Stéphane Chatty, Emmanuel Dubois, Laurence Nigay, and Jean Vanderdonckt. 2015. Towards an Interaction Engineering Glossary and a Repository for Interactive Software "-ilities"

    work page 2015

  3. [3]

    1999.Refactoring: Improving the Design of Existing Code

    Martin Fowler. 1999.Refactoring: Improving the Design of Existing Code. Addison-Wesley, Boston, MA, USA

    work page 1999

  4. [4]

    Saul Greenberg and Bill Buxton. 2008. Usability evaluation considered harmful (some of the time). InProceedings of the SIGCHI Conference on Human Factors in Computing Systems(Florence, Italy)(CHI ’08). Association for Computing Machinery, New York, NY, USA, 111–120. doi:10.1145/1357054. 1357074

    work page doi:10.1145/1357054 2008

  5. [5]

    Instructables. [n. d.].Silicone Devices. https://www.instructables.com/Silicone-Devices/ Instructables tutorial (accessed 2026-03-04)

    work page 2026

  6. [6]

    Jofish Kaye. 2009. I Give Up on CHI/UIST. https://dubfuture.blogspot.com/2009/11/i-give-up-on-chiuist.html. Accessed: 2025-01-15. Manuscript submitted to ACM Making It Work Is the Work: Engineering Maturity as Epistemic Work 9

    work page 2009

  7. [7]

    Stig Konings, Maties Claesen, Danny Leen, Mannu Lambrichts, Xander Vaes, and Raf Ramakers. 2026. StoryStick++. InProceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26). ACM. To appear

    work page 2026

  8. [8]

    David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. InProceedings of the 2018 CHI Conference on Human Factors in Computing Systems(Montreal QC, Canada)(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–17. doi:10.1145/3173574.3173610

    work page doi:10.1145/3173574.3173610 2018

  9. [9]

    Danny Leen, Nadya Peek, and Raf Ramakers. 2020. LamiFold: Fabricating Objects with Integrated Mechanisms Using a Laser cutter Lamination Workflow. InProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology(Virtual Event, USA)(UIST ’20). Association for Computing Machinery, New York, NY, USA, 304–316. doi:10.1145/3379337.3415885

    work page doi:10.1145/3379337.3415885 2020

  10. [10]

    Danny Leen, Tom Veuskens, Kris Luyten, and Raf Ramakers. 2019. JigFab: Computational Fabrication of Constraints to Facilitate Woodworking with Power Tools. InProceedings of the 2019 CHI Conference on Human Factors in Computing Systems(Glasgow, Scotland Uk)(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. doi:10.1145/3290605.3300386

    work page doi:10.1145/3290605.3300386 2019

  11. [11]

    Steven Nagels, Raf Ramakers, Kris Luyten, and Wim Deferme. 2018. Silicone Devices: A Scalable DIY Approach for Fabricating Self-Contained Multi-Layered Soft Circuits using Microfluidics. InProceedings of the 2018 CHI Conference on Human Factors in Computing Systems(Montreal QC, Canada)(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13...

    work page doi:10.1145/3173574.3173762 2018

  12. [12]

    Dan R. Olsen. 2007. Evaluating user interface systems research. InProceedings of the 20th Annual ACM Symposium on User Interface Software and Technology(Newport, Rhode Island, USA)(UIST ’07). Association for Computing Machinery, New York, NY, USA, 251–258. doi:10.1145/1294211. 1294256

    work page doi:10.1145/1294211 2007

  13. [13]

    Open Source Hardware Association. 2012. Open Source Hardware (OSHW) Definition 1.0. https://www.oshwa.org/definition/. Accessed: 2025-01-15

    work page 2012

  14. [14]

    Raf Ramakers, Kashyap Todi, and Kris Luyten. 2015. PaperPulse: An Integrated Approach for Embedding Electronics in Paper Designs. InProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(Seoul, Republic of Korea)(CHI ’15). Association for Computing Machinery, New York, NY, USA, 2457–2466. doi:10.1145/2702123.2702487

    work page doi:10.1145/2702123.2702487 2015

  15. [15]

    Raf Ramakers, Kashyap Todi, and Kris Luyten. 2015. PaperPulse: An integrated approach for embedding electronics in paper designs. InSpecial interest group on computer graphics and interactive techniques conference, SIGGRAPH ’15, los angeles, CA, USA, august 9-13, 2015, studio. ACM, 3:1. doi:10.1145/2785585.2792694

    work page doi:10.1145/2785585.2792694 2015

  16. [16]

    Valkyrie Savage, Harrison Goldstein, Nóra Püsök, Jia Yi Ren, Bhaskar Dutt, Chandrakana Nandi, and Lora Oehlberg. 2025. FEDT: Supporting experiment design and execution in HCI fabrication research. InProceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST ’25). Association for Computing Machinery, New York, NY, USA, Art...

    work page doi:10.1145/3746059.3747739 2025

  17. [17]

    Vincenti

    W.G. Vincenti. 1990.What Engineers Know and How They Know It: Analytical Studies from Aeronautical History. Johns Hopkins University Press. https://books.google.be/books?id=5XNTAAAAMAAJ

    work page 1990

  18. [18]

    Wilson, Ed H

    Max L. Wilson, Ed H. Chi, Stuart Reeves, and David Coyle. 2014. RepliCHI: the workshop II. InCHI ’14 Extended Abstracts on Human Factors in Computing Systems(Toronto, Ontario, Canada)(CHI EA ’14). Association for Computing Machinery, New York, NY, USA, 33–36. doi:10.1145/ 2559206.2559233

    work page arXiv 2014

  19. [19]

    Wobbrock and Julie A

    Jacob O. Wobbrock and Julie A. Kientz. 2016. Research contributions in human-computer interaction.Interactions23, 3 (April 2016), 38–44. doi:10.1145/2907069 Manuscript submitted to ACM

    work page doi:10.1145/2907069 2016