{"id":"f646856e-d2a4-4362-8d05-5161e90d31ac","arxiv_id":"2502.09169","paper_version":1,"verdict":"ACCEPT","confidence":"HIGH","novelty_score":4.0,"correctness_risk":"low","formal_verification":"none","parameter_count":0,"one_line_summary":"A review of citizen science quantum games that attributes the field's development to serious game use, quantum computer evolution, and Quantum Game Jams.","lead":"This paper surveys quantum physics games designed for citizen science, identifying eleven discontinued projects. It organizes the field around three driving forces: serious applications, quantum computer evolution, and open game development events.","discovery_kind":"review","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The abstract's claim that citizen science is woven into all three driving forces is not supported for the quantum-computer force; §3.2 offers only one speculative, never-implemented example.","rationale":"The reader's weakest assumption concerned the completeness and representativeness of the game list, particularly the acknowledged Western-language bias. That is a valid external-scope limitation. My concern is different and more internal: even within the author's own selection, the evidence for citizen science's influence on one of the three claimed driving forces is thin. The paper is honest about this, saying that few realisations exist on quantum computers and that Quantum Awesomeness was not developed with a concrete citizen science problem. However, the abstract and conclusions do not carry that caveat forward; they assert citizen science plays an influential role in all three aspects. This is a mismatch between the evidence presented and the central claim as stated. The paper's contribution as a historical review and design-resource summary remains solid, and the issue is repairable by qualifying the claim. Therefore I do not recommend rejection; a conditional acceptance with a revision to the abstract and conclusions is appropriate. A focused enumeration of quantum-computer games would settle whether the concern is only about wording or reflects a genuine gap in the claimed framework.","tokens_in":17878,"tokens_out":3591,"duration_ms":38362,"concrete_test":"Enumerate every quantum-computer or quantum-simulator game from the author's own List of Quantum Games [16] and the cited histories [11,44]; classify each by whether it (a) was designed with a citizen science purpose, (b) actually collected public gameplay data used in a published analysis, or (c) only had speculative potential. Also inspect Wootton's benchmarking papers [97,99] and the Quantum Awesomeness repository [101] to determine whether any player-generated circuits were actually submitted and used. If the count for (a) or (b) among quantum-computer games is zero or one, and Quantum Awesomeness falls in category (c), then the abstract should be revised to describe citizen science's role in the quantum-computer force as potential or emerging rather than established.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The central claim of the paper is that the quantum games landscape is shaped by three driving forces and that citizen science plays an influential role in all three. The weakest of these three branches is 'the evolution of quantum computers.' Section 3.2 itself states: 'For the use of citizen science, not many realisations have existed that run on a quantum computer.' The only quantum-computer candidate presented, Quantum Awesomeness, was 'proposed also as a benchmarking tool' but the author adds that 'no specific problems suitable for citizen science engagement were identified during its development' and that the possibility of revival is 'currently uncertain.' The first games on quantum computers, Rock-Paper-Scissors and Battleship, were not citizen science projects. Thus, the evidence that the quantum-computer force is shaped by citizen science is a single hypothetical benchmarking idea rather than an observed, implemented citizen science contribution. Because the abstract asserts citizen science plays an influential role in all three forces, this overstatement weakens the central observation, even though the review remains valuable as a historical synthesis.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper is a narrative review of quantum-physics-related games, focusing on citizen science quantum games and their historical development. It adopts a previously published definition of quantum games, documents eleven citizen science quantum games and prototypes plus one crowdsourcing platform and one interactive art installation, and organizes the landscape around three 'driving forces': serious games, the evolution of quantum computers, and Quantum Game Jams. The author claims that citizen science is influential in all three forces, discusses design guidelines, and outlines future directions involving hybrid intelligence and open access quantum computers.","tokens_in":18055,"tokens_out":7054,"duration_ms":63562,"significance":"The paper offers a valuable, carefully referenced historical synthesis of a small but active niche at the intersection of citizen science, quantum physics, and game design. Its strengths include the detailed game-by-game documentation, the explicit acknowledgment of source limitations such as Western-language bias and non-archived web materials, and the connection to existing design guidelines. The three-forces framework is a plausible and useful interpretive lens for organizing the field's history. The main weakness is that the abstract and conclusions overstate the role of citizen science in the quantum-computer force, while the body itself acknowledges that almost no implemented citizen science games exist on quantum computers.","major_comments":[{"comment":"The claim that 'citizen science plays an influential role in all three aspects' is not supported for the quantum-computer force. Section 3.2 explicitly states that 'For the use of citizen science, not many realisations have existed that run on a quantum computer.' The only candidate, Quantum Awesomeness, is described as having been 'proposed also as a benchmarking tool,' but the paper also says 'no specific problems suitable for citizen science engagement were identified during its development' and that its revival is 'currently uncertain.' The first games on quantum computers, Rock-Paper-Scissors and Battleship, are presented without any citizen science component. Because the abstract and conclusions present citizen science as woven into all three driving forces, this is a load-bearing overstatement. Please revise the abstract and conclusions to distinguish the well-supported claim that the evolution of quantum computers is a driving force for quantum games from the much weaker claim that citizen science has shaped this force; the latter should be framed as prospective or potential rather than influential.","section":"Abstract, §3.2, §6"}],"minor_comments":[{"comment":"The sentence 'These citizen science games on quantum physics were able to reach millions of players world-wide' is not supported by the cited sources; the only participant number given in the paper is 100,000 for The BIG Bell Quest. Please add a citation or qualify the claim.","section":"§4"},{"comment":"The acknowledgment that 'The available literature and resources, particularly those accessible for review, are primarily in Western languages' is commendable and important; consider moving this caveat to the Introduction or Abstract so that readers encounter it before the main analysis.","section":"§4"},{"comment":"The sentence 'Today, there exists over three hundred games that reference quantum physics' should be 'there exist'; similarly, 'Nowadayssecond generation quantum technologies' is missing a space.","section":"§1"},{"comment":"The caption contains 'the 20 qubit QS1 1 device,' which appears to be a typo; please correct it to 'QS1 1' or the intended device name.","section":"Fig. 5 caption"},{"comment":"Reference [102] lists '(2010)' as the year, which is inconsistent with the blog post's topic and the stated access date of 21st December 2023; please correct the year.","section":"References"},{"comment":"The Data Availability Statement cites 'The List of Quantum Games' at a personal website; for long-term accessibility, please consider adding an archived version, a DOI, or a versioned identifier.","section":"Data Availability Statement"}],"recommendation":"major_revision","confidential_remarks":"The paper is strongly grounded in the author's own prior work: the definition of quantum games, the List of Quantum Games, and the Quantum Game Jam records all originate from the same research group. This is not disqualifying for a review paper, but the editor may want to consider whether the framing is sufficiently independent. Several key sources are personal communications or non-archived web pages, which may affect long-term verifiability. The Western-language bias is acknowledged but may limit the generalizability of the three-forces framework; this is acceptable if presented as a scope limitation. The central overstatement about citizen science's role in the quantum-computer force is fixable by softening the claim in the abstract and conclusions."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Short version: this is a solid, unpretentious review. Its real contribution is gathering eleven citizen-science quantum games and prototypes into one timeline and framing the field with three driving forces. If you work on quantum games or citizen science, this saves you a lot of digging. The author also does something rare: she reports on discontinued projects and says why they stopped. That alone is worth the read.\n\nThe new part is the three-force framing — serious games, quantum computer development, and Quantum Game Jams — not new data or theory. That's fine for a review. The descriptive claims are sourced across academic papers, blogs, and personal communications, and the limitations are acknowledged up front: Western-language bias, informal sources, and the fact that all projects are discontinued. I don't see a circularity problem that matters: reusing the author's own 2022 definition of quantum games and her own list is reasonable for continuity, and each game is independently described.\n\nWhere the paper is soft: the abstract says citizen science plays an influential role in all three driving forces. For the quantum-computer force, that is not actually shown. Section 3.2 admits not many realisations exist that run on a quantum computer. The only candidate is Quantum Awesomeness, which was proposed as a benchmarking tool but never had specific citizen-science problems identified and whose revival is uncertain. The first games on quantum computers, Rock-Paper-Scissors and Battleship, were not citizen science. So the citizen science connection to the quantum-computer force is one hypothetical, not an observed pattern. The three-forces framework survives, but the claim should be softened to say citizen science is central to two forces and a speculative possibility in the third.\n\nMinor point: some statuses rely on non-archived web sources and personal communication, so a few facts will be hard to verify later. The author flags this; it is a minor issue for a review of this kind.\n\nWho is this for? Researchers or designers working on quantum games or citizen-science game design. It is not a paper that changes practice, but it is a fair, careful map of a small field, and it treats failures as informative. I would send it to peer review; with the abstract fixed, it should be accepted. The stress-test concern is real and should be relayed to the author.","headline":"A genuinely useful review of citizen-science quantum games; the three-forces framing is valuable, but the abstract overstates citizen science's role in the quantum-computer branch.","tokens_in":18547,"tokens_out":2033,"would_cite":true,"duration_ms":18789,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Citizen science runs through all three eras of quantum games.","keywords":["Quantum Games","Science Games","Quantum Game Jam","Serious Games","Games With A Purpose","Citizen Science","Crowdsourcing","Gamification"],"falsifier":"A comprehensive multilingual census of quantum games that uncovers active or recently active citizen science quantum games outside the Western-language sources—especially any developed after 2019 with a stated citizen science goal—would contradict the paper's observation that all such projects are discontinued and its claim that the three named forces fully drive the landscape.","tokens_in":17678,"feed_emoji":"🎮","tokens_out":7648,"duration_ms":65526,"temperature":0.7,"pith_summary":"This review attempts to organize the history of quantum games—rule-based games that reference or use quantum physics—around the role of citizen science, and it argues that the field has been shaped by three driving forces: the serious use of games for research and education, the evolution of quantum computers, and open development events such as Quantum Game Jams. The paper inventories eleven citizen science quantum games and prototypes, plus a crowdsourcing platform and an interactive art installation, and observes that citizen science contributions appear in all three driving forces. It further claims that every one of these citizen science projects has been discontinued, despite collectively reaching millions of players, and that public interest in quantum technologies has grown since their most active years. For a reader, the payoff is a concrete map of what has been tried, why the projects stalled, and what design guidance and collaborative models exist for future attempts.","feed_headline":"Citizen science runs through all three eras of quantum games","feed_subtitle":"Eleven citizen science quantum games reached millions, yet all stalled—here is why and what comes next.","key_machinery":"The organizing object is the 'dimension of scientific purposes' in the paper's three-dimensional definition of quantum games, paired with a historical timeline that sorts games by what drove their creation. The mechanism doing the analytic work is the mapping of a quantum research problem into a playable visual task built on numerical simulation: laser-controlled movement of a simulated wave function in Quantum Moves, simplification of knot-like topological circuits in meQuanics, puzzle-based error correction in Decodoku, and randomness generation through binary choices in The BIG Bell Quest. The Quantum Black Box simulator, developed for Quantum Game Jams and reused in QWiz and Quantum Garden, is the concrete tool that lets game jam participants prototype citizen science games against a numerical simulation of a Bose-Einstein condensate. These mappings let the author read each game as an instance of one or more driving forces and connect design choices to research outcomes.","core_discovery":"The paper's central discovery is that the current landscape of quantum games is not a random collection but the product of three distinct driving forces: the serious application of games (education, training, citizen science), the development of quantum computers and their public availability, and open game development events like Quantum Game Jams. It traces eleven citizen science quantum games—including Quantum Moves and Quantum Moves 2 for quantum optimal control, meQuanics for topological quantum error correction, Decodoku for qudit error correction, The BIG Bell Quest for human-generated randomness in Bell tests, and Quantum Awesomeness for benchmarking early quantum devices—and finds that citizen science is woven through all three forces. The paper also reports that all of these citizen science projects have been discontinued, often due to limited time, funding, manpower, or shifted research aims, even though they reached millions of players and produced useful data, such as players' solutions in Quantum Moves and 97 million human binary choices in The BIG Bell Quest. On the paper's own terms, the claim is that these three forces explain both the past trajectory of quantum games and the promising conditions for future citizen science quantum games in an era of open-access quantum computers and human-machine collaboration.","pith_inferences":["Editorial inference: If the three-force account is right, the uniform discontinuation pattern suggests a structural cycle—projects are born around hardware-access milestones and fade when funding or research focus shifts—so the next wave is likely to arrive with the next round of accessible quantum computers.","Editorial inference: Because successful citizen science in astronomy and biology taps pattern recognition on familiar visual data, quantum citizen science may need to build visual intuition slowly through tutorial layers; the paper's tournament idea is one testable way to do that.","Editorial inference: A comparative study of numerical-simulation-based versus real-quantum-computer-based games, which the paper calls for, would also test whether human intuition formed on simulations transfers to actual quantum devices; this is a concrete next experiment the paper implies but does not run.","Editorial inference: The focus on optimal control problems with transferable metrics suggests a broader design principle: quantum citizen science games are most viable when the research task can be expressed as a visual optimization with clear feedback, which could guide game jams beyond quantum physics."],"forward_implications":["If the three-force account is correct, future citizen science quantum games will most plausibly emerge where serious research needs, accessible quantum hardware, and open development events overlap—such as benchmarking or error correction on near-term devices.","Because all eleven inventoried citizen science projects were discontinued, any new project should follow the recommended design guidance: early involvement of both game design and quantum physics expertise, early decisions about the citizen science goal, and strong visual communication.","The rise in public interest in quantum technologies since the games' most active years implies a wider potential player pool for a renewed citizen science quantum game.","The tournament model proposed for limited quantum-computer access—tutorial rounds on classical simulations, then finale rounds on real hardware, as in The BIG Bell Quest—could make scarce quantum resources go further.","A shared, community-run platform for quantum citizen science, similar in spirit to established astronomy and biology citizen science platforms, would let projects pool resources instead of each starting from scratch."],"supporting_citations":[{"why":"Defines quantum games and their three dimensions, establishing the 'scientific purposes' category that frames citizen science games.","marker":"[10]"},{"why":"Provides the prior history of quantum games that this review reorganizes specifically around citizen science.","marker":"[11]"},{"why":"Documents the design, player recruitment, and early results of Quantum Moves, the first major citizen science quantum game.","marker":"[57]"},{"why":"Reports that Quantum Moves players reached near-optimal quantum speed-limit solutions, evidence that citizen scientists can contribute to quantum control research.","marker":"[58]"},{"why":"Shows citizen scientists remotely optimizing an ultracold-atoms experiment through Alice Challenge, grounding the claim that games can do real research.","marker":"[59]"},{"why":"Describes Decodoku as a citizen science game for quantum error correction and public demystification, a key data point for the serious-games force.","marker":"[71]"},{"why":"Presents The BIG Bell Quest's use of 97 million human choices to test local realism, evidence of crowdsourced citizen science at scale.","marker":"[76]"},{"why":"Documents the Quantum Game Jam series and its citizen science game prototypes, supporting the open-development-events driving force.","marker":"[105]"},{"why":"Supplies design guidelines for citizen science quantum games and details the Quantum Black Box simulator used across jam games and QWiz.","marker":"[104]"}],"fun_headline_variants":["Citizen science weaves through all three quantum game drivers","All 11 citizen science quantum games stopped, despite millions","Quantum Game Jams, serious play, chips: citizen science connects","Quantum games' three forces, all fed by citizen science"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The whole classification depends on the compiled list of games and sources being complete and representative; the paper itself notes that most accessible material is in Western languages, so unlisted or non-Western citizen science quantum games could change the three-force picture.","fun_headline_variants_meta":{"raw":{"variants":["Citizen science weaves through all three quantum game drivers","All 11 citizen science quantum games stopped, despite millions","Quantum Game Jams, serious play, chips: citizen science connects","Quantum games' three forces, all fed by citizen science"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000344,"raw_usage":{"total_tokens":1888,"prompt_tokens":939,"completion_tokens":949,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":555,"completion_tokens_details":{"reasoning_tokens":880}},"tokens_in":555,"tokens_out":949,"duration_ms":9767,"temperature":1.0,"reasoning_tokens":880,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-07T22:23:05.284595+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"A comprehensive multilingual census of quantum games that uncovers active or recently active citizen science quantum games outside the Western-language sources—especially any developed after 2019 with a stated citizen science goal—would contradict the paper's observation that all such projects are discontinued and its claim that the three named forces fully drive the landscape.","supporting_citations":[{"cited_title":"Defining Quantum Games","cited_arxiv_id":"2206.00089","evidence_quote":"Defines quantum games and their three dimensions, establishing the 'scientific purposes' category that frames citizen science games."},{"cited_title":"Human Computation 1(2) (2014) https://doi.org/10.15346/hc.v1i2.11","cited_arxiv_id":null,"evidence_quote":"Documents the design, player recruitment, and early results of Quantum Moves, the first major citizen science quantum game."},{"cited_title":"Nature 532(7598), 210–213 (2016) https://doi.org/10.1038/nature17620","cited_arxiv_id":null,"evidence_quote":"Reports that Quantum Moves players reached near-optimal quantum speed-limit solutions, evidence that citizen scientists can contribute to quantum control research."},{"cited_title":"Proceedings of the National Academy of Sciences 115, 201716869 (2018) https://doi.org/10.1073/pnas.1716869115","cited_arxiv_id":null,"evidence_quote":"Shows citizen scientists remotely optimizing an ultracold-atoms experiment through Alice Challenge, grounding the claim that games can do real research."},{"cited_title":": Challenging local realism with human choices","cited_arxiv_id":null,"evidence_quote":"Presents The BIG Bell Quest's use of 97 million human choices to test local realism, evidence of crowdsourced citizen science at scale."},{"cited_title":"In: Academic Mindtrek 2021, pp","cited_arxiv_id":null,"evidence_quote":"Documents the Quantum Game Jam series and its citizen science game prototypes, supporting the open-development-events driving force."},{"cited_title":"Master’s thesis, Department of Computing, University of Turku (2024)","cited_arxiv_id":null,"evidence_quote":"Supplies design guidelines for citizen science quantum games and details the Quantum Black Box simulator used across jam games and QWiz."}],"review_version":1}