{"id":"9e9b5ede-b0f7-41ce-9501-4d26defc7dd1","arxiv_id":"2505.18196","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":3.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"A comment paper argues that a 2024 critique of politicized U.S. science funding misrepresents its cited government documents, and appends those documents as evidence.","lead":"This preprint is a point-by-point rebuttal of a 2024 commentary claiming that U.S. funding agencies forced scientists to spend grant money on diversity activities. The author reproduces the cited government slide decks, funding announcements, and privacy statements, and argues the claims misquote these sources.","discovery_kind":"review","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The broad claim that 'few (if any) program solicitations require DEI activities' is unsupported by the reproduced documents and is in tension with the DOE PIER source, which makes a PIER plan a required, merit-scored element for all Office of Science applications.","rationale":"The central claim of the comment is that Efimov et al. misrepresented agency policy, specifically that 'few (if any) program solicitations require DEI activities' and that no budget set-aside is therefore mandated. My stress-test focused on whether the evidence supports that claim. The reproduced documents are primary sources and are valuable: the NASA deck does state inclusion plans will not be part of the adjectival rating, and the DOE deck lists the PIER plan last among merit criteria in descending order of importance. Those specific fact-checks hold. The weak point is the universal quantifier 'few (if any).' A convenience sample of five documents cannot establish that claim, and the DOE source actively conflicts with the broad wording because it makes a PIER Plan a required, merit-reviewed element for every Office of Science application. The paper implicitly narrows 'require DEI activities' to 'require budget set-asides,' and on that narrow reading the rebuttal of the 5-10% figure is sound. But the text in Section 2 and Table 1 does not consistently maintain that narrow reading, so the central assertion overreaches. This is a limitation on scope, not a fatal flaw: the specific document-level corrections are reproducible and checkable. The reader's CONDITIONAL verdict already encodes exactly this concern, so my read does not move the verdict. A systematic survey of 2024 solicitations would settle whether the broad generalization is salvageable or should be retracted to the audited documents.","tokens_in":45700,"tokens_out":5611,"duration_ms":45246,"concrete_test":"Compile all NSF, NIH, DOE, and NASA research solicitations active in calendar year 2024 (e.g., via grants.gov and agency listing pages), and code each for (a) whether it requires a DEI/inclusion/broader-impacts plan as a proposal element, (b) whether that plan is a scored or gating merit review criterion, (c) whether it mandates specific DEI activities, and (d) whether it requires a minimum budget percentage or line item for DEI activities. Report counts and the exact solicitation language for any positive hits. If more than a handful of solicitations require a plan as a scored element, the phrase 'few (if any) program solicitations require DEI activities' is misleading; if zero require a budget set-aside, the specific rebuttal of the 5-10% figure stands.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central rebuttal rests on the claim (Section 2, first paragraph; Table 1) that 'few (if any) program solicitations require DEI activities.' The supporting evidence is a convenience sample of five documents, none of which is a systematic survey of solicitations. More importantly, one of the paper's own reproduced sources cuts against the claim: the DOE Office of Science deck (Supplementary Material, Ref. 12, slides 2 and 7) states that a PIER Plan is 'a required proposal element for all applications submitted to the DOE Office of Science' and is 'evaluated as part of the merit review process and thus may inform funding decisions.' A PIER Plan must 'describe the activities and strategies' the applicant will incorporate. So at least one major agency explicitly requires a DEI-related plan as a scored proposal element. The paper tries to defuse this by equating 'requiring DEI activities' with mandating budget line items, arguing that 'Inclusion Plans and similar documents need not have funds attached.' That rebuts Efimov et al.'s narrower 5-10% budget claim, but it does not support the sweeping 'few (if any)' generalization. If the claim were narrowed to 'few (if any) solicitations mandate a minimum DEI budget percentage,' the reproduced sources would support it. As written, the central assertion is broader than the evidence.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The manuscript is a point-by-point rebuttal of the 2024 commentary by Efimov et al., which argued that U.S. funding agencies have politicized grant review by prioritizing DEI activities over scientific merit. The author claims that the commentary misrepresents agency policy: that few, if any, program solicitations require DEI activities; that no budget set-asides are mandated; that NASA's Inclusion Plans are not used to rank proposals; that DOE's PIER Plan criterion is ranked below scientific and technical merit; and that NSF demographic data collection is voluntary. The paper reproduces dated government source documents in its supplementary material and closes with an epilogue describing the author's experience submitting the work to a journal.","tokens_in":45887,"tokens_out":6014,"duration_ms":52606,"significance":"If the document-level rebuttals survive scrutiny, the paper provides a useful archival service: the supplementary reproductions of agency slide decks and policy statements are dated and verbatim, and several specific claims are directly supported by those sources, including the NASA statement that Inclusion Plans will not be part of the adjectival rating, the DOE default ordering of merit criteria, and the NSF statement that submission of demographic information is voluntary. The paper is therefore valuable as a correction of specific evidentiary errors in the original commentary. Its value is weakened, however, by overgeneralization from a convenience sample of five documents to the broad claim that 'few (if any) program solicitations require DEI activities,' a claim that is contradicted by one of the paper's own reproduced sources. The unsupported speculation about the motives of named journal staff further undermines the paper's credibility as a scholarly correction.","major_comments":[{"comment":"The central sentence 'few (if any) program solicitations require DEI activities' is not supported by the evidence presented and is affirmatively contradicted by the paper's own reproduced DOE source. Supplementary Material, Ref. 12, slide 2 states that a PIER Plan is 'a required proposal element for all applications submitted to the DOE Office of Science' and slide 7 states that the PIER Plan is 'evaluated as part of the merit review process and thus may inform funding decisions.' At least one major agency therefore requires a DEI-related plan as a scored proposal element. The rebuttal of Efimov et al.'s 5-10% budget claim can be retained, but it should be narrowed to the claim that 'few (if any) solicitations mandate a minimum DEI budget percentage,' which the reproduced sources do support; the broader claim is not established by the convenience sample of five documents.","section":"Section 2, first paragraph; Table 1, row 'DEI activities are required for STEM funding'"},{"comment":"The statement that funding agencies 'seldom (if ever) micromanage budgets in the manner that is suggested' is an empirical claim offered without citation. It is not necessary for the paper's core rebuttal, which is that the 5-10% figure comes from an outreach specialist's advice deck rather than from a solicitation requirement. Please either support the 'seldom micromanage' claim with a policy document or remove it, since as written it repeats the same kind of unsupported categorical assertion that the paper criticizes in Efimov et al.","section":"Section 2, second paragraph; Table 1, row 'Grant proposals require extravagant spending on DEI activities'"},{"comment":"The passage 'I suspect that these individuals stepped away for reasons other than being too busy' attributes motives to named individuals, namely the reviewer and the associate editor, based only on the timing of a journal administrative change. This is speculation about persons rather than evidence, and it is outside the scope of a fact-checking commentary. The passage should be removed, or explicitly marked as the author's personal conjecture with no assertion of fact, so that the paper does not repeat the practice of making unsubstantiated claims about other people's intentions.","section":"Section 4, Epilogue"}],"minor_comments":[{"comment":"The phrase 'This is debunked in detail elsewhere' is supported by a citation to the author's own prior opinion piece (Ref. 2). The fact-checking should be self-contained or cite the primary agency documents directly, especially because the paper's own sources are already reproduced in the supplementary material.","section":"Section 2, first paragraph; Ref. 2"},{"comment":"The claims about NASA and DOE omit caveats present in the cited sources. The NASA slide (Ref. 11, slide 8) adds that 'some programs may require an acceptable plan for the selected proposal(s) before funding may be released,' and the DOE slide (Ref. 12, slide 7) states that the descending order of merit criteria may be modified by the sponsoring program office. The paper's statements are accurate for the default case, but they should include these qualifications to avoid creating new overstatements.","section":"Section 2, paragraphs on NASA and DOE; Refs. 11 and 12"},{"comment":"The manuscript uses inflammatory and non-scholarly language, including 'cabal of authors,' 'paranoid delusion of anti-DEI zealots,' 'anti-DEI crusaders,' and 'legacy elites.' Such phrasing is not appropriate for a fact-checking commentary and should be replaced with neutral descriptions of the disputed claims.","section":"Throughout"},{"comment":"There is a typographical error in the sentence 'the clear statistical reality of While male domination of STEM,' which should read 'White male domination.' The title on the first page also renders the word 'trust' as 'tr ust,' which should be corrected.","section":"Section 4, Epilogue"}],"recommendation":"major_revision","confidential_remarks":"The paper has real value as an archival record of specific agency documents, but its central generalization is broader than its evidence, and the epilogue contains speculation about named individuals that would be problematic in a journal publication. The author should be encouraged to resubmit after narrowing the factual claims, removing or clearly labeling the speculation, and adopting a more measured tone. The heavy reliance on self-citations, especially Ref. 2 as the authority for 'debunked in detail elsewhere,' should also be addressed."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"What you should know: this is a rebuttal commentary, not a research preprint, and its documentary core is mostly sound. The appendix reproduces the actual government sources—NASA inclusion-plan deck, DOE PIER-plan deck, NSF privacy statement, NIH funding announcement, MCB broader-impacts slides—many now offline, and the point-by-point table of alleged errors in Efimov et al. is genuinely useful. I checked the quotations that matter: the NASA deck does say Inclusion Plans will not be part of the adjectival rating, and the DOE deck lists PIER-plan quality last among the merit criteria in descending order of importance. Those document-level rebuttals hold up.\n\nThe main soft spot is exactly what the stress-test flags. The paper asserts that \"few (if any) program solicitations require DEI activities,\" but the evidence is a convenience sample of five documents, not a survey of solicitations. Worse, the paper's own reproduced DOE source says a PIER Plan is \"a required proposal element for all applications submitted to the DOE Office of Science,\" is \"evaluated as part of the merit review process,\" and \"may inform funding decisions.\" The author's narrowing move—requiring a plan is not the same as mandating a budget percentage—rebuts Efimov et al.'s 5–10% budget claim, but it does not support the sweeping \"few (if any)\" generalization. The paper would be on firm ground if it claimed few solicitations mandate a minimum DEI budget share; as written it overreaches.\n\nThere are two other weaknesses. The rhetorical frame (\"paranoid delusion,\" \"legacy elites\") sits outside the fact-checking register and will cost the paper credibility with readers who might otherwise accept the documented corrections. And the Epilogue's speculation about the journal process is explicitly unverifiable—it reads as grievance, and while it does not affect the factual core, it should be clearly separated from the documentation.\n\nThe citation pattern is acceptable: self-citations exist, but the load-bearing claims rest on appended primary sources, and the broader empirical claims about demographics cite real literature. The paper is best seen as an archival correction for a heated policy debate, and the reproduced sources give it lasting value even for readers who dislike the author's politics.\n\nMy recommendation: send it to peer review, but with a clear expectation of revision. The author should narrow the central claim to what the documents actually support, move the rhetorical attacks to a clearly labeled opinion section, and either present a systematic survey of solicitations or stop generalizing beyond the reproduced sources. A serious reviewer could turn this into a genuinely useful documentary record.","headline":"A fact-checking commentary worth reading for its archived primary sources and mostly accurate document-level rebuttals, but its central 'few if any' claim is wider than the evidence.","tokens_in":46488,"tokens_out":1730,"would_cite":false,"duration_ms":18981,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"A point-by-point fact-check argues that the 2024 'politicized science funding' commentary misreads the agency documents it cites.","keywords":["science funding policy","diversity equity and inclusion","inclusion plans","grant review criteria","NSF broader impacts","NASA inclusion plans","DOE PIER plans","fact-checking"],"falsifier":"A systematic count of NSF, NIH, DOE, and NASA funding announcements in force during 2024 that required an inclusion or DEI plan with a dedicated budget line, or that ranked proposals by plan quality, would settle the dispute; if many such solicitations existed with mandatory budgeted DEI activities, the paper's central rebuttal would fail.","tokens_in":45383,"feed_emoji":"⚖️","tokens_out":6964,"duration_ms":60494,"temperature":0.7,"pith_summary":"This commentary tries to overturn the central claim of a 2024 opinion essay that U.S. science funders had 'politicized' grant-making by putting diversity, equity, and inclusion ahead of scientific merit. It argues that the essay's evidence does not survive contact with the documents it cites: few program solicitations required DEI activities, inclusion plans at NASA were explicitly not used to rank or select proposals, and DOE placed the quality of its PIER plan below scientific and technical merit in the review criteria. The author also reproduces the primary agency documents as an archive, so that the actual state of these policies at the end of 2024 cannot be retroactively misdescribed. An epilogue recounts the author's failed attempt to publish the comment, including the withdrawal of an editor and reviewer after the January 2025 pause on federal grant decisions, as evidence that the political climate was already affecting review. A sympathetic reader would care because the dispute is not merely about one essay: if the rebuttal is right, then the claim that federal grants were being steered by DEI quotas and mandatory budget set-asides is a factual error, not a policy disagreement.","feed_headline":"Fact-check: grant rules did not mandate DEI budgets","feed_subtitle":"The rebuttal reproduces the primary sources to show inclusion plans were never ranking criteria.","key_machinery":"The central mechanism is the reproduced primary-source document, used as evidence against the earlier commentary's citations. The argument turns on a simple distinction: activities a solicitation requires are binding elements of merit review, while activities a solicitation encourages are not; if DEI activities are not required, no budget share must be set aside for them. The load-bearing documents are the NSF MCB 'Let's Talk Broader Impacts' slide deck, the NASA 'Inclusion Plans in Research Proposals' deck, the DOE 'Promoting Inclusive and Equitable Research (PIER) Plans' office-hours deck, the NSF privacy-act statement, and the NIH PRIDE funding announcement, all reproduced in the supplementary material. These documents carry the rebuttal by showing, in the agencies' own words, that inclusion-plan quality was not a ranking criterion and that budget requests for such activities were optional rather than mandated.","core_discovery":"On the paper's own terms, the discovery is that the specific documents cited by the 2024 commentary do not say what the commentary says they say. The NSF slide deck cited for the 5–10% budget figure is a 'Broader Impacts' outreach talk by an organization that works on outreach, and it does not establish a mandatory set-aside. The NASA inclusion-plan deck states that Inclusion Plans 'will again not be part of the adjectival rating for the proposal and will not inform the selection of proposals,' and it warns against tokenizing diverse team members. The DOE Office of Science deck lists 'Quality and Efficacy of the Plan for Promoting Inclusive and Equitable Research' as the fifth merit-review criterion, below scientific and technical merit, method, personnel, and budget. The NSF privacy statement says submission of the information is voluntary, and the NIH announcement that was cited concerns a program specifically targeted at inclusion and diversity rather than a general grant program. The paper also argues that the broader-impacts criterion at NSF has existed since 1997 under administrations of both parties, so it cannot be a Biden-era imposition.","pith_inferences":["Beyond the paper: a systematic survey of NSF, NIH, DOE, and NASA solicitations in force during 2024 could test whether the 'few (if any)' claim holds across the full population of funding announcements, not just the reproduced sample.","Beyond the paper: if the reading of the NASA and DOE decks is correct, a concrete test is to compare the archived ROSES-2023 and DOE Office of Science solicitation language with the claim that inclusion plans were never ranking criteria.","Beyond the paper: the required-versus-encouraged distinction could be applied to the 2025 policy reversal, framing it as the removal of a procedural plan requirement rather than the abolition of a quota system, unless other evidence shows otherwise."],"forward_implications":["If the rebuttal is correct, the headline claim that U.S. funders were diverting science money into compulsory DEI budgets is unsupported by the cited sources.","The NASA and DOE documents imply that inclusion-plan requirements were procedural: plans had to be submitted and could gate funding, but they did not rank proposals.","The NSF privacy notice implies that demographic data collection was voluntary, so it cannot serve as evidence of de facto quotas or identity-based award allocation.","Because the paper archives the documents, future researchers can check the 2024 policy record directly even after agency websites removed the material.","The paper's reading of the record would mean the original commentary's First Amendment and 'compelled speech' arguments rested on a mistaken factual premise."],"supporting_citations":[{"why":"The 2024 commentary being rebutted; supplies every claim that is fact-checked.","marker":"[1]"},{"why":"The NSF MCB 'Broader Impacts' slide deck; the source actually cited for the 5–10% budget figure and for what broader impacts activities involve.","marker":"[3]"},{"why":"The NASA 'Inclusion Plans in Research Proposals' deck; states that inclusion plans are not used to rank or select proposals and warns against tokenizing.","marker":"[11]"},{"why":"The DOE Office of Science PIER plans deck; shows the PIER criterion is listed below scientific and technical merit.","marker":"[12]"},{"why":"The NSF privacy act and public burden statement; shows submission of requested information, including demographic data, is voluntary.","marker":"[9]"},{"why":"The NIH PRIDE R25 funding announcement; the only citation offered for quota-like reporting, and it is a program specifically targeted at inclusion and diversity.","marker":"[10]"},{"why":"A prior fact-check by the same author; states the rebuttal's core reading of the funding agencies' policies.","marker":"[2]"},{"why":"An insider perspective on broader impacts; supports the claim that Broader Impacts has been an NSF review criterion since 1997.","marker":"[7]"}],"fun_headline_variants":["Primary sources debunk DEI budget mandate claims","Grant rules never required DEI set-aside, evidence shows","Inclusion plans weren't ranking criteria, documents confirm","Source documents contradict politicized funding claims","Primary documents refute DEI budget claims"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The broad conclusion that 'few (if any)' solicitations required DEI activities is inferred from a small set of reproduced documents, not from a systematic survey of NSF, NIH, DOE, and NASA solicitations; the related claim that agencies 'seldom (if ever)' micromanage budgets is asserted without a citation.","fun_headline_variants_meta":{"raw":{"variants":["Primary sources debunk DEI budget mandate claims","Grant rules never required DEI set-aside, evidence shows","Inclusion plans weren't ranking criteria, documents confirm","Source documents contradict politicized funding claims","Primary documents refute DEI budget claims"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000641,"raw_usage":{"total_tokens":2946,"prompt_tokens":938,"completion_tokens":2008,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":554,"completion_tokens_details":{"reasoning_tokens":1936}},"tokens_in":554,"tokens_out":2008,"duration_ms":15746,"temperature":1.0,"reasoning_tokens":1936,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-07T15:24:44.294328+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"A systematic count of NSF, NIH, DOE, and NASA funding announcements in force during 2024 that required an inclusion or DEI plan with a dedicated budget line, or that ranked proposals by plan quality, would settle the dispute; if many such solicitations existed with mandatory budgeted DEI activities, the paper's central rebuttal would fail.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"The NSF MCB 'Broader Impacts' slide deck; the source actually cited for the 5–10% budget figure and for what broader impacts activities involve."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"The NASA 'Inclusion Plans in Research Proposals' deck; states that inclusion plans are not used to rank or select proposals and warns against tokenizing."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"The DOE Office of Science PIER plans deck; shows the PIER criterion is listed below scientific and technical merit."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"The NSF privacy act and public burden statement; shows submission of requested information, including demographic data, is voluntary."},{"cited_title":"Overview Information","cited_arxiv_id":null,"evidence_quote":"The NIH PRIDE R25 funding announcement; the only citation offered for quota-like reporting, and it is a program specifically targeted at inclusion and diversity."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"A prior fact-check by the same author; states the rebuttal's core reading of the funding agencies' policies."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"An insider perspective on broader impacts; supports the claim that Broader Impacts has been an NSF review criterion since 1997."}],"review_version":1}