Recognition: 2 theorem links
· Lean TheoremMapping the Landscape of Open Access Dashboards -- A Dataset for Research and Infrastructure Development
Pith reviewed 2026-05-17 03:18 UTC · model grok-4.3
The pith
A survey has produced a dataset of nearly 60 open access dashboards described by a new metadata schema to support research on open science monitoring.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The authors conducted an extensive survey that located nearly 60 open access dashboards and indexed each one according to a purpose-built metadata schema. This schema captures characteristics such as geographic and institutional coverage, data provenance, visualization techniques, and maintenance status. The indexed collection is offered as a living resource that stakeholders can extend through a participatory process, thereby supporting both quantitative studies of open access trends and the iterative improvement of policy-relevant metrics.
What carries the argument
The metadata schema, which supplies a standardized set of fields for recording the scope, technical properties, and policy relevance of open access dashboards.
If this is right
- The dataset enables systematic empirical analyses of how open access progress is currently measured and communicated.
- It provides a foundation for refining indicators and policy instruments in open science contexts.
- Community contributions can maintain the inventory as new dashboards appear.
- Researchers gain a shared reference point for comparing monitoring efforts across organizations and countries.
Where Pith is reading between the lines
- The schema might be extended to capture dashboards that track related open science practices such as data sharing or preprint adoption.
- Policymakers could use the indexed descriptions to identify coverage gaps, for instance in regions with limited dashboard availability.
- Linking the dataset to publication databases could allow automated checks on whether dashboard numbers match actual open access shares.
- Future surveys might test whether dashboards that follow the schema's recommended features prove more useful to decision makers than those that do not.
Load-bearing premise
The survey captured a representative collection of existing dashboards and the chosen metadata schema is adequate for supporting empirical analyses and policy refinements.
What would settle it
A subsequent independent search that locates a substantial number of additional open access dashboards absent from the dataset, or practical tests showing that the schema fields produce inconsistent or uninformative results when used for cross-dashboard comparisons.
Figures
read the original abstract
As Open Access continues to gain importance in science policy, understanding the proportion of Open Access publications relative to the total research output of research-performing organizations, individual countries, or even globally has become increasingly relevant. In response, dashboards are being developed to capture and communicate progress in this area. To provide an overview of these dashboards and their characteristics, an extensive survey was conducted, resulting in the identification of nearly 60 dashboards. To support a detailed and structured description, a dedicated metadata schema was developed, and the identified dashboards were systematically indexed accordingly. To foster community engagement and ensure ongoing development, a participatory process was launched, allowing interested stakeholders to contribute to the dataset. The dataset is particularly relevant for researchers in Library and Information Science (LIS) and Science and Technology Studies (STS), supporting both empirical analyses of Open Access and the methodological refinement of indicators and policy instruments in the context of Open Science.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper reports on an extensive survey that identified nearly 60 open access dashboards, introduces a dedicated metadata schema for systematically indexing their characteristics, and describes a participatory process for ongoing community contributions to the resulting dataset. The work positions the dataset as a resource for empirical analyses of open access and for methodological refinement of indicators and policy instruments in open science, with relevance to researchers in library and information science and science and technology studies.
Significance. If the survey coverage is representative and the schema is robust, the dataset would provide a valuable, structured foundation for studying the landscape of open access monitoring tools. This could support reproducible empirical work on open science indicators and help refine policy instruments, with the participatory maintenance model offering a practical strength for long-term utility.
major comments (2)
- [Abstract] The central claim that an 'extensive survey' identified nearly 60 dashboards rests on undocumented methodology. No search protocol, list of queried databases or sources, definition of 'dashboard', time window, or inclusion/exclusion criteria are provided, rendering representativeness and reproducibility untestable (see Abstract and any Methods section describing the survey process).
- [Schema development and indexing description] Without documented validation steps or inter-rater reliability measures for schema application, it is unclear whether the indexing of the ~60 dashboards was applied consistently, which directly affects the dataset's utility for the claimed empirical analyses and policy refinement.
minor comments (2)
- [Results or Dataset description] Clarify the exact number of dashboards included (the abstract says 'nearly 60' while the reader's summary references 'nearly 60'); provide a precise count and any breakdown by type or region.
- [Participatory process section] The participatory process is mentioned but lacks details on how contributions will be moderated or integrated; add a brief description of the workflow.
Simulated Author's Rebuttal
We thank the referee for the constructive comments on our manuscript. We address each major comment below and will revise the paper to improve methodological transparency and documentation of the schema application process.
read point-by-point responses
-
Referee: [Abstract] The central claim that an 'extensive survey' identified nearly 60 dashboards rests on undocumented methodology. No search protocol, list of queried databases or sources, definition of 'dashboard', time window, or inclusion/exclusion criteria are provided, rendering representativeness and reproducibility untestable (see Abstract and any Methods section describing the survey process).
Authors: We agree that the survey methodology requires fuller documentation to support reproducibility and evaluation of representativeness. In the revised manuscript we will add a dedicated Methods section that specifies the search protocol, the databases and other sources queried, our operational definition of an open access dashboard, the survey time window, and the inclusion and exclusion criteria applied. These additions will make the process of identifying the nearly 60 dashboards transparent and testable. revision: yes
-
Referee: [Schema development and indexing description] Without documented validation steps or inter-rater reliability measures for schema application, it is unclear whether the indexing of the ~60 dashboards was applied consistently, which directly affects the dataset's utility for the claimed empirical analyses and policy refinement.
Authors: We acknowledge the value of documenting validation procedures for schema application. The revised manuscript will expand the description of schema development to include the iterative process used to create the metadata fields and the steps taken to apply the schema consistently across the identified dashboards. We will also report any validation activities performed and, where formal inter-rater reliability statistics were not calculated, we will transparently describe the collaborative review methods employed and note this as a limitation. revision: yes
Circularity Check
No circularity: purely descriptive survey and dataset construction
full rationale
The paper reports conducting a survey that identified nearly 60 dashboards, developing a metadata schema, indexing the dashboards, and launching a participatory process for ongoing contributions. No derivation chain, equations, predictions, fitted parameters, or self-referential claims exist in the abstract or described content. The work is a cataloging and schema-creation effort without any reduction of outputs to inputs by construction, self-citation load-bearing premises, or renaming of known results as novel derivations. The contribution stands as self-contained descriptive research.
Axiom & Free-Parameter Ledger
Lean theorems connected to this paper
-
IndisputableMonolith/Foundation/AbsoluteFloorClosure.leanreality_from_one_distinction unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
an extensive survey was conducted, resulting in the identification of nearly 60 dashboards... dedicated metadata schema was developed
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
metadata schema... 13 distinct properties... Scope, Operator type, Data type, Data source
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
P. Suber,Open Access. Cambridge: The MIT Press, 2012,isbn: 978-0- 262-30173-2.doi:10.7551/mitpress/9286.001.0001Accessed: Mar. 4, 2023
-
[2]
Analysis of comments and implementation of the NIH public access policy,
National Institutes of Health, “Analysis of comments and implementation of the NIH public access policy,” 2008. [Online]. Available:https : / / publicaccess.nih.gov/analysis_of_comments_nih_public_access_ policy.pdf
work page 2008
-
[3]
Nih-funded science must now be free to read instantly: What you should know,
M. Lenharo, “Nih-funded science must now be free to read instantly: What you should know,”Nature, Jun. 2025,issn: 1476-4687.doi:10 . 1038 / d41586-025-01938-8
work page 2025
- [4]
-
[5]
Background note on open access to scientific pub- lications and open research data,
European Commission, “Background note on open access to scientific pub- lications and open research data,” 2016
work page 2016
-
[6]
Council conclusions on the transition towards an open science system (no. 9526/16),
Council of the European Union, “Council conclusions on the transition towards an open science system (no. 9526/16),” 2016. [Online]. Available: https://data.consilium.europa.eu/doc/document/ST-9526-2016- INIT/en/pdf
work page 2016
-
[7]
Few,Information dashboard design, The effective visual communication of data, 1
S. Few,Information dashboard design, The effective visual communication of data, 1. Aufl. Sebastopol, CA: O’Reilly & Associates, 2006, 211 pp., isbn: 9780596100162
work page 2006
-
[8]
E. Dong et al., “The johns hopkins university center for systems science and engineering COVID-19 dashboard: Data collection process, challenges faced, and lessons learned,”The Lancet Infectious Diseases, vol. 22, no. 12, e370–e376, Dec. 1, 2022, Publisher: Elsevier,issn: 1473-3099, 1474-4457. doi:10.1016/S1473-3099(22)00434-0Accessed:Apr.17,2025.[Online]...
work page doi:10.1016/s1473-3099(22)00434-0accessed:apr.17 2022
-
[9]
T. Khodaveisi, H. Dehdarirad, H. Bouraghi, A. Mohammadpour, F. Sa- jadi, and M. Hosseiniravandi, “Characteristics and specifications of dash- boards developed for the COVID-19 pandemic: A scoping review,”Journal of Public Health, vol. 32, no. 4, pp. 553–574, Apr. 1, 2024,issn: 1613-2238. doi:10.1007/s10389-023-01838-zAccessed: Apr. 17, 2025. 12
-
[10]
Advances in Engineering Software42(12), 1020–1034 (2011)
A. Vahedi, H. Moghaddasi, F. Asadi, A. S. Hosseini, and E. Nazemi, “Ap- plications, features and key indicators for the development of covid-19 dashboards: A systematic review study,”Informatics in Medicine Un- locked, vol. 30, p. 100910, Jan. 1, 2022,issn: 2352-9148.doi:10.1016/j. imu.2022.100910Accessed: Apr. 17, 2025. [Online]. Available:https:// www.s...
work page doi:10.1016/j 2022
-
[11]
S. Biesenbender, S. Petersohn, and C. Thiedig, “Using current research information systems (CRIS) to showcase national and institutional re- search (potential): Research information systems in the context of open science,”Procedia Computer Science, 14th International Conference on Current Research Information Systems, CRIS2018, FAIRness of Research Inform...
work page 2019
-
[12]
É. Archambault et al., “Proportion of open access papers published in peer-reviewed journals at the european and world levels—1996–2013,”
work page 1996
-
[13]
Available:https://digitalcommons.unl.edu/scholcom/ 8
[Online]. Available:https://digitalcommons.unl.edu/scholcom/ 8
-
[14]
The state of oa: A large-scale analysis of the prevalence and impact of open access articles,
H. Piwowar et al., “The state of oa: A large-scale analysis of the prevalence and impact of open access articles,”PeerJ, vol. 6, e4375, Feb. 2018,issn: 2167-8359.doi:10.7717/peerj.4375
-
[15]
On the challenges of open access mon- itoring,
A. Salamoura and G. Tsakonas, “On the challenges of open access mon- itoring,”Insights, vol. 37, no. 1, Feb. 13, 2024,issn: 2048-7754.doi: 10.1629/uksg.641Accessed: Apr. 17, 2025. [Online]. Available:https: //insights.uksg.org/articles/10.1629/uksg.641
-
[16]
Monitoring open science trends in europe
Rand. “Monitoring open science trends in europe. ”[Online]. Available: https://www.rand.org/randeurope/research/projects/2017/open- science-monitor.html
work page 2017
-
[17]
Elsevier will monitor open science in EU using measurement system that favors its own titles,
G. Moody. “Elsevier will monitor open science in EU using measurement system that favors its own titles,” Techdirt, Accessed: Apr. 17, 2025. [On- line]. Available:https://www.techdirt.com/2018/07/09/elsevier- will-monitor-open-science-eu-using-measurement-system-that- favors-own-titles/
work page 2025
-
[18]
Hated science publisher elsevier to help EU monitor open science – including open access,
G. Moody. “Hated science publisher elsevier to help EU monitor open science – including open access,” Techdirt, Accessed: Apr. 17, 2025. [On- line]. Available:https : / / www . techdirt . com / 2018 / 04 / 03 / hated - science-publisher-elsevier-to-help-eu-monitor-open-science- including-open-access/
work page 2025
-
[19]
Feedback on EC open science monitor methodologicalnote
French Open Science Committee, “Feedback on EC open science monitor methodologicalnote.”[Online].Available:https://www.ouvrirlascience. fr/wp- content/uploads/2018/11/Feedback- on- EC- Open- Science- Monitor-Methodological-note.pdf 13
work page 2018
-
[20]
Facts and figures for open research data -
European Commission. “Facts and figures for open research data -. ”[On- line]. Available:https : / / research - and - innovation . ec . europa . eu / strategy / strategy - research - and - innovation / our - digital - future/open-science/open-science-monitor/facts-and-figures- open-research-data_en
-
[21]
The new OpenAIRE monitor: Brand new dashboards and features!
L. Pispiringas, I. Grypari, H. Dimitropoulos, and A. Bardi. “The new OpenAIRE monitor: Brand new dashboards and features!” OpenAIRE, Accessed: May 22, 2025. [Online]. Available:https://www.openaire.eu/ the-new-openaire-monitor-brand-new-dashboards-and-features
work page 2025
-
[22]
Introducing the EOSC observatory,
G. O’Neill. “Introducing the EOSC observatory,” OpenAIRE, Accessed: May22,2025.[Online].Available:https://www.openaire.eu/introducing- the-eosc-observatory
work page 2025
-
[23]
Measurement of open access as an infrastructural challenge: The case of finland,
P. Olsbo, “Measurement of open access as an infrastructural challenge: The case of finland,” inExpanding Perspectives on Open Science: Com- munities, Cultures and Diversity in Concepts and Practices, IOS Press, 2017, pp. 217–226.doi:10.3233/978- 1- 61499- 769- 6- 217Accessed: Apr. 17, 2025
-
[24]
B. Mittermaier, “Rolle des Open Access Monitor Deutschland bei der AntragstellungimDFG-Förderprogramm„Open-Access-Publikationskosten“,” o-bib. Das offene Bibliotheksjournal / Herausgeber VDB, 1–14 Seiten, Nov. 9, 2021, Artwork Size: 1-14 Seiten Publisher: o-bib. Das offene Biblio- theksjournal / Herausgeber VDB.doi:10.5282/O- BIB/5731Accessed: Apr. 17, 20...
work page doi:10.5282/o- 2021
-
[25]
SynOA Synergien für Open Access – Open Access Monitoring Schlussbericht,
I. Barbers, B. Mittermaier, P. Pollack, B. Lindstrot, and H. Schmiedicke- Hintzen, “SynOA Synergien für Open Access – Open Access Monitoring Schlussbericht,” Forschungszentrum Jülich GmbH Zentralbibliothek, Ve- lag, FZJ-2021-01137, 2021. Accessed: May 22, 2025. [Online]. Available: http://hdl.handle.net/2128/27226
work page 2021
-
[26]
Promoting open science through bibliometrics: A practical guide to build an open access monitor,
L. Bracco, “Promoting open science through bibliometrics: A practical guide to build an open access monitor,”LIBER Quarterly: The Journal of the Association of European Research Libraries, vol. 32, no. 1, pp. 1– 18, Oct. 3, 2022, Number: 1,issn: 2213-056X.doi:10.53377/lq.11545 Accessed: May 23, 2025. [Online]. Available:https://liberquarterly. eu/article/...
-
[27]
Swiss open access monitor goes live
Lib4RI. “Swiss open access monitor goes live. ”[Online]. Available:https: / / www . lib4ri . ch / swiss - open - access - monitor - goes - live ? utm _ source=chatgpt.com
-
[28]
P. Danowski et al., “Report on "open access monitoring – approaches and perspectives" (2-day-workshop, 09–10 april 2018, vienna),” Zenodo, Dec. 19, 2018.doi:10.5281/zenodo.2415894Accessed: Apr. 17, 2025. [Online]. Available:https://zenodo.org/records/2415894 14
-
[29]
F. Jülich. “Open-access-barometer 2016,” Accessed: May 22, 2025. [On- line]. Available:https://www.fz- juelich.de/de/zb/open- science/ open-access/oa-barometer/oa-barometer-2016
work page 2016
-
[30]
Check your openness with the UZH OA-monitor (with new feature!)
U. Zürich. “Check your openness with the UZH OA-monitor (with new feature!)” Blog derUB Zürich, Accessed: May22, 2025.[Online].Available: https://www.uzh.ch/blog/ub/2024/10/15/check- your- openness- with-the-uzh-oa-monitor-with-new-feature/?lang=en
work page 2025
-
[31]
M. Duine, A. Iarkaeva, and A. Hübner, “Initiating discipline-specific open science monitoring with the open science dashboard for earth sciences,” Publisher: Zenodo, Nov. 15, 2024.doi:10.5281/zenodo.14170751Ac- cessed:Apr.24,2025.[Online].Available:https://zenodo.org/records/ 14170751
-
[32]
CHORUS – a solution for public access,
F. Dylla, “CHORUS – a solution for public access,”Information Services and Use, vol. 34, no. 3, pp. 195–199, Aug. 2014,issn: 0167-5265, 1875- 8789.doi:10.3233/ISU-140740Accessed: Apr. 17, 2025. [Online]. Avail- able:https://journals.sagepub.com/doi/10.3233/ISU-140740
-
[33]
Europe PMC funders’ dashboard – europe PMC news blog
Europe PMC team. “Europe PMC funders’ dashboard – europe PMC news blog. ”[Online]. Available:https://blog.europepmc.org/2020/ 02/europe-pmc-funders-dashboard.html
work page 2020
-
[34]
New funders page added to OpenAIRE EXPLORE!
A. Brunschweiger. “New funders page added to OpenAIRE EXPLORE!” OpenAIRE, Accessed: Apr. 17, 2025. [Online]. Available:https://www. openaire.eu/new-funders-page-added-to-openaire-explore
work page 2025
-
[35]
Open and shut?: Peter suber on the state of open access: Where are we, what still needs to be done?
R. Poynder. “Open and shut?: Peter suber on the state of open access: Where are we, what still needs to be done?” Open and Shut? Accessed: Apr. 17, 2025. [Online]. Available:https : / / poynder . blogspot . com / 2013/07/peter-suber-on-state-of-open-access.html
work page 2025
-
[36]
P. Danowski et al., “"Empfehlung" für die weitere Vorgangsweise für das Open-Access-Monitoring. Deliverable des AT2OA-Teilprojekts TP1-B,” Mitteilungen der Vereinigung Österreichischer Bibliothekarinnen und Bib- liothekare, vol. 73, no. 2, pp. 278–284, Jul. 14, 2020, Number: 2,issn: 2791-4011.doi:10.31263/voebm.v73i2.3941Accessed: Apr. 17, 2025. [Online]....
-
[37]
Open access monitoring: Guidelines and recommendations for research organisations and funders,
T. Philipp, G. Botz, J.-C. Kita, A. Sänger, O. Siegert, and M. Reumaux, “Open access monitoring: Guidelines and recommendations for research organisations and funders,” May 10, 2021.doi:10.5281/zenodo.4905554 Accessed: Apr. 17, 2025. [Online]. Available:https : / / zenodo . org / records/4905554
-
[38]
H.Pampeletal.,“Datenpraxiszurgestaltungderopen-access-transformation - analyse, empfehlung, training & vernetzung (OA datenpraxis),” Mar. 11, 2024.doi:10.5281/zenodo.10794298Accessed: Mar. 11, 2024. 15
-
[39]
K. Cobey, D. Moher, C. Ripp, D. Franzen, A. Armond, and S. Haustein, “Open science dashboard,” Sep. 7, 2021, Publisher: OSF.doi:10.17605/ OSF.IO/JM8WGAccessed: May 22, 2025. [Online]. Available:https://osf. io/jm8wg/
work page 2021
-
[40]
Metadata schema for the description of research data repositories : Version 4.0,
D. Strecker et al., “Metadata schema for the description of research data repositories : Version 4.0,” 2023, Publisher: re3data.doi:10.48440/re3. 014Accessed: Jun. 1, 2024. [Online]. Available:https : / / gfzpublic . gfz-potsdam.de/pubman/faces/ViewItemOverviewPage.jsp?itemId= item_5022309
-
[41]
Jahn,Datasets on fee-based Open Access publishing across German In- stitutions, in collab
N. Jahn,Datasets on fee-based Open Access publishing across German In- stitutions, in collab. with N. Jahn et al., Medium: text/csv; charset=UTF- 8,text/plain; charset=UTF-8,text/x-markdown; charset=UTF-8,text/x-r; charset=UTF-8, 2014.doi:10 . 4119 / UNIBI / UB . 2014 . 18Accessed: May 21, 2025. [Online]. Available:https://gitlab.ub.uni-bielefeld. de/njah...
work page 2014
-
[42]
OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts
J. Priem, H. Piwowar, and R. Orr,OpenAlex: A fully-open index of schol- arly works, authors, venues, institutions, and concepts, Jun. 17, 2022.doi: 10.48550/arXiv.2205.01833arXiv:2205.01833[cs].Accessed:May21,
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2205.01833arxiv:2205.01833 2022
-
[43]
OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts
[Online]. Available:http://arxiv.org/abs/2205.01833
work page internal anchor Pith review Pith/arXiv arXiv
-
[44]
Barcelona declaration on open research information,
“Barcelona declaration on open research information,” Barcelona Dec- laration on Open Research Information. [Online]. Available:https : / / barcelona-declaration.org/ 8 Author Contributions J.S.andH.P.conceptualizedthestudyanddevelopedthedatacollectionmethod- ology; J.S. curated the data; J.S. and H.P. wrote the manuscript. Both authors contributed to the...
work page 2024
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.