{"id":"4cc0a454-2263-4c7b-8552-9949ea393576","arxiv_id":"2504.12897","paper_version":3,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":4.0,"correctness_risk":"low","formal_verification":"none","parameter_count":0,"one_line_summary":"The paper reports a prototype OntoPortal catalogue for astronomy vocabularies and ontologies, along with a roadmap for a production service.","lead":"Astronomy's three data communities keep their vocabularies in separate registries and formats, so this paper reports a prototype online catalogue, OntoPortal-Astro, that gathers them under one searchable umbrella. The interest for a generalist reader is seeing how an established open-source platform is being extended to a new research field to make data more findable and interoperable.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The promised integration depends on sub-communities formally adopting and sustaining RDF versions of their semantic artefacts; the paper documents only prototype conversions and expressions of interest, not commitments.","rationale":"The reader's weakest assumption identifies exactly the same load-bearing point: community adoption and sustained semantic lifting. The paper is a competent infrastructure report with concrete incremental outputs — SKOS fixes, OWL drafts, a live prototype, and credible use cases — so the concern is not that the technical work is wrong. It is that the central claim is about future impact, and the evidence for the required adoption is only informal interest plus a roadmap. I agree with the conditional verdict: the paper should be accepted with the condition that the adoption/sustainability risk be explicitly tracked and that the production service provide evidence of maintainer-owned RDF releases and updates. No new red flag beyond the reader's assessment was found; the paper itself states the key limitation in Section 6, which strengthens rather than weakens the conditional framing. The proposed concrete test targets the transition from prototype conversions to official, maintained semantic artefacts, which is the minimal evidence that would turn the vision into a supported claim.","tokens_in":22040,"tokens_out":2099,"duration_ms":23567,"concrete_test":"At the end of OPAL's first production year, inspect https://ontoportal-astro.eu together with the official standards pages of IVOA, IHDEA and IPDA, and check two facts: (1) whether the PDS4 Information Model, SPASE, and the main IVOA vocabularies have official RDF/OWL releases published under maintainer control (versioned, with maintainer-minted URIs), rather than only OntoPortal-Astro conversions; and (2) whether the OntoPortal-Astro status metadata for those artefacts has moved from 'Test'/'Develop' to 'Ready' with maintainer-supplied versions. If no governing body has adopted RDF versions and the artefacts are not updated after initial upload, the reference-catalogue claim is unsupported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim is forward-looking: OntoPortal-Astro becomes the reference catalogue and strengthens the semantic infrastructure. The load-bearing condition is that each sub-community not only supplies OWL/SKOS versions of its semantic artefacts but also maintains them through its official governance. The paper's own evidence shows this condition is currently unmet. Section 2 states that IVOA schemas are not available in semantic-web compliant formats and that none of the heliophysics standards share an RDF implementation. Section 6 says the IVOA vocabularies are designed to have as few external dependencies as possible and that 'the IPDA is currently not ready for such a shift'. In Section 4.2, the OWL drafts of PDS4, SPASE and VAMDC are listed with status 'Test' or 'Develop', and the paper reports only that the maintainer teams 'expressed a strong interest'. There is no formal commitment, adoption decision, or maintenance plan from the governing bodies. If the RDF versions are not adopted and sustainably maintained by IVOA, IHDEA and IPDA, the catalogue will contain static conversions rather than living, reference-grade semantic artefacts, and the promised mappings, FAIRness assessment and long-term URI resolution lose their basis. The authors acknowledge this fragility, but the roadmap does not make the required community adoption an explicit, testable milestone.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper reports on a FAIR-IMPACT prototyping exercise that deploys an OntoPortal instance for astronomy, heliophysics, and planetary sciences. It surveys current semantic artefact management in the three sub-communities (IVOA, IHDEA, IPDA), presents six driving use cases, describes the ingestion of about forty vocabularies and ontologies into a live prototype, documents OWL/SKOS drafts of PDS4, SPASE, VAMDC, and CERN Open Data artefacts, reports fixes to IVOA vocabulary RDF, and outlines a roadmap for a production service called OntoPortal-Astro. The paper is explicitly a prototype/infrastructure report: its main claim is forward-looking, and its current evidence consists of a landscape review, a live portal, and maintainer expressions of interest rather than quantitative evaluation.","tokens_in":22356,"tokens_out":5150,"duration_ms":52977,"significance":"If the outlined governance adoption succeeds, OntoPortal-Astro would fill a real gap by giving astronomy a single, maintained catalogue of machine-actionable semantic artefacts, supporting cross-community interoperability and FAIR assessment. The paper's concrete contributions are the landscape review of existing catalogues, the live prototype at ontoportal-astro.eu, and the specific fixes to IVOA vocabulary RDF, and the authors are candid about current limitations, including the lack of RDF versions in the heliophysics and planetary communities. The significance is conditional, however: no formal adoption decision, maintenance plan, or quantitative evidence is provided, so the value of the service rests on assumptions about community engagement that are not yet tested.","major_comments":[{"comment":"The central forward-looking claim in §7 ('may become the reference Semantic Artefact Catalogue for astronomy... significant step') rests on the three sub-communities supplying and maintaining OWL/SKOS versions of their semantic artefacts through their official governance. The paper's own evidence shows this premise is currently unmet: Table 2 lists NASA PDS4, SPASE, VAMDC, and CERN Open Data versions as 'Test' or 'Develop', Section 4.2 reports only that maintainers 'expressed a strong interest', and Section 6 states that 'the IPDA is currently not ready for such a shift' and that IVOA vocabularies are designed with 'as little external dependencies as possible.' No formal adoption decision, maintenance plan, or contingency path is documented. I recommend either softening the conclusion to an explicitly conditional proposal, or adding measurable adoption milestones (e.g., endorsement by the IVOA Semantics WG, acceptance of the SPASE OWL rendering by IHDEA, a PDS4 CCB decision) with deadlines and indicators, plus a stated fallback if RDF versions are not sustained.","section":"§7, §6, Table 2"},{"comment":"The impact framework in §5 presents nine impact factors and seven metrics, but no baseline values, measurement protocol, or success thresholds are specified. For example, 'Count of new mappings between SAs' depends on how mappings are harvested and from which starting set, and 'adoption of SAs in data repositories' requires a defined repository sample and query method; none of these are given. Because the abstract claims the exercise 'resulted in improved vocabulary and ontology management' and 'is now paving the way,' the metrics need to be operationalized or the claim must be labeled as an untested hypothesis. At minimum, add a small table mapping each metric to its data source, baseline, and target value in the OPAL project.","section":"§5, Figure 1"}],"minor_comments":[{"comment":"The concrete fixes to IVOA vocabularies (missing top-level concepts, internal URI references, added MOD metadata) would be much easier to assess if the paper included verification checks, such as SPARQL counts showing that every SKOS concept now has an appropriate broader concept, and links to the corresponding GitHub issues or commits.","section":"§4.3"},{"comment":"The OSTRAILS row lists the time range as '2024-2017', which appears to be a typo for '2024-2027'.","section":"Table 1"},{"comment":"The sentence 'In the FAIR-IMPACT projet, an astronomy SA catalogue use-case has been developed' contains the typo 'projet' for 'project'.","section":"§4.2"},{"comment":"The sentence 'OntoPortal-Astro will implements a very rich metadata model' should be 'will implement'.","section":"§3.5"},{"comment":"The phrase 'allow to semantically described the data' should be 'allow one to semantically describe the data' or 'allow semantic description of the data'.","section":"Abstract"},{"comment":"The phrase 'we participated to the I-ADOPT Variable Modelling Challenge' should be 'we participated in'.","section":"§6"}],"recommendation":"major_revision","confidential_remarks":"Nothing beyond the major comments; the paper is within scope for an astronomy-computing infrastructure report, and I did not identify citation or novelty concerns."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Short take: this is a professionally written infrastructure report with a live prototype, real fixes to IVOA vocabularies, and honest self-assessment. The headline result is modest: a working OntoPortal instance for astronomy plus draft OWL conversions of PDS4, SPASE, and VAMDC. That is genuine new engineering, not a research breakthrough. The paper also does a useful job of mapping the current semantic artefact landscape across celestial astronomy, heliophysics, and planetary science, with appropriate references, including Rovetto's AstroPortal concept.\n\nWhat earns credit: the portal is actually up, the SKOS fixes (missing top-level concepts, URI handling) are concrete, and the authors are candid about the limits. They explicitly state that IVOA vocabularies are designed to avoid external dependencies, that IPDA is 'not ready for such a shift,' and that the OWL conversions are at 'Test' or 'Develop' status. That is the right kind of honesty for a prototype report.\n\nThe soft spots are the ones the reader flags. The central claim about becoming the reference Semantic Artefact Catalogue is forward-looking and untested. The paper reports 'strong interest' from PDS, SPASE, and VAMDC maintainers, but no formal adoption decisions, governance commitments, or maintenance plans. The roadmap does not make community adoption an explicit, testable milestone. And there is no quantitative evaluation—no user study, no mapping accuracy measure, no FAIRness before/after. These are real concerns, but they are proportionate: this is a description of a prototype, not an adoption study. The authors already know where the fragility is. My main suggestion would be to tighten the roadmap around adoption commitments.\n\nWho benefits: anyone building community semantic catalogues, astronomers working on FAIR data interoperability, and semantic web people looking for concrete domain cases. It deserves a serious referee; it would be a useful Astronomy & Computing paper, likely with revisions. I'd accept it for peer review.","headline":"A solid, honest infrastructure report: live prototype, concrete SKOS fixes, and useful landscape review, but the central 'reference catalogue' claim depends on community adoption that the paper itself admits is not yet in place.","tokens_in":22791,"tokens_out":2718,"would_cite":true,"duration_ms":26402,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Astronomy's fragmented semantic artefacts can be gathered into a single FAIR catalogue, and the authors prototype it as OntoPortal-Astro.","keywords":["OntoPortal-Astro","semantic artefact catalogue","astronomy","heliophysics","planetary sciences","FAIR principles","SKOS","OWL"],"falsifier":"Two years after the production launch, check the actual content of the service: if the planetary information model and the heliophysics metadata standard are still available only as XML schemas, with no maintained OWL or SKOS versions and no resolvable URIs in the catalogue, then the claimed unification has not happened.","tokens_in":21861,"feed_emoji":"🔭","tokens_out":7600,"duration_ms":69759,"temperature":0.7,"pith_summary":"The paper argues that astronomy's three data communities—celestial astronomy, heliophysics, and planetary science—keep their vocabularies and ontologies in separate, heterogeneous registries, and that this fragmentation blocks semantic interoperability. It claims that a central semantic artefact catalogue built on the OntoPortal technology, called OntoPortal-Astro, can collect these artefacts, expose them in standard machine-readable forms, and support their mapping and FAIR assessment. To support that claim, the authors prototyped the catalogue, populated it with about forty vocabularies and ontologies, and converted several XML-based community schemas into OWL and SKOS. If the claim holds, astronomy gains a single reference point where researchers and tools can find, compare, and reuse semantic artefacts, which would strengthen cross-community data discovery and reuse.","feed_headline":"Astronomy gets one catalogue for its scattered vocabularies","feed_subtitle":"OntoPortal-Astro aims to make astronomy's semantic tools findable, comparable, and reusable.","key_machinery":"The load-bearing mechanism is the OntoPortal technology, deployed as an astronomy instance, which acts as a web platform that hosts semantic artefacts, exposes them with resolvable URIs, computes lexical mappings between them, and assesses their FAIRness. The second motor is the process the paper calls 'semantic lifting': converting community schemas that exist as XML models or term lists into OWL or SKOS ontologies with minted URIs. The platform's metadata model gives each artefact a formal description, and the built-in FAIRness assessment tool reports how each artefact can become more FAIR. The combination is what turns a scattered collection of vocabularies into a catalogue that machines can query.","core_discovery":"The central claim is that no existing astronomy service satisfies the FAIR requirements for a semantic artefact catalogue, and that a purpose-built instance of the OntoPortal technology can fill that role. The paper reports a prototype instance that ingests roughly forty artefacts from all three astronomy sub-communities, including the main thesaurus, the interoperability vocabularies, and newly drafted OWL versions of four schema-based standards (the planetary information model, the heliophysics data model, the virtual atomic and molecular data schema, and the particle-physics open-data terms). Importing the existing vocabularies exposed concrete defects—missing top-level concepts and inconsistent URIs—which the authors fixed, and the exercise produced new mappings between terms such as 'planet' in the exoplanet use case. On the paper's own terms, the discovery is that the semantic lifting of legacy schemas into OWL or SKOS is feasible, that the central portal makes this lifting visible and manageable, and that the community is ready to move from the prototype to a production service.","pith_inferences":["If the lifting succeeds, the same approach could be offered to other disciplines whose standards are still locked in XML or PDF, turning schema conversion into a shared service rather than a per-community chore.","A testable corollary of the paper's argument is that once the portal is live, usage of term URIs in data-repository metadata should grow; that is measurable through repository records.","The prototype's automatic lexical mapping between artefacts may make hand-built cross-community mappings less necessary, and AI-assisted alignment is a plausible next step the paper only gestures at."],"forward_implications":["A single astronomy-wide catalogue will replace the current scattered listings and libraries of semantic artefacts with one findable, searchable service.","Legacy XML schemas can be lifted into standard ontology formats, and the prototype demonstrates this for four community standards.","Terms used across sub-communities—'planet' versus 'exoplanet', observation facilities, units, reference frames—can be mapped once in the catalogue instead of being hard-coded in each client tool.","Vocabularies that lose their original hosting can still resolve their URIs through the portal, giving long-term persistence to their terms.","The import process itself improves the source vocabularies, as seen in the fixed top-level concepts and URI consistency in the interoperability vocabularies."],"supporting_citations":[{"why":"It supplies the OntoPortal technology on which the prototype and the planned production service are built.","marker":"(Jonquet et al., 2023)"},{"why":"It defines the FAIR principles that the catalogue is meant to make astronomy semantic artefacts satisfy.","marker":"(Wilkinson et al., 2016)"},{"why":"It specifies how the interoperability vocabularies are managed and encoded, the artefacts the prototype imports and improves.","marker":"(Demleitner et al., 2023)"},{"why":"It describes the planetary information model that the authors convert into an OWL ontology.","marker":"(Hughes et al., 2017)"},{"why":"It describes the heliophysics metadata standard that was lifted into an OWL test implementation.","marker":"(Roberts et al., 2018)"},{"why":"It provides the Unified Astronomy Thesaurus, one of the core artefacts and the basis of the keyword vocabulary.","marker":"(Frey and Accomazzi, 2018)"},{"why":"It delivers the landscape analysis showing that no existing astronomy catalogue meets the FAIR criteria, motivating the prototype.","marker":"(Jonquet and Grau, 2024a)"},{"why":"It defines the notion of semantic artefact and catalogue maturity used to frame the problem and the proposed solution.","marker":"(Corcho et al., 2024)"}],"fun_headline_variants":["Astronomy's semantic artefacts get one findable home","A single catalogue for astronomy's fragmented vocabularies","OntoPortal-Astro bridges astronomy's vocabulary gaps","Astronomy's ontologies and schemas finally aligned in one portal","One FAIR catalogue to replace astronomy's scattered registries"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The catalogue only delivers its promised integration if the groups that own each community standard supply and keep maintaining machine-readable OWL or SKOS versions of them; the paper itself notes that the planetary-archive community is not ready for that shift.","fun_headline_variants_meta":{"raw":{"variants":["Astronomy's semantic artefacts get one findable home","A single catalogue for astronomy's fragmented vocabularies","OntoPortal-Astro bridges astronomy's vocabulary gaps","Astronomy's ontologies and schemas finally aligned in one portal","One FAIR catalogue to replace astronomy's scattered registries"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001172,"raw_usage":{"total_tokens":4881,"prompt_tokens":1014,"completion_tokens":3867,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":630,"completion_tokens_details":{"reasoning_tokens":3787}},"tokens_in":630,"tokens_out":3867,"duration_ms":31865,"temperature":1.0,"reasoning_tokens":3787,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-16T12:18:55.554571+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Two years after the production launch, check the actual content of the service: if the planetary information model and the heliophysics metadata standard are still available only as XML schemas, with no maintained OWL or SKOS versions and no resolvable URIs in the catalogue, then the claimed unification has not happened.","supporting_citations":[{"cited_title":", author Gray , N","cited_arxiv_id":null,"evidence_quote":"It specifies how the interoperability vocabularies are managed and encoded, the artefacts the prototype imports and improves."},{"cited_title":", author Crichton, D.J","cited_arxiv_id":null,"evidence_quote":"It describes the planetary information model that the authors convert into an OWL ontology."},{"cited_title":", author Thieman, J","cited_arxiv_id":null,"evidence_quote":"It describes the heliophysics metadata standard that was lifted into an OWL test implementation."},{"cited_title":", author Accomazzi , A","cited_arxiv_id":null,"evidence_quote":"It provides the Unified Astronomy Thesaurus, one of the core artefacts and the basis of the keyword vocabulary."},{"cited_title":", author Ekaputra, F.J","cited_arxiv_id":null,"evidence_quote":"It defines the notion of semantic artefact and catalogue maturity used to frame the problem and the proposed solution."}],"review_version":1}