Pith. sign in

REVIEW 4 major objections 5 minor 13 references

A Rule-Based Methodology for Company Identification: Application to the Downstream Space Sector

T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A rule-based named-entity-recognition pipeline applied to French press articles and the national business registry identified 88 new downstream space companies, expanding the known sector database by more than a third.

desk verdict A transparent methodology paper whose headline 88 is really 58 plus 30 manually spotted co-cited firms—worth reviewing, but the abstract oversells the rule-based pipeline. read the letter →

arxiv 2412.02342 v1 pith:7BHBG4QQ submitted 2024-12-03 econ.GN q-fin.EC

Kenza Bousedra , Pierre Pelletier This is my paper · ORCID
classification econ.GNq-fin.EC
keywords downstreamspacesectornamedentityrecognitionrule-basedNLPtextminingcompanyidentificationFrenchpresseconomyindustryclassification
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper proposes a reusable text-mining method to find French companies in the downstream space sector, firms earning revenue from products and services built on satellite data such as communications, Earth observation, and navigation. The method is rule-based named-entity recognition: starting from 220 known downstream companies, it builds a dictionary from the national business registry using their industry codes and legal forms, then scans 48,900 French press articles and applies three further rules (capitalized words, a 30-word semantic context, and recurring name patterns) to shrink millions of possible firms to 1,475 candidates for expert review. In the first application, expert sorting confirmed 58 new downstream companies from that list, and co-citation during sorting uncovered 30 more, for 88 new companies and a more-than-a-third enrichment of the reference database. The paper's evaluation finds the rule cascade keeps 120 of the 128 known companies that appear in the query articles, while a generic statistical NER model recovers only 83 of those 128. If this holds, the method gives economists and space agencies a practical way to track a sector that official activity classifications cannot delimit, and a template that can be ported to other countries or industries.

What carries the argument

The load-bearing object is the Sirene dictionary: a subset of the French national business registry cut down to the 33 APE (official activity) codes and the 8 legal statuses that appear among the 220 known downstream companies. Around that dictionary the method wraps four rules: (1) keep only registry entries matching those codes and legal forms; (2) keep only words in the press text that start with a capital letter, with accents removed and punctuation preserved; (3) keep only matched company names that appear within 30 words of a word on the business-context list or the query's own keywords, so the citation is semantically anchored to downstream space; and (4) keep only names containing one of 18 recurring character strings observed in downstream company names. The cascade converts 6.9 million registered firms into 1,475 hand-checkable candidates, and that reduction, from national registry to expert-sortable list, is the mechanism that makes the identification tractable.

What would settle it

Hold out a random 30 of the 128 known companies that appear in the query articles, rebuild Rules 1, 3, and 4 using only the other 98, and count how many held-out companies the rebuilt pipeline recovers; if recovery is much below the reported 120 of 128, the rules are overfit to the seed database rather than capturing the sector.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central result is that a transparent, expert-crafted NER cascade can do what standard activity classifications and generic statistical NER do not: find downstream space companies in France that were previously unknown. Starting from 220 known downstream firms, the authors build a dictionary by filtering the French national business registry (6.9 million active legal units) to the 33 official activity codes and 8 legal forms present among the known firms, yielding 650,000 candidates. Matching these against the capitalized words of 48,900 French press articles on downstream space activity leaves 30,084 companies; requiring a mention within thirty words of a business or space-context word leaves 22,862; requiring one of eighteen recurring name patterns (such as data, geo, ima, sat, tele) leaves 1,475. Expert sorting of that list confirms 58 new downstream companies, and co-citation during sorting adds 30 more, for 88 new companies total and a final 2022 database of 334 firms, more than a quarter of them detected by the method. In the evaluation, the rule cascade keeps 120 of the 128 known companies that appear in the query articles, while a generic statistical NER model labels 268,015 entities yet recovers only 83 of those 128.

Load-bearing premise

The whole pipeline assumes that the 220 known downstream companies are a fair mold for the entire population, same activity codes, legal forms, capitalization habits, and name patterns, and that press coverage is a reliable net; since 31 of those 220 companies never appear in either press database, any downstream company that looks different or stays out of the news will be missed no matter how well the rules are tuned.

Editorial extensions

If this is right

  • The downstream-space company database can be updated annually by rerunning the four rules on a single year of press articles, with a substantial drop from the initial 12-day application time because the rules and query stay unchanged.
  • The same methodology can be transplanted to other countries: replace the registry, query language, and known-company seed list, and the rule cascade will produce a candidate list for the local downstream space sector.
  • For any industry whose firms straddle many official activity codes, the rule cascade offers a way to detect new entrants that sector-level input-output analysis misses.
  • The method's conservation ratio (120 of 128 known companies survive the text rules) indicates that most downstream companies that do appear in the query articles can be detected, while the 31 known companies never found in the press mark a hard ceiling on press-based identification.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Beyond the paper: because Rule 4's regular-expression list and Rule 1's code list are learned from the 2022 known-company snapshot, the pipeline's precision will decay as New Space applications diversify; an annual recalibration, as the paper recommends, is not just a convenience but a correctness condition.
  • Beyond the paper: the 30 co-cited 'by-product' companies suggest the press corpus contains an implicit network, firms mentioned together in the same article are likely to share programs, markets, or supplier links, and the paper's final paragraph points to this unexploited structure; converting co-citation into a graph would give an independent test of downstream membership.
  • Beyond the paper: the reported 4% precision among the 1,475 Rule-4 candidates implies the method is best read as a candidate generator, not a classifier; feeding the 88 new names plus their article contexts into a small trained NER model would likely close much of the gap toward the fully automated system the paper sketches.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes a rule-based Named Entity Recognition pipeline to identify French downstream space companies from press articles. The method filters the French Sirene company registry by APE codes and legal statuses (Rule 1), keeps only capitalized words in a downstream-space query corpus (Rule 2), retains matches within 30 words of context or query keywords (Rule 3), and finally keeps names containing hand-picked regular expressions (Rule 4). The pipeline reduced 6.9 million legal units to 1,475 candidates, which were then manually sorted by an expert. The paper reports 58 new companies from the strict application of the rules plus 30 'by-products' discovered through co-citation during sorting, for a total of 88 new downstream companies, and claims this enriches the known-company database by 33%.

Significance. If the central claim were properly supported, the paper would make a useful methodological contribution: it addresses a real gap in identifying downstream space firms that standard industrial classifications miss, and it provides a transparent, rule-based alternative to statistical NER with detailed intermediate counts, honest reporting of losses (31 of 220 known companies never appear in the press), a full query and rule list, a comparison with spaCy, and practical time estimates. These are genuine strengths. However, the headline result and its evaluation currently rest on an undocumented manual by-product step, in-sample performance metrics, and no released code or company list, which limits the paper's evidential value until those issues are repaired.

major comments (4)
  1. [Section 4; Table 5; Abstract] The headline figure of 88 is not the output of the rule-based method as defined. The text states that strict implementation of Rules 1-4 yielded 58 companies, while the 30 additional 'by-products' are companies that failed Rule 4 and were included only because an expert noticed their co-citation with Rule-4 companies during manual sorting. No operational criterion is given for co-citation: neither the set of intermediate-list companies examined nor the relationship, distance, or evidentiary threshold for inclusion is specified, so the 30 by-products cannot be reproduced. The abstract and conclusion nevertheless attribute all 88 companies to 'our rule-based named entity recognition approach.' The enrichment figures are also internally inconsistent: Table 5 sums to 334 but the text says 344; 88/220 is 40%, 88/246 is about 36%, and 88/334 is about 26%, none matching the stated 33%. The authors should report the strict-rule count and the by-product count separately, define a reproducible co-citation protocol or drop the by-products from the main claim, and reconcile the percentages.
  2. [Section 5.2.1; Section 3.2; Section 3.4; Section 3.5] The Conservation ratio of 120/128 is measured against the same set of known companies that was used to construct the rules. The APE codes (Rule 1), legal statuses, the Word Context list (Rule 3), and the regular expressions (Rule 4) were all derived from the 220-company reference database and a 500-article sample, and the 128 companies are a subset of those 220. The performance metrics therefore describe in-sample calibration, not predictive or discovery performance. The authors are transparent that they did not split the data, but the conclusion that the rules are effective should be framed as calibration; a stronger validation would use the 26 'Other' companies or newly collected firms as a holdout set. This is load-bearing because the paper's methodological value claim is that the rules identify companies beyond those used to build them.
  3. [Section 4; Section 6] The manual sorting of the 1,475 candidates is a single-expert classification with no inter-rater reliability measure, no codebook beyond a two-step procedure, and no audit trail. Given that only 58 of the 1,475 (about 4%) were classified as downstream companies and that the 30 by-products were added during the same subjective review, the classification step carries substantial weight in the main result. A reproducibility-focused methodology paper should provide a classification codebook, record for each accepted company the evidence used (press description, website keywords, or call-for-projects mention), and ideally report agreement with a second coder on a subsample. Without this, the numerical results cannot be independently verified or applied by other researchers.
  4. [Section 6; data availability] The paper promises guidelines for replication but does not release the article corpus, the code for the matching algorithm, the construction of the Sirene dictionary, or the final list of 334 companies with their sources. Since the method's contribution is methodological and the evaluation depends on exact intermediate lists and matching decisions, the absence of these materials prevents any independent audit of the 58-company strict result, the 30 by-products, or the comparison with spaCy. The authors should provide a supplementary data and code package, or at minimum the final company list and the code for Rules 1-4, before the reported numbers can be accepted as more than an illustrative application.
minor comments (5)
  1. [Section 4; Table 5; Section 7] The total number of companies in the final database is given as 344 in one place, 334 in Table 5, and 334 in the Discussion; these figures should be reconciled.
  2. [Section 3.3] The first sentence of Section 3.3 calls Rule 2 'The third rule,' although Rule 2 is the second rule in the numbering; this appears to be a typo.
  3. [Section 5.2.1; Section 4] The number of potential downstream companies after Rule 3 is reported as 22,862 in Section 4 and as 22,863 in Section 5.2.1; the discrepancy should be corrected.
  4. [Section 5.2.2] The comparison with spaCy is not apples-to-apples: spaCy labels organizations and miscellaneous entities without access to the Sirene dictionary, while the rule-based method starts from a dictionary matching step. Clarify that the 83 known companies are those whose names appeared among spaCy's labeled entities, rather than a dictionary-based identification, and discuss how this affects the interpretation of the comparison.
  5. [Section 2.1; Figure 5] The text refers to 'Figure 5.1' where it should refer to the figure on known-company losses, which is labeled Figure 5; please fix the cross-reference.

Circularity Check

1 steps flagged · score 4.0 of 10

Rule-evaluation metrics are in-sample (rules tuned on the known-company set), and the headline 88 mixes 30 non-rule by-products into the rule-based count; the core discovery claim still rests on independent manual verification.

  1. fitted input called prediction [Section 5.1 (Query verification) and Section 5.2.1 (Rules performance evaluation)]
    "Therefore, we have not split our 'known companies' database into a learning and test subset, as our approach has no machine learning process."

    The rules based on known-company characteristics (APE codes, legal statuses, context-word lists, regular expressions) were explicitly calibrated on the 220-company known database; Section 3.4 states the 30-word window was selected as 'the most efficient in terms of filtering and known companies kept.' Section 5.2.1 then reports the Conservation Ratio on those same companies (120 of 128 known companies after Rule 3) as evidence of rule quality. Because there is no held-out split, the reported conservation is a restatement of the tuning objective, not an independent prediction of rule performance.

full rationale

The paper is transparent that its rules are engineered from a 220-company seed database and a 500-article sample; this is a normal rule-construction setup and is not by itself circular. The circularity score is raised by the in-sample evaluation: the conservation of known companies (120/128) is reported as a performance measure even though the same known-company set was used to choose the APE codes, context-word list, regular expressions, and 30-word window, and the paper explicitly states there is no train/test split. A separate, non-circular but material defect affects the headline number: 'Eventually, we obtained 88 new downstream companies using our rule-based named entity recognition approach,' while Section 4 also says strict implementation yielded 58 and the other 30 are 'by-products' that failed Rule 4 and were found through an unformalized co-citation step during manual sorting. That makes 88 partly an expert-input count rather than a pure rule-based output; the enrichment figure changes if only the 58 are attributed to the method. The core discovery claim nevertheless retains independent content through manual verification of article context and company websites. No load-bearing self-citation or imported-uniqueness circularity is present; the Bousedra (2023) citation is used only for a definition. Overall, the circularity is partial and concentrated in the evaluation and result-aggregation steps, not in the basic idea of using hand-crafted rules to surface candidate companies.

Assumptions & free parameters 7 free parameters · 4 assumptions · 0 invented entities

The method has no invented physical entities. Its free parameters are hand-fitted to a seed set of 220 known downstream space companies and a 500-article sample. The only external anchor is the manual expert verification of candidates via article context and company websites. No code, data, or full company list is released, so the extractive pipeline is not independently reconstructable.

free parameters (7)
  • APE code set (33 sub-classes) = Table 1
    Selected as the activity codes of known downstream companies (Section 3.2); determines the Sirene dictionary.
  • Legal status set (8 codes) = Table 2
    Selected from the legal statuses of known downstream companies (Section 3.2).
  • Capital-letter restriction = Only words starting with a capital letter
    Assumes company names are always capitalized in press; implemented as Rule 2 (Section 3.3).
  • Context window size = 30 words before and after
    Chosen after trials to balance filtering and conservation; w=15 and w=10 lost too many known companies (Section 3.4).
  • Word Context word list = Table 3
    Built from a sample of 500 articles citing downstream companies (Section 3.4).
  • Regular expression list = Table 4 (agr, data, e-, farm, geo, ima, lab, map, nav, ocea, sat, sea, service, solution, space, system, tech, tele…
    Recurring character strings observed in known company names (Section 3.5).
  • Downstream space query keywords and proximity operators = Box 3
    Formulated and optimized to capture downstream space articles in Factiva and Europresse (Section 3.1).
assumptions (4)
  • domain assumption The known companies database of 220 companies is accurate and representative of the downstream space sector.
    All rules are derived from characteristics of these companies (Sections 2.1, 3.2, 3.4, 3.5). If the seed set is biased, the method inherits the bias.
  • domain assumption Company names always appear in press articles with an initial capital letter.
    Rule 2 eliminates all lowercase-initial words, and the authors report that 15 known companies were lost due to name misquoting (Sections 3.3, 5.1).
  • domain assumption Press coverage is a sufficient lens for identifying downstream space companies.
    31 of 220 known companies never appear in the two press databases, so the method cannot capture these companies (Section 5.1).
  • domain assumption Expert manual sorting of the final candidate list is a valid ground truth.
    The final classification of the 1,475 candidates relies on expert judgment, article context reading, and website keyword checks, with no inter-rater reliability or audit trail (Section 4).

how reviews work

0 comments
Cite this review

Pith. "Pith review of A Rule-Based Methodology for Company Identification: Application to the Downstream Space Sector." pith.science (2026). https://pith.science/paper/7BHBG4QQ

@misc{pith2026241202342,
  author       = {Pith},
  title        = {Pith review of: A Rule-Based Methodology for Company Identification: Application to the Downstream Space Sector},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/7BHBG4QQ}},
  note         = {Machine review of arXiv:2412.02342}
}
read the original abstract

This paper proposes an original methodology based on Named Entity Recognition (NER) to identify companies involved in downstream space activities, i.e., companies that provide services or products exploiting data and technology from space. Using a rule-based approach, the method leverages a corpus of texts from digitized French press articles to extract company names related to the downstream space segment. This approach allowed the detection of 88 new downstream space companies, enriching the existing database of the sector by 33\%. The paper details the identification process and provides guidelines for future replications, applying the method to other geographic areas, or adapting it to other industries where new entrants are challenging to identify using traditional activity classifications.

Figures

Figures reproduced from arXiv: 2412.02342 by the authors.

Figure 1
Figure 1. Rule-based strategy 2.1 Data collection The textual data were extracted from four data sources. The first two sources are the electronic press databases Factiva and Europresse, which we used for article collection. Factiva was our primary resource. It is a business-oriented platform offering access to more than 30,000 international sources, including newspapers, journals, business mag￾azines, and newswires. We used … view at source ↗
Figure 2
Figure 2. Downstream space query results: Number of articles published per year [PITH_FULL_IMAGE:figures/full_fig_p007_2.png] view at source ↗
Figure 3
Figure 3. The downstream space query (with Factiva language) [PITH_FULL_IMAGE:figures/full_fig_p011_3.png] view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Results of the first implementation The final step in the identification method was to manually sort the 1,475 companies obtained by applying the rules. The procedure for determining whether a company was effectively part of the downstream sector was in two stages: 1. …
Figure 5
Figure 5. Figure 5: illustrates the number of known companies before and after the application [PITH_FULL_IMAGE:figures/full_fig_p021_5.png]
Figure 5
Figure 5. Figure 5: Loss of known companies upon query application [PITH_FULL_IMAGE:figures/full_fig_p022_5.png]
Figure 6
Figure 6. Figure 6: Method evaluation: Rules performance and comparison with the statistical [PITH_FULL_IMAGE:figures/full_fig_p024_6.png]
Figure 7
Figure 7. Figure 7: Most visible journals, number of articles per source [PITH_FULL_IMAGE:figures/full_fig_p035_7.png]
Figure 8
Figure 8. Figure 8: Number of companies captured per article [PITH_FULL_IMAGE:figures/full_fig_p035_8.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

13 extracted references · 9 canonical work pages

  1. [5]

    Space Venture Europe 2018: Entrepreneurship and Private Investment in the European Space Sector

    ESPI. Space Venture Europe 2018: Entrepreneurship and Private Investment in the European Space Sector. Number

    work page 2018

  2. [10]

    URL https://www

    doi: https://doi.org/https://doi.org/10.1787/8bfef437-en. URL https://www. oecd-ilibrary.org/content/publication/8bfef437-en. Oxford Economics. The case for space: the impact of space derived services and data. Online: Oxford Economics http://www. oxfordeconomics. com/my- oxford/projects/129029. Paul Quirke,“African Space Programmes: Political or Scien- t...

    work page doi:10.1787/8bfef437-en

  3. [12]

    Summary Report: The Size and Health of the UK Space Industry 2021

    UK Space Agency. Summary Report: The Size and Health of the UK Space Industry 2021 . Prepared by BryceTech, London, United Kingdom,

    work page 2021

  4. [13]

    URL https://www.gov.uk/government/ publications/the-size-and-health-of-the-uk-space-industry-2021/ size-and-health-of-the-uk-space-industry-2021 . 8 Appendices 8.1 Information on newspaper texts collected Two sources are over-represented in our text database: ’AFP Infos Economiques’ with 5,500 articles and ’AFP Infos Françaises’ with around 5,000 articles...

    work page 2021

  5. [2004]

    URL https://onlinelibrary.wiley

    doi: https: //doi.org/10.1111/j.1540-6261.2004.00662.x. URL https://onlinelibrary.wiley. com/doi/abs/10.1111/j.1540-6261.2004.00662.x. S. K. Arora, J. Youtie, P. Shapira, L. Gao, and T. Ma. Entry strategies in an emerging technology: a pilot web-based study of graphene firms.Scientometrics, 95:1189–1207,

    arXiv 2004

  6. [2009]

    URL https: //doi.org/10.1177/0148558X0902400104

    doi: 10.1177/0148558X0902400104. URL https: //doi.org/10.1177/0148558X0902400104. D. Libaers, D. Hicks, and A. L. Porter. A taxonomy of small firm technology commer- cialization. Industrial and Corporate Change, 25(3):371–405,

    work page doi:10.1177/0148558x0902400104

  7. [2013]

    doi: https://doi.org/10.1016/ j.im.2013.05.010

    ISSN 0378-7206. doi: https://doi.org/10.1016/ j.im.2013.05.010. URL https://www.sciencedirect.com/science/article/pii/ S037872061300061X. W. Antweiler and M. Z. Frank. Is all that talk just noise? the information content of inter- net stock message boards.The Journal of Finance, 59(3):1259–1294,

    work page 2013

  8. [2015]

    32 P. J. Gorinski, H. Wu, C. Grover, R. Tobin, C. Talbot, H. Whalley, C. Sudlow, W. White- ley, and B. Alex. Named entity recognition for electronic health records: a comparison of rule-based and machine learning approaches.arXiv preprint arXiv:1903.03985,

    arXiv 1903

Show all 13 references
  1. [2016]

    URL https://doi.org/10.1086/688176

    doi: 10.1086/688176. URL https://doi.org/10.1086/688176. T. Hong and I. Han. Knowledge-based data mining of news information on the internet using cognitive maps and neural networks.Expert systems with applications, 23(1):1–8,

    doi

  2. [2019]

    doi: 10.2873/011961. A.-H. Tan et al. Text mining: The state of the art and the challenges. InProceedings of the pakdd 1999 workshop on knowledge disocovery from advanced databases, volume 8, pages 65–70,

    1999 doi

  3. [2020]

    URL https://www.asc-csa.gc.ca/eng/ publications/2020-state-canadian-space-sector-facts-figures-2019.asp . EARSC. EARSC Industry Survey

    2020

  4. [2021]

    2020 State of the Canadian Space Sector Report: Facts and Figures

    CSA. 2020 State of the Canadian Space Sector Report: Facts and Figures

    2020

  5. [2022]

    doi: https://doi.org/10.1016/j.spacepol.2021.101474

    ISSN 0265-9646. doi: https://doi.org/10.1016/j.spacepol.2021.101474. URL https://www.sciencedirect. com/science/article/pii/S0265964621000667. G. Hoberg and G. Phillips. Text-based network industries and endogenous product differ- entiation. Journal of Political Economy, 124(5...

    2021

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.