Gender Differences in Research Topic and Method Selection in Library and Information Science: Perspectives from Three Top Journals

Chengzhi Zhang; Liang Tian; Siqi Wei; Yi Zhao

arxiv: 2607.01828 · v1 · pith:V2EUSCOKnew · submitted 2026-07-02 · 💻 cs.DL · cs.CL· cs.CY

Gender Differences in Research Topic and Method Selection in Library and Information Science: Perspectives from Three Top Journals

Chengzhi Zhang , Siqi Wei , Yi Zhao , Liang Tian This is my paper

Pith reviewed 2026-07-03 02:24 UTC · model grok-4.3

classification 💻 cs.DL cs.CLcs.CY

keywords gender differencesresearch methodslibrary and information scienceinterview methodtheoretical approachautomatic classification

0 comments

The pith

In library and information science, women tend to select interview methods while men prefer theoretical approaches, independent of research topic.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper investigates whether gender differences in research method selection exist in library and information science after accounting for topic choice. Using data from three top journals and an automatic full-text model CogFT, it finds women more likely to use interviews and men theoretical methods. This holds across topics, offering insights into research design processes that may contribute to gender disparities in academia. Sympathetic readers would care as it suggests ways to promote inclusivity through method awareness.

Core claim

Gender influences the choice of research methods in LIS, with women favoring Interview and men favoring Theoretical approach, and this pattern persists across a range of research topics as determined by analysis of full texts from three journals.

What carries the argument

The CogFT automatic classification model, which identifies the primary research method from a paper's full text based on cognition of its content.

If this is right

Gender differences in method use are not solely due to differences in topic selection.
Specific design processes in research contribute to observed gender patterns in methods.
Guidance on research methods could help address gender inclusivity in academic fields like LIS.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

Similar patterns might appear in other social science fields if analyzed similarly.
Interventions in research training could test if method preferences can be balanced.
The findings raise questions about whether these differences affect the types of knowledge produced in the field.

Load-bearing premise

The CogFT model correctly classifies the primary research method in each paper from its full text, and author genders can be accurately inferred from names or metadata.

What would settle it

A hand-coded sample of papers where the model's method labels differ substantially from human coders, or an analysis showing no gender difference when using alternative method classifications.

read the original abstract

Research in the social sciences has shown that there are gender differences in the selection of research methods, with women often opting for qualitative methods while men prefer quantitative methods. However, it is important to consider that research methods are generally chosen based on the research topic. To figure out the influence of gender on research method selection, a study was conducted in the field of Library and Information Science, using a more fine-grained method classification system and an automatic classification model called CogFT, which is based on full-text cognition. The findings showed that women tend to use Interview while men prefer Theoretical approach, across a range of topics. The study offers insights into the specific research design processes that contribute to gender differences in method selection and suggests ways to promoting gender inclusivity and equality in academia by considering research method use and guidance.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

The gender-method split in three LIS journals depends on an unvalidated CogFT classifier and name-based gender labels, so the central claim needs more support.

read the letter

The paper finds that across three top LIS journals, women authors lean toward interview methods while men favor theoretical ones, and this pattern holds after looking at topics. They built CogFT, a full-text model, to assign methods at a finer grain than prior work, then compared by inferred author gender.

What the paper does is take a known social-science pattern and test it inside Library and Information Science with actual full-text classification instead of relying on titles or keywords. That choice of scope and the attempt to separate topic from method are the concrete steps forward.

The soft spots are right where the stress test flagged them. No accuracy, precision, or confusion-matrix numbers appear for CogFT on these journals, and the abstract gives no detail on how gender was assigned from names or metadata. If either step has even moderate error, especially on non-Western names or method edge cases, the reported difference could be noise. The dataset is also limited to three journals, so broader claims would need more data anyway.

This is the sort of observational piece that could interest people who study research practices or gender in the social sciences. A reader already working on method choice in LIS might pull the dataset or the taxonomy for their own checks. The thinking is straightforward and engages the literature on its own terms, even if the evidence is still thin.

I would send it to peer review so referees can see the full validation and robustness checks. As written, the result is not yet solid enough to cite or build on.

Referee Report

3 major / 1 minor

Summary. The manuscript analyzes articles from three top Library and Information Science journals to examine gender differences in research topic and method selection. It applies an automatic full-text classification model (CogFT) to assign primary research methods and infers author gender from names or metadata. The central claim is that women tend to select the Interview method while men prefer the Theoretical approach, and that this pattern persists across topics after controlling for topic. The work concludes with suggestions for promoting gender inclusivity in research design.

Significance. If the core observational result is robust, the paper would add a fine-grained, topic-controlled view of gender-method associations within LIS, extending prior social-science findings on qualitative vs. quantitative preferences. The use of full-text classification and a multi-journal corpus are potential strengths, but the absence of any reported validation for the classifier or gender labels limits the strength of the contribution.

major comments (3)

[Abstract / Methods] Abstract and Methods: No accuracy, precision, recall, or confusion-matrix figures are supplied for the CogFT model on the three target journals. Because the headline gender-method association rests entirely on the correctness of these automatic labels, the lack of validation metrics is load-bearing for the central claim.
[Abstract / Methods] Abstract and Methods: No description is given of the gender-inference procedure (name-based, metadata, or otherwise), no error-rate estimates are provided, and no sensitivity analysis appears for plausible misclassification rates (especially on non-Western names). If gender labels contain >5–10 % error that correlates with method, the reported cross-topic difference could be an artifact.
[Results] Results: The claim that the gender difference holds 'across a range of topics' requires a topic-controlled analysis; the abstract supplies no table, figure, or statistical test showing that the Interview/Theoretical split remains after topic is held constant.

minor comments (1)

[Abstract] Abstract: Minor grammatical issues ('to figure out the influence', 'suggests ways to promoting') should be revised for clarity.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the constructive comments, which highlight important areas for strengthening the manuscript's transparency and robustness. We address each major comment below.

read point-by-point responses

Referee: [Abstract / Methods] Abstract and Methods: No accuracy, precision, recall, or confusion-matrix figures are supplied for the CogFT model on the three target journals. Because the headline gender-method association rests entirely on the correctness of these automatic labels, the lack of validation metrics is load-bearing for the central claim.

Authors: We agree that explicit validation metrics for CogFT on the three target journals are necessary. Although the model was validated in its original development, we omitted journal-specific performance figures. In the revision we will add a Methods subsection reporting accuracy, precision, recall, and a confusion matrix obtained from manual annotation of a stratified sample drawn from the three journals. revision: yes
Referee: [Abstract / Methods] Abstract and Methods: No description is given of the gender-inference procedure (name-based, metadata, or otherwise), no error-rate estimates are provided, and no sensitivity analysis appears for plausible misclassification rates (especially on non-Western names). If gender labels contain >5–10 % error that correlates with method, the reported cross-topic difference could be an artifact.

Authors: We acknowledge the need for fuller documentation. Gender was inferred via a standard name-based algorithm supplemented by metadata where available. The revised Methods section will describe the exact procedure, cite benchmark error rates, and include a sensitivity analysis that varies plausible misclassification rates, with explicit attention to non-Western names. revision: yes
Referee: [Results] Results: The claim that the gender difference holds 'across a range of topics' requires a topic-controlled analysis; the abstract supplies no table, figure, or statistical test showing that the Interview/Theoretical split remains after topic is held constant.

Authors: The manuscript already stratifies the gender-method associations by topic to support the claim that the Interview/Theoretical pattern persists across topics. To make the controlled analysis more prominent, we will insert an explicit table (or figure) in the Results section that presents the within-topic comparisons together with the associated statistical tests, and we will update the abstract to reference this controlled evidence. revision: yes

Circularity Check

0 steps flagged

No significant circularity; empirical analysis is data-driven

full rationale

The paper conducts an empirical analysis of journal articles by applying the CogFT model to classify research methods and inferring gender from metadata, then reporting observed associations. No equations, fitted parameters, or self-citations are described that would reduce the gender-method findings to inputs by construction. The derivation chain consists of standard data processing steps without self-definitional loops, fitted-input predictions, or load-bearing self-citations.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

The central claim depends on the unstated accuracy of the CogFT classifier and on the assumption that name-based gender inference is sufficiently accurate; no free parameters, axioms, or invented entities are described in the abstract.

pith-pipeline@v0.9.1-grok · 5676 in / 1157 out tokens · 22120 ms · 2026-07-03T02:24:38.609777+00:00 · methodology

discussion (0)

Reference graph

Works this paper leans on

6 extracted references · 6 canonical work pages

[1]

Angelov, D. (2020). Top2Vec: Distributed representations of topics (arXiv:2008.09470). https://doi.org/10.48550/arXiv.2008.09470 Ashmos Plowman, D., & Smith, A.D. (2011). The gendering of organizational research methods: Evidence of gender patterns in qualitative research. Qualitative Research in Organizations and Management: An International Journal, 6(1...

work page doi:10.48550/arxiv.2008.09470 2020
[2]

https://doi.org/10.1097/SLA.0000000000004057 Herubel, J.-P.V .M

Annals of Surgery, 275(1), e115. https://doi.org/10.1097/SLA.0000000000004057 Herubel, J.-P.V .M. (1992). Authorship, gender, and institutional affiliation in library history. 16 Behavioral & Social Sciences Librarian, 11(1), 49–54. https://doi.org/10.1300/J103v11n01_04 Holman, L., Stuart-Fox, D., & Hauser, C.E. (2018). The gender gap in science: How long...

work page doi:10.1097/sla.0000000000004057 1992
[3]

https://doi.org/10.1108/JD-10-2020-0171 Ma, J., & Lund, B

Journal of Documentation, 77(5), 1196–1208. https://doi.org/10.1108/JD-10-2020-0171 Ma, J., & Lund, B. (2021). The evolution and shift of research topics and methods in library and information science. Journal of the Association for Information Science and Technology, 72(8), 1059–1074. https://doi.org/10.1002/asi.24474 Mairesse, J., & Pezzoni, M. (2015). ...

work page doi:10.1108/jd-10-2020-0171 2020
[4]

https://doi.org/10.1080/09540253.2017.1290219 Su, R., & Rounds, J

Gender and Education, 31(1), 33–61. https://doi.org/10.1080/09540253.2017.1290219 Su, R., & Rounds, J. (2015). All STEM fields are not created equal: People and things interests explain gender disparities across STEM fields. Frontiers in Psychology, 6,

work page doi:10.1080/09540253.2017.1290219 2017
[5]

Su, R., Rounds, J., & Armstrong, P.I. (2009). Men and things, women and people: A meta- analysis of sex differences in interests. Psychological Bulletin, 135(6), 859–884. 18 https://doi.org/10.1037/a0017364 Sun, C., Qiu, X., Xu, Y ., & Huang, X. (2019). How to fine-tune BERT for text classification? In M. Sun, X. Huang, H. Ji, Z. Liu, & Y . Liu (Eds.), Ch...

work page doi:10.1037/a0017364 2009
[6]

19 https://doi.org/10.1007/s11192-023-04740-3 Zhang, H., & Zhang, C

Scientometrics, 128(7), 3981-4006. 19 https://doi.org/10.1007/s11192-023-04740-3 Zhang, H., & Zhang, C. (2021). Using full-text content of academic articles to build a methodology taxonomy of information science in China. Knowledge Organization, 48(2), 126–139. https://doi.org/10.5771/0943-7444-2021-2-126 Zhang, L., Sivertsen, G., Du, H., Huang, Y ., & Gl...

work page doi:10.1007/s11192-023-04740-3 2021

[1] [1]

Angelov, D. (2020). Top2Vec: Distributed representations of topics (arXiv:2008.09470). https://doi.org/10.48550/arXiv.2008.09470 Ashmos Plowman, D., & Smith, A.D. (2011). The gendering of organizational research methods: Evidence of gender patterns in qualitative research. Qualitative Research in Organizations and Management: An International Journal, 6(1...

work page doi:10.48550/arxiv.2008.09470 2020

[2] [2]

https://doi.org/10.1097/SLA.0000000000004057 Herubel, J.-P.V .M

Annals of Surgery, 275(1), e115. https://doi.org/10.1097/SLA.0000000000004057 Herubel, J.-P.V .M. (1992). Authorship, gender, and institutional affiliation in library history. 16 Behavioral & Social Sciences Librarian, 11(1), 49–54. https://doi.org/10.1300/J103v11n01_04 Holman, L., Stuart-Fox, D., & Hauser, C.E. (2018). The gender gap in science: How long...

work page doi:10.1097/sla.0000000000004057 1992

[3] [3]

https://doi.org/10.1108/JD-10-2020-0171 Ma, J., & Lund, B

Journal of Documentation, 77(5), 1196–1208. https://doi.org/10.1108/JD-10-2020-0171 Ma, J., & Lund, B. (2021). The evolution and shift of research topics and methods in library and information science. Journal of the Association for Information Science and Technology, 72(8), 1059–1074. https://doi.org/10.1002/asi.24474 Mairesse, J., & Pezzoni, M. (2015). ...

work page doi:10.1108/jd-10-2020-0171 2020

[4] [4]

https://doi.org/10.1080/09540253.2017.1290219 Su, R., & Rounds, J

Gender and Education, 31(1), 33–61. https://doi.org/10.1080/09540253.2017.1290219 Su, R., & Rounds, J. (2015). All STEM fields are not created equal: People and things interests explain gender disparities across STEM fields. Frontiers in Psychology, 6,

work page doi:10.1080/09540253.2017.1290219 2017

[5] [5]

Su, R., Rounds, J., & Armstrong, P.I. (2009). Men and things, women and people: A meta- analysis of sex differences in interests. Psychological Bulletin, 135(6), 859–884. 18 https://doi.org/10.1037/a0017364 Sun, C., Qiu, X., Xu, Y ., & Huang, X. (2019). How to fine-tune BERT for text classification? In M. Sun, X. Huang, H. Ji, Z. Liu, & Y . Liu (Eds.), Ch...

work page doi:10.1037/a0017364 2009

[6] [6]

19 https://doi.org/10.1007/s11192-023-04740-3 Zhang, H., & Zhang, C

Scientometrics, 128(7), 3981-4006. 19 https://doi.org/10.1007/s11192-023-04740-3 Zhang, H., & Zhang, C. (2021). Using full-text content of academic articles to build a methodology taxonomy of information science in China. Knowledge Organization, 48(2), 126–139. https://doi.org/10.5771/0943-7444-2021-2-126 Zhang, L., Sivertsen, G., Du, H., Huang, Y ., & Gl...

work page doi:10.1007/s11192-023-04740-3 2021