REVIEW 4 major objections 6 minor 37 references
Structural Bias Beyond Homophily: A Study of Fairness in Link Prediction
T0 review · 4 major / 6 minor · reviewed 2026-08-02 · deepseek-v4-flash
Pith's one-line read The fairness of link prediction is largely determined by graph topology, and current fairness-aware methods remain sensitive to structural biases beyond homophily.
desk verdict A useful benchmark toolkit for fair link prediction, but the beyond-homophily claim needs confounder control before it can carry weight. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the combination of a taxonomy of structural bias measures and an extended Barabási-Albert (preferential attachment) graph generator. The taxonomy classifies biases into node-level measures (closeness, betweenness, prestige, degree, constraint, density, heterogeneity, and effective-resistance-based isolation, diameter, and control) and graph-level measures (assortativity, average mixed distance, power exponent, and information unfairness), each defined as a normalized difference between sensitive groups. The generator extends the standard preferential-attachment model with four modular controls: sensitive attribute imbalance (α), homophily intensity (β), anchor-based
What would settle it
A concrete check: use the generator to create graphs where each structural measure is residualized on assortativity (so they vary independently), and test whether fairness still changes when assortativity is fixed. If fairness no longer changes with heterogeneity, information unfairness, or power exponent, the claim of sensitivity to beyond-homophily biases is falsified. Alternatively, compare fairness of a model on real-world graphs matched for assortativity but differing on these other biases; if fairness is invariant, the claim is refuted.
Extended reading notes
Core claim
The paper's central claim is that fairness outcomes in link prediction are strongly correlated with graph topology, and that current fairness-aware methods remain sensitive to structural biases beyond homophily. Empirically, the authors report R^2 > 0.8 when regressing fairness scores on structural bias measures across three synthetic use cases (opinion blogs, friendship ego-networks, and collaboration networks) and multiple models (Node2Vec, SVD, NMF, Fairwalk, DeBayes, CrossWalk, FairAdj, FLIP). They also show, in Section 5.3, that when graphs are partitioned by assortativity, fairness metrics still change as heterogeneity, information unfairness, and power exponent vary, indicating that t
Load-bearing premise
The extended Barabási-Albert generator is assumed to vary structural biases independently enough that subsets matched on assortativity isolate each named bias; in fact, all bias measures vary with both class imbalance and homophily parameters, so the observed fairness changes may be driven by other correlated structural features.
Editorial extensions
If this is right
- If fairness is strongly determined by topology, a fairness-aware method validated on one graph may not transfer to another graph with the same homophily but different heterogeneity or information flow; benchmarking must therefore vary multiple structural biases.
- The proposed taxonomy and generator provide a reusable testbed for fair link prediction, enabling stress-testing of methods under controlled bias configurations.
- Reporting fairness metrics alone is insufficient; papers should report the structural bias profile of the evaluation graph to make results comparable.
- The high R^2 (above 0.8) implies fairness scores are largely predictable from structural measures, suggesting structural bias measures could serve as diagnostics or proxies for fairness when sensitive attributes are incomplete.
Reading between the lines
- Because the paper's own Appendix C shows the bias measures are correlated, the independent effect of each beyond-homophily bias is not fully isolated; a generator that orthogonalizes these measures would provide stronger evidence for the specific attributions.
- The strong R^2 may partly reflect the generator's parameterization; testing on real-world graphs with varied topologies would clarify whether the topology–fairness link is as strong outside the synthetic corpus.
- The paper's conclusions imply that homophily-focused fairness methods (such as fair random walks) should be re-evaluated in low-assortativity, high-heterogeneity networks, where their assumptions may break down.
- The taxonomy could be extended to multivalued or multivariate sensitive attributes, and the same generation framework could test whether the conclusions hold when groups are defined by more than one attribute.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces a benchmarking framework for fair link prediction centered on structural biases in graphs. It proposes a taxonomy of node-level and graph-level bias measures, extends the Barabási–Albert generator with sensitive-attribute imbalance α, homophily intensity β, anchor-based community structure, and Gamma-distributed degree variability, and evaluates eight LP models on synthetic graphs fitted to three real datasets (Polblogs, Facebook ego, co-authorship). Using a corpus of over 1,000 graphs per setting, the authors report high Random Forest R² values (Table 3) when regressing fairness metrics on structural-bias measures, analyze feature importances, and claim in RQ3 that fairness-aware methods remain sensitive to HETEROGENEITY, INFO UNFAIRNESS, and POWER EXP even when assortativity is held fixed (Table 4, Tables 6–10).
Significance. The paper addresses an important and underexplored problem: fairness evaluation in link prediction has focused on homophily, while other structural biases may also affect fairness outcomes. The taxonomy is a useful synthesis of existing measures, and the generator is simple, interpretable, and calibrated to real network statistics. The study covers multiple fairness-aware methods across three distinct use cases, and the fixed-assortativity comparison is a meaningful step beyond homophily. If the main empirical claim were established, this would be a valuable contribution to fair graph learning and would motivate structurally grounded benchmarks. The high R² correlation result is plausible and interesting; however, the causal attribution of 'beyond homophily' sensitivity and the reproducibility of the experiments require substantial strengthening.
major comments (4)
- [§5.3, Tables 4, 6–10] The central claim that fairness-aware methods are sensitive to structural biases beyond homophily is not established by the presented analysis. The generator controls only α and β directly; HETEROGENEITY, INFO UNFAIRNESS, POWER EXP, and the other bias measures are emergent and correlated functions of α and β. Appendix C heatmaps show every bias measure varies with both parameters, and Appendix C.1 reports strong inter-measure correlations. Appendix D further shows that SP/EO grow directly with α. Partitioning graphs into low/high ASSORTATIVITY and then splitting on a third measure cannot isolate that measure, because α, degree disparity, density, and other collinear features vary within the bins. The Mann-Whitney tests only establish that the subsets have different metric distributions, not which feature drives the difference. To support the specific attribution, the authors need generat
- [§5.1, Table 3] The RQ1 analysis uses Random Forest regressors with all bias measures as features. The reported R² is an in-sample fit, not an independent predictive or explanatory result, and impurity-based feature importance on collinear features is not a reliable attribution. The statement that fairness scores 'can be largely explained by the graph’s topological properties' is therefore overstated. Moreover, the text says 'R² values consistently above 0.8', but Table 3 reports NMF EO Opinion R²=0.74. Please report cross-validated R², error bars across the 5 splits, and clearly distinguish correlation, prediction, and explanation. If 'explainability' is intended, a variance partition or ablations with held-out feature sets would be needed.
- [Section 5 and Appendix D] The paper states: 'All models achieve strong predictive performance (see Appendix D), ensuring that observed fairness differences are not confounded by weak predictive quality.' Appendix D actually reports Hit@10 values as low as 0.01–0.09 and AP@10 near 0.00 for the Opinion use case (e.g., Figures 21–22, 25–26, 29–30). If models are near-random or poorly calibrated on these graphs, fairness differences can be driven by very few positive predictions. The manuscript should report AUC or a comparable metric for every model and use case, and either demonstrate strong performance across metrics or restrict the fairness analysis to settings where predictive quality is sufficient.
- [§5.3, Tables 4, 6–10] The construction of the compared subsets is underspecified. 'Low/high ASSORTATIVITY' and 'subsets that differ significantly in HETEROGENEITY, INFO UNFAIRNESS, POWER EXP' need precise operational definitions: quantile thresholds, number of graphs, whether the subsets are disjoint, and the corresponding α/β ranges. The tables report percentage changes without raw values, confidence intervals, or effect sizes, and the large number of comparisons in the appendix would require multiple-testing correction. Without this information, the stability and reproducibility of the RQ3 results cannot be assessed.
minor comments (6)
- [Appendix A] Typo: 'V ⊂ E × E' should be 'E ⊂ V × V'. Also, 'Fiendship' in Appendix B.1 and 'convoltuonal' in reference [19] should be corrected.
- [Table 1] The caption says 'Measures in red are from fairness-oriented works', but the red color is not visible in monochrome print or plain text. Use bold symbols or asterisks instead.
- [Figure 4] The caption should explain what the red crosses represent and how the box plots aggregate over the 5 train/test splits and graph realizations.
- [§5.1, Table 3] The column '%R² assessed by ASSORTATIVITY' is not defined. Is this the R² of a univariate regression using only assortativity, or a variance partition in the Random Forest? Please clarify in the caption.
- [Reproducibility] No code, seeds, or exact graph counts are provided. For a benchmark contribution, please include a reproducibility appendix with generator hyperparameters, random seeds, and code/data availability.
- [Tables 4, 6–10] Significance is indicated by color, which is lost in monochrome or text-based versions. Add asterisks and report p-values or effect sizes.
Circularity Check
No definitional circularity; results are empirical. Minor in-sample-fit issue in RQ1, but RQ3's fixed-assortativity comparisons provide independent, non-tautological evidence.
-
fitted input called prediction
[Section 5.1 (RQ1) and Table 3]
"To assess how strongly structural biases influence fairness outcomes, we train Random Forest regressors to predict fairness scores from structural bias measures. ... Table 3 shows the R2 scores ... The results reveal a strong link between structural bias and fairness, with R2 values consistently above 0.8. This indicates that fairness scores can be largely explained by the graph's topological properties."
The high R2 is presented as evidence of a 'strong link' between structural bias and fairness, but it is the in-sample fit of regressors trained on the same fairness scores they are used to explain; no held-out or cross-validated prediction of fairness from structural measures is reported. The explanatory claim therefore partly restates the fitted relationship. This is a minor form of the fitted-input-called-prediction pattern, and it does not affect the independent RQ3 fixed-assortativity comparisons.
full rationale
The paper is an empirical study rather than a derivation, and no central result reduces to its inputs by construction. The taxonomy and bias measures are defined independently of model fairness outcomes; the graph generator varies α and β, and fairness metrics are measured from trained LP models, so the reported correlations and sensitivity results are not definitional. RQ3 partitions graphs by measured assortativity and compares subsets differing in other bias measures, providing a non-tautological comparison even if confounds among the emergent bias measures remain a validity concern. Self-citations (e.g., [21]) appear only in related-work context and are not load-bearing. The sole mild circularity is RQ1's in-sample R2 being framed as evidence of explanation rather than as a predictive validation; this is minor and does not undermine the paper's main empirical claims.
Assumptions & free parameters
free parameters (5)
- α (sensitive class imbalance) =
0.52 (Opinion), 0.66 (Friendship), 0.53 (Collab); swept 0.50–0.90
- β (homophily intensity) =
swept 0–8 (Opinion/Collab), 0–3.8 (Friendship)
- m (expected edges per new node) =
14 (Opinion), 3 (Collab); Friendship uses affine 0.55·deg(u)+3
- γ (Gamma variance parameter) =
0.08 (Opinion), 1 (Collab); not used for Friendship
- anchor-node attachment weights =
Friendship: 1-hop high, 2-hop 2, 3+hop 1; Collab: 1-hop 1, 2+hop 0
assumptions (5)
- domain assumption Barabási–Albert preferential attachment produces graphs whose structural bias space is representative of real-world social networks for link-prediction fairness.
- domain assumption Measured assortativity is an adequate proxy for homophily when constructing 'fixed homophily' subsets in RQ3.
- domain assumption Random-forest impurity importance is a reliable attribution of fairness variance to individual collinear structural measures.
- domain assumption Binary sensitive attribute and dyadic/statistical-parity fairness metrics capture the fairness-relevant bias for the studied tasks.
- standard math Effective resistance and information-unfairness measures from [31] and [16] are well-defined for the generated graphs.
Cite this review
Pith. "Pith review of Structural Bias Beyond Homophily: A Study of Fairness in Link Prediction." pith.science (2026). https://pith.science/paper/MVPUD5AM
@misc{pith2026260211802,
author = {Pith},
title = {Pith review of: Structural Bias Beyond Homophily: A Study of Fairness in Link Prediction},
year = {2026},
howpublished = {\url{https://pith.science/paper/MVPUD5AM}},
note = {Machine review of arXiv:2602.11802}
}
read the original abstract
Graph link prediction (LP) plays a critical role in socially impactful applications such as job recommendation and friendship formation, making fairness a critical concern in this task. While many fairness-aware methods manipulate graph structures to mitigate prediction disparities, the topological biases inherent to social graphs remain poorly understood and are consistently conflated with homophily alone. In this work, we study the relationship between structural biases and fairness outcomes in LP. To this end, we formalize a taxonomy of topological bias measures and introduce a graph generation method producing a diverse corpus of synthetic graphs with controlled structural properties. Using this corpus, we show empirically that fairness outcomes are strongly correlated with graph topology, and that current fairness-aware methods remain sensitive to structural biases beyond homophily. These findings highlight the need for structurally grounded evaluations in fair graph learning.
Figures
Figures from the paper (29 more)
Reference graph
Works this paper leans on
-
[1]
Stochastic blockmodels: First steps
Paul Holland et al. “Stochastic blockmodels: First steps”. In:Social networks5.2 (1983), pp. 109–137. 21 Model Assor. Heterogeneity Info unfairness Power exp Hit EO SP Hit EO SP Hit EO SP crosswalk high -0.50.3 35.8 0.8-0.4 -43 -0.60.4 45.2 low -1.4 0.5 61.2 0.9-0.4 -48.9 -0.80.4 58.1 debayes high -0.3 0.1 10.5 -0.1 -0.1 -13.5 -0.20.4 15.8 low -1.40.6 63....
1983
-
[2]
Network measures of social capital
Stephen P Borgatti et al. “Network measures of social capital”. In:Connections21.2 (1998), pp. 27–36
1998
-
[3]
Emergence of scaling in random networks
Albert-L ´aszl´o Barab´asi and R´eka Albert. “Emergence of scaling in random networks”. In:science286.5439 (1999), pp. 509–512
1999
-
[4]
Birds of a feather: Homophily in social networks
Miller McPherson et al. “Birds of a feather: Homophily in social networks”. In:Annual review of sociology27.1 (2001), pp. 415–444
2001
-
[5]
The structure and function of complex networks
Mark EJ Newman. “The structure and function of complex networks”. In:SIAM review45.2 (2003), pp. 167–256
2003
-
[6]
The political blogosphere and the 2004 US election: divided they blog
Lada A Adamic and Natalie Glance. “The political blogosphere and the 2004 US election: divided they blog”. In: Proceedings of the 3rd international workshop on Link discovery. 2005, pp. 36–43. 22
2004
-
[7]
Finding structure with randomness: Probabilistic algo- rithms for constructing approximate matrix decompositions
Nathan Halko, Per-Gunnar Martinsson, and Joel A Tropp. “Finding structure with randomness: Probabilistic algo- rithms for constructing approximate matrix decompositions”. In:SIAM review53.2 (2011), pp. 217–288
2011
-
[8]
penguin UK, 2011
Eli Pariser.The filter bubble: What the Internet is hiding from you. penguin UK, 2011
2011
Show all 37 references
-
[9]
Learning to discover social circles in ego networks
Jure Leskovec and Julian Mcauley. “Learning to discover social circles in ego networks”. In:Advances in neural information processing systems25 (2012)
2012
-
[10]
node2vec: Scalable feature learning for networks
Aditya Grover and Jure Leskovec. “node2vec: Scalable feature learning for networks”. In:Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining. 2016, pp. 855–864
2016
-
[11]
Sources of segregation in social networks: A novel approach using Facebook
Bas Hofstra et al. “Sources of segregation in social networks: A novel approach using Facebook”. In:American Sociological Review82.3 (2017), pp. 625–656
2017
-
[12]
Pitfalls of graph neural network evaluation
Oleksandr Shchur et al. “Pitfalls of graph neural network evaluation”. In:arXiv preprint arXiv:1811.05868(2018)
2018 arXiv
-
[13]
Algorithmic glass ceiling in social networks: The effects of social recommendations on network diversity
A Stoica et al. “Algorithmic glass ceiling in social networks: The effects of social recommendations on network diversity”. In:Proceedings of the 2018 World Wide Web Conference. 2018, pp. 923–932
2018
-
[14]
Fairwalk: Towards Fair Graph Embedding
Tahleen Rahman et al. “Fairwalk: Towards Fair Graph Embedding”. In:Proceedings of the Twenty-Eighth Inter- national Joint Conference on Artificial Intelligence, IJCAI-19. International Joint Conferences on Artificial Intelli- gence Organization, July 2019, pp. 3289–3295.DOI: 1...
2019 doi
-
[15]
DeBayes: a Bayesian method for debiasing network embeddings
Maarten Buyl and Tijl De Bie. “DeBayes: a Bayesian method for debiasing network embeddings”. In:Proceedings of ICML. 2020
2020
-
[16]
On the information unfairness of social networks
Zeinab S Jalali et al. “On the information unfairness of social networks”. In:Proceedings of the 2020 SIAM Inter- national Conference on Data Mining. SIAM. 2020, pp. 613–521
2020
-
[17]
Bursting the filter bubble: Fairness-aware network link prediction
Farzan Masrour et al. “Bursting the filter bubble: Fairness-aware network link prediction”. In:Proceedings of the AAAI conference on artificial intelligence. V ol. 34. 2020, pp. 841–848
2020
-
[18]
Geom-gcn: Geometric graph convolutional networks
Hongbin Pei et al. “Geom-gcn: Geometric graph convolutional networks”. In:arXiv preprint arXiv:2002.05287 (2020)
2002 arXiv
-
[19]
Investigating and mitigating degree-related biases in graph convoltuional networks
Xianfeng Tang et al. “Investigating and mitigating degree-related biases in graph convoltuional networks”. In:Pro- ceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, pp. 1435– 1444
2020
-
[20]
Say no to the discrimination: Learning fair graph neural networks with limited sensitive attribute information
Enyan Dai and Suhang Wang. “Say no to the discrimination: Learning fair graph neural networks with limited sensitive attribute information”. In:Proceedings of the 14th ACM international conference on web search and data mining. 2021, pp. 680–688
2021
-
[21]
All of the fairness for edge prediction with optimal transport
Charlotte Laclau et al. “All of the fairness for edge prediction with optimal transport”. In:International Conference on Artificial Intelligence and Statistics. PMLR. 2021, pp. 1774–1782
2021
-
[22]
On dyadic fairness: Exploring and mitigating bias in graph connections
Peizhao Li et al. “On dyadic fairness: Exploring and mitigating bias in graph connections”. In:International Con- ference on Learning Representations. 2021
2021
-
[23]
Fairdrop: Biased edge dropout for enhancing fairness in graph representation learning
Indro Spinelli et al. “Fairdrop: Biased edge dropout for enhancing fairness in graph representation learning”. In: IEEE Transactions on Artificial Intelligence3.3 (2021), pp. 344–354
2021
-
[24]
Graph learning with localized neighborhood fairness
April Chen et al. “Graph learning with localized neighborhood fairness”. In:arXiv preprint arXiv:2212.12040 (2022)
2022 arXiv
-
[25]
Edits: Modeling and mitigating data bias for graph neural networks
Yushun Dong et al. “Edits: Modeling and mitigating data bias for graph neural networks”. In:Proceedings of the ACM web conference 2022. 2022, pp. 1259–1269
2022
-
[26]
Crosswalk: Fairness-enhanced node representation learning
Ahmad Khajehnejad et al. “Crosswalk: Fairness-enhanced node representation learning”. In:Proceedings of the AAAI Conference on Artificial Intelligence. V ol. 36. 2022
2022
-
[27]
Fairlp: Towards fair link prediction on social network graphs
Yanying Li et al. “Fairlp: Towards fair link prediction on social network graphs”. In:Proceedings of the interna- tional AAAI conference on web and social media. V ol. 16. 2022, pp. 628–639
2022
-
[28]
Fairedit: Preserving fairness in graph neural networks through greedy graph editing
Donald Loveland et al. “Fairedit: Preserving fairness in graph neural networks through greedy graph editing”. In: arXiv preprint arXiv:2201.03681(2022)
2022 arXiv
-
[29]
Beyond real-world benchmark datasets: An empirical study of node classification with GNNs
Seiji Maekawa, Koki Noda, Yuya Sasaki, et al. “Beyond real-world benchmark datasets: An empirical study of node classification with GNNs”. In:Advances in Neural Information Processing Systems35 (2022), pp. 5562–5574
2022
-
[30]
A survey on deep graph generation: Methods and applications
Yanqiao Zhu et al. “A survey on deep graph generation: Methods and applications”. In:Learning on Graphs Conference. PMLR. 2022, pp. 47–1
2022
-
[31]
Structural Group Unfairness: Measurement and Mitigation by means of the Effec- tive Resistance
Adrian Arnaiz-Rodriguez et al. “Structural Group Unfairness: Measurement and Mitigation by means of the Effec- tive Resistance”. In:arXiv preprint arXiv:2305.03223(2023). 23
2023 arXiv
-
[32]
Evaluating graph neural networks for link prediction: Current pitfalls and new benchmarking
Juanhui Li et al. “Evaluating graph neural networks for link prediction: Current pitfalls and new benchmarking”. In:Advances in Neural Information Processing Systems36 (2023), pp. 3853–3866
2023
-
[33]
GenCAT: Generating attributed graphs with controlled relationships between classes, at- tributes, and topology
Seiji Maekawa et al. “GenCAT: Generating attributed graphs with controlled relationships between classes, at- tributes, and topology”. In:Information Systems115 (2023), p. 102195
2023
-
[34]
A topology-aware analysis of graph collaborative filtering
Daniele Malitesta et al. “A topology-aware analysis of graph collaborative filtering”. In:arXiv preprint arXiv:2308.10778 (2023)
2023 arXiv
-
[35]
Link Prediction Without Learning
Simon Delarue et al. “Link Prediction Without Learning”. In:European Conference on Artificial Intelligence. 2024
2024
-
[36]
Fairgen: Towards fair graph generation
Lecheng Zheng et al. “Fairgen: Towards fair graph generation”. In:2024 IEEE 40th International Conference on Data Engineering (ICDE). IEEE. 2024, pp. 2285–2297
2024
-
[37]
Fairness amidst non-IID graph data: A literature review
Wenbin Zhang et al. “Fairness amidst non-IID graph data: A literature review”. In:AI Magazine46.1 (2025), e12212. 24
2025
Reviewed August 2, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.