REVIEW 3 major objections 4 minor 44 references
Fairness and Sparsity within Rashomon sets: Enumeration-Free Exploration and Characterization
T0 review · 3 major / 4 minor · reviewed 2026-08-08 · deepseek-v4-flash
Pith's one-line read The paper establishes that the extrema of a fairness metric over an epsilon-Rashomon set, under a sparsity cap, can be computed exactly by solving two mixed-integer programs, provided the hypothesis class admits a mathematical-programming…
desk verdict Genuinely new exact-MILP approach to fairness/sparsity tradeoffs over Rashomon sets, but the 'certifiably exact' claims need solver gap documentation. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the $\epsilon$-Rashomon set, the set of models $h \in H$ with $\hat{L}_S(h) \le \hat{L}_S(h_S) + \epsilon$, where $\hat{L}_S$ is the empirical 0/1 loss and $h_S$ is a loss-minimizing model. The framework converts exploration of this set into a two-stage mixed-integer program: first solve the learning problem with no regularization to obtain the reference loss $\hat{L}_S(h_S)$; then optimize the fairness metric, expressed as a linear function of prediction variables, subject to the sparsity constraint $\mathrm{Sparsity}(h) \le \alpha$ and the performance constraint $\hat{L}_S(h) \le \hat{L}_S(h_S) + \epsilon$. Flipping the sign of the objective yields the opposite extreme, so the two solves bracket the whole achievable fairness interval. The instantiations ride on two existing exact formulations: SLIM for scoring systems and a decision-diagram mixed-integer formulation, both of which express predictions with binary variables and linear constraints.
What would settle it
Rerun one experimental configuration from the paper, for example scoring systems on the Default of Credit Card Clients dataset with $\alpha=9$ and $\epsilon=10\%$, using a longer time limit or a different solver, and find a feasible model whose statistical parity lies outside the reported $[-0.124, -0.009]$ range for the same split; such a model would disprove the exactness claim. More fundamentally, exhibiting a scoring system in the hypothesis class that cannot be encoded by the allowed integer coefficient domains $\Omega_j$ would break the formulation's equivalence.
Extended reading notes
Core claim
The central claim is that one can certify, for a given dataset, hypothesis class, fairness metric, sparsity budget $\alpha$, and accuracy tolerance $\epsilon$, the exact minimum and maximum fairness value over all models in the Rashomon set, together with the models attaining them. The key move is to replace convex loss surrogates with the true 0/1 loss inside a mixed-integer program: because the fairness objective is optimized directly rather than by enumerating models, the Rashomon set is not shrunk by approximation. For scoring systems, the predictions are integer-coefficient linear rules encoded by the SLIM formulation; for decision diagrams, predictions are flows through a fixed directed acyclic graph encoded by a recent decision-diagram mixed-integer formulation. The paper reports that the resulting intervals are wide and often cross zero, that sparsity restrictions narrow them asymmetrically, and that on the Default dataset, scoring systems with at most nine non-zero coefficients within 10% of optimal accuracy necessarily predict default more often for women than for men --- a systematic disparate impact certified by the optimization.
Load-bearing premise
The framework's results are certified as exact only if the mixed-integer programs exactly represent every model in the hypothesis class and the solver proves global optimality in every run; the paper states that convergence was reached but reports no optimality gaps.
Editorial extensions
If this is right
- For any hypothesis class with a mathematical-programming formulation, the minimum and maximum of a fairness metric over the $\epsilon$-Rashomon set, under any sparsity cap, are computable and certified, along with models attaining them.
- A certified interval that stays entirely on one side of zero means no model in the Rashomon set can avoid favoring one protected group, so a \u201cbusiness necessity\u201d defense is either established or refuted for that class, dataset, sparsity, and tolerance.
- Sparsity constrains fairness: smaller sparsity budgets narrow the achievable fairness range, and tight enough budgets can exclude all models that favor the disadvantaged group, sometimes making bias systematic.
- Accuracy and sparsity interact asymmetrically with different fairness metrics: statistical parity and equal opportunity can respond differently to the same sparsity tightening because equal opportunity is conditioned on true labels.
- The hypothesis class is itself a decision variable: because decision diagrams with multivariate splits contain all scoring systems, they admit wider fairness trade-offs and make disparate impact harder to excuse by business necessity.
Reading between the lines
- The paper certifies fairness ranges on the training set; an immediate extension is to certify ranges that hold out-of-sample, for example by solving the same two-stage mixed-integer program on bootstrap samples or deriving high-probability bounds on test-set fairness extrema.
- Because the solver returns the models attaining each extreme, the machinery doubles as a generator of minimally discriminatory models, not just an auditor; one can extract a deployable model with a specified target fairness value and sparsity.
- The COMPAS scalability result --- more training data narrows the certified fairness range and amplifies the disadvantage --- suggests a testable hypothesis for other datasets: increasing $N$ can harden, rather than soften, the bias that sparsity imposes, because the Rashomon set of near-optimal models shrinks.
- The same two-stage pattern should apply to any property expressible as a linear function of predictions, such as calibration differences across groups or robustness to bounded input perturbations, even though the paper only instantiates fairness metrics.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes an enumeration-free framework for characterizing the extrema of fairness metrics (statistical parity and equal opportunity) within epsilon-Rashomon sets of a hypothesis class, subject to a sparsity bound. The idea is to solve a MILP whose objective is the fairness metric, with constraints enforcing membership in the hypothesis class, the sparsity limit, and a loss bound relative to the optimal 0/1 loss. The framework is instantiated for scoring systems via a modified SLIM formulation and for decision diagrams via a modified Florio et al. formulation. Experiments on Adult, Default of Credit Card Clients, and COMPAS report min/max fairness values across epsilon and alpha values and interpret them for business-necessity arguments. The core claim is that the method exactly and certifiably characterizes achievable fairness under accuracy and sparsity constraints.
Significance. If the certification claim can be substantiated, this is a valuable contribution: it replaces convex-surrogate-based Rashomon-set bounds with exact 0/1-loss optimization, handles sparsity explicitly, and applies to two interpretable model families with released code. The two instantiations are nontrivial, and the experiments cover three benchmark datasets and two fairness metrics. The main caveat is that the reported 'convergence' does not yet demonstrate the global optimality certificates on which the exactness claim rests. Since this appears to be an empirical verification issue rather than a flaw in the modeling idea, the contribution is worth publishing after the evidence is added or the claims are qualified.
major comments (3)
- [Section 5.1, 'Exploration of the Rashomon set'; Section 4.1, Problems (6) and (17)] The central exactness claim requires every Gurobi solve to terminate with a proof of global optimality (or a correct infeasibility certificate). Section 5.1 states only that 'Convergence was reached in all runs after at most five such iterations'; no optimality gaps, final incumbent-versus-bound values, or solver statuses are reported. The hot-starting procedure produces feasible incumbents and can help pruning, but it does not by itself establish optimality. If any run ended with a nonzero MIP gap, the reported min/max fairness values are bounds rather than certified extrema, and statements such as Result 3 ('certifiably inevitable') or the N/A entries in Table 3a (which require certified infeasibility) are not justified. Please report per-instance termination status and MIP gap, or qualify the 'certifiable' claim accordingly.
- [Section 4.2, Constraints (13)-(14)] The big-M constants O'_i and O_i are not defined. The correctness of the encoding z_i = 1[y_i x_i^T lambda <= 0] relies on these constants being large enough to enforce the implications in both directions and on the choice of the margin gamma. Please specify how O'_i and O_i are computed from the coefficient domains Omega_j and the data, and state the value of gamma; otherwise the formulation is not reproducible and a too-small choice could invalidate the loss computation.
- [Section 4.3, Equations (20)-(21)] The integrality of the flow variables w_iv is not stated. If w_iv are continuous, Constraint (20) does not force z_i to be binary, and the objective (17) would not exactly represent the statistical parity of a 0/1 classifier. Please state the domains of w_iv, f_{iuv}^+ and f_{iuv}^-, and t_{uv}^+ and t_{uv}^-, and either prove that the formulation's extreme points yield binary w_iv or add explicit integrality constraints.
minor comments (4)
- [Abstract] The phrase 'within less than 1% of the best possible training accuracy' is imprecise; the experiments use an epsilon schedule between the optimal loss and the majority-class loss, not a direct threshold on accuracy. Please rephrase to match the actual definition in Section 5.1.
- [Table 3a] Several numeric entries contain stray spaces (for example, '0 .077' and '0 .120'); please fix the formatting.
- [Section 4.2, after Eq. (15)] The sentence 'ensuring that (y_i x_i^T lambda) for all examples i is lower-bounded' is incomplete; it should say that the margin gamma bounds the score away from zero when the model is confident. Please reword.
- [Section 4.1, Equations (8) and (17)] The objective minimizes the raw difference of positive rates, but the connection between the binary predictions ^y_i and the indicators 1[h(x_i)=1] in Equations (2) and (3) is not stated explicitly before the objective is used. A one-sentence clarification would help the reader.
Circularity Check
No significant circularity: the claimed fairness extrema are computed by solving explicitly stated optimization problems whose constraints define the Rashomon set, sparsity, and hypothesis class, with no fitted parameter or self-citation chain standing in for the result.
full rationale
The derivation chain is self-contained. The paper defines the epsilon-Rashomon set in Equation (4) using the optimal 0/1 loss obtained by solving Problem (5) with C = 0, and then solves Problems (6), (8), and (17), whose objective is exactly the fairness metric and whose constraints are exactly the hypothesis-class membership, sparsity, and performance conditions. No parameter is fitted to the reported fairness extrema, and no prior result by the same authors is invoked to replace an argument: the SLIM formulation is an external published encoding of scoring systems, and the decision-diagram MILP of Florio et al. (2023), although co-authored by Vidal, is a published, independently checkable mathematical programming formulation of a hypothesis class rather than a statement of the target fairness characterization. The only notable caveat is empirical verifiability rather than circularity: Section 5.1 states 'Convergence was reached in all runs' without reporting Gurobi optimality gaps or solver logs, so a nonzero MIP gap would reduce the reported extrema to bounds; that is a correctness and evidence-reporting concern, not a circularity of the derivation. Accordingly, the honest finding is no significant circularity.
Assumptions & free parameters
free parameters (3)
- Scoring coefficient domain Ω =
{0, ±1, ±2, ±5, ±10, ±20, ±30, ±50}
- Decision diagram skeleton =
(1,2,3,3,3), 12 internal nodes, depth 5
- Rashomon set schedule (p) =
1%, 5%, 10%, 20% of the loss gap to the majority classifier
assumptions (4)
- domain assumption SLIM MILP formulation exactly encodes the class of scoring systems with 0/1 loss, as per Ustun et al. (2014).
- domain assumption The decision diagram MILP of Florio et al. (2023) exactly represents the allowed decision diagram space for the given skeleton.
- domain assumption Gurobi returns proven optimal solutions for all instances within the given time and memory limits.
- domain assumption Statistical parity and equal opportunity are the fairness criteria of interest, and the 0/1 loss is the utility measure defining the Rashomon set.
Cite this review
Pith. "Pith review of Fairness and Sparsity within Rashomon sets: Enumeration-Free Exploration and Characterization." pith.science (2026). https://pith.science/paper/3I6Y3XAO
@misc{pith2026250205286,
author = {Pith},
title = {Pith review of: Fairness and Sparsity within Rashomon sets: Enumeration-Free Exploration and Characterization},
year = {2026},
howpublished = {\url{https://pith.science/paper/3I6Y3XAO}},
note = {Machine review of arXiv:2502.05286}
}
read the original abstract
We introduce an enumeration-free method based on mathematical programming to precisely characterize various properties such as fairness or sparsity within the set of "good models", known as Rashomon set. This approach is generically applicable to any hypothesis class, provided that a mathematical formulation of the model learning task exists. It offers a structured framework to define the notion of business necessity and evaluate how fairness can be improved or degraded towards a specific protected group, while remaining within the Rashomon set and maintaining any desired sparsity level. We apply our approach to two hypothesis classes: scoring systems and decision diagrams, leveraging recent mathematical programming formulations for training such models. As seen in our experiments, the method comprehensively and certifiably quantifies trade-offs between predictive performance, sparsity, and fairness. We observe that a wide range of fairness values are attainable, ranging from highly favorable to significantly unfavorable for a protected group, while staying within less than 1% of the best possible training accuracy for the hypothesis class. Additionally, we observe that sparsity constraints limit these trade-offs and may disproportionately harm specific subgroups. As we evidenced, thoroughly characterizing the tensions between these key aspects is critical for an informed and accountable selection of models.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
, " * write output.state after.block = add.period write newline
ENTRY address archivePrefix author booktitle chapter edition editor eid eprint howpublished institution isbn journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.state.consts #0 'before.a...
-
[2]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in capitalize " " * FUNCT...
-
[3]
A \" vodji, U.; Arai, H.; Fortineau, O.; Gambs, S.; Hara, S.; and Tapp, A. 2019. Fairwashing: the risk of rationalization. In International Conference on Machine Learning, 161--170. PMLR
2019
-
[4]
Angwin, J.; Larson, J.; Mattu, S.; and Kirchner, L. 2016. Machine bias: There’s software used across the country to predict future criminals. And it’s biased against blacks. ProPublica (2016). ProPublica, May, 23
work page 2016
-
[5]
Aziz, H.; Cseh, \' A .; Dickerson, J. P.; and McElfresh, D. C. 2021. Optimal Kidney Exchange with Immunosuppressants. In Proceedings of the 35th AAAI Conference on Artificial Intelligence, AAAI 2021 , 21--29. AAAI Press
work page 2021
-
[6]
Black, E.; Koepke, L.; Kim, P.; Barocas, S.; and Hsu, M. 2024. The Legal Duty to Search for Less Discriminatory Algorithms. In The 2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024 , Non--archival paper
work page 2024
-
[7]
Breiman, L. 2001. Statistical modeling: The two cultures (with comments and a rejoinder by the author). Statistical science, 16(3): 199--231
work page 2001
-
[8]
Ciaperoni, M.; Xiao, H.; and Gionis, A. 2024. Efficient Exploration of the Rashomon Set of Rule-Set Models. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2024 , 478--489. ACM
work page 2024
Show all 44 references
-
[9]
Coker, B.; Rudin, C.; and King, G. 2021. A theory of statistical inference for ensuring the robustness of scientific results. Management Science, 67(10): 6174--6197
2021
-
[10]
F.; Lee, K.; Choksi, M
Cooper, A. F.; Lee, K.; Choksi, M. Z.; Barocas, S.; Sa, C. D.; Grimmelmann, J.; Kleinberg, J. M.; Sen, S.; and Zhang, B. 2024. Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification. In Proceedings of the 38th AAAI Conference on Artificial...
2024
-
[11]
Coston, A.; Rambachan, A.; and Chouldechova, A. 2021. Characterizing fairness over the set of good models under selective labels. In International Conference on Machine Learning, 2144--2155. PMLR
2021
-
[12]
B.; and Black, E
Dai, G.; Ravishankar, P.; Yuan, R.; Neill, D. B.; and Black, E. 2025. Be Intentional About Fairness!: Fairness, Size, and Multiplicity in the Rashomon Set. arXiv preprint arXiv:2501.15634
2025 arXiv
-
[13]
Doshi-Velez, F.; and Kim, B. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608
2017 arXiv
-
[14]
Dua, D.; and Graff, C. 2017. UCI Machine Learning Repository
2017
-
[15]
Dwork, C.; Hardt, M.; Pitassi, T.; Reingold, O.; and Zemel, R. 2012. Fairness through awareness. In Proceedings of the 3rd innovations in theoretical computer science conference, ITCS 2012, 214--226
2012
-
[16]
K.; Ben-David, S.; and Roy, D
Dziugaite, G. K.; Ben-David, S.; and Roy, D. M. 2020. Enforcing interpretability and its statistical impacts: Trade-offs between accuracy and interpretability. arXiv preprint arXiv:2010.13764
2020 arXiv
-
[17]
EEOC., T. U. March 2, 1979. Uniform guidelines on employee selection procedures
1979
-
[18]
A.; Moeller, J.; Scheidegger, C.; and Venkatasubramanian, S
Feldman, M.; Friedler, S. A.; Moeller, J.; Scheidegger, C.; and Venkatasubramanian, S. 2015. Certifying and Removing Disparate Impact. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2015 , 259--268. ACM
2015
-
[19]
Fisher, A.; Rudin, C.; and Dominici, F. 2019. All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously. J. Mach. Learn. Res., 20(177): 1--81
2019
-
[20]
M.; Martins, P.; Schiffer, M.; Serra, T.; and Vidal, T
Florio, A. M.; Martins, P.; Schiffer, M.; Serra, T.; and Vidal, T. 2023. Optimal Decision Diagrams for Classification. In Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023 , 7577--7585. AAAI Press
2023
-
[21]
Gambella, C.; Ghaddar, B.; and Naoum - Sawaya, J. 2021. Optimization problems for machine learning: A survey. Eur. J. Oper. Res., 290(3): 807--828
2021
-
[22]
Ganesh, P.; Chang, H.; Strobel, M.; and Shokri, R. 2023. On The Impact of Machine Learning Randomness on Group Fairness. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2023 , 1789--1800. ACM
2023
-
[23]
Grover, S. S. 1995. The business necessity defense in disparate impact discrimination cases. Ga. L. Rev., 30: 387
1995
-
[24]
Guidotti, R.; Monreale, A.; Ruggieri, S.; Turini, F.; Giannotti, F.; and Pedreschi, D. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR), 51(5): 1--42
2018
-
[25]
Gurobi Optimization, LLC . 2023. Gurobi Optimizer Reference Manual
2023
-
[26]
Hardt, M.; Price, E.; and Srebro, N. 2016. Equality of opportunity in supervised learning. Advances in neural information processing systems, 29: 3315--3323
2016
-
[27]
Hsu, H.; and Calmon, F. 2022. Rashomon capacity: A metric for predictive multiplicity in classification. Advances in Neural Information Processing Systems, 35: 28988--29000
2022
-
[28]
Kohavi, R. 1994. Bottom-Up Induction of Oblivious Read-Once Decision Graphs: Strengths and Limitations. In Proceedings of the 12th National Conference on Artificial Intelligence, AAAI 1994, 613--618. AAAI Press / The MIT Press
1994
-
[29]
Langenkamp, M.; Costa, A.; and Cheung, C. 2020. Hiring fairly in the age of algorithms. arXiv preprint arXiv:2004.07132
2020 arXiv
-
[30]
Laufer, B.; Raghavan, M.; and Barocas, S. 2025. Fundamental Limits in the Search for Less Discriminatory Algorithms--and How to Avoid Them. In ACM CS&Law 2025
2025
-
[31]
Marx, C.; Calmon, F.; and Ustun, B. 2020. Predictive multiplicity in classification. In International Conference on Machine Learning, 6765--6774. PMLR
2020
-
[32]
Mata, K.; Kanamori, K.; and Arimura, H. 2022. Computing the Collection of Good Models for Rule Lists. In 18th International Conference on Machine Learning and Data Mining (MLDM 2022)
2022
-
[33]
Mehrabi, N.; Morstatter, F.; Saxena, N.; Lerman, K.; and Galstyan, A. 2021. A survey on bias and fairness in machine learning. ACM computing surveys (CSUR), 54(6): 1--35
2021
-
[34]
Oliver, J. 1993. Decision graphs -- an extension of decision trees. In Proceedings of the 4th international workshop on artificial intelligence and statistics (AISTATS), 343—350
1993
-
[35]
Rudin, C. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature machine intelligence, 1(5): 206--215
2019
-
[36]
Rudin, C.; Chen, C.; Chen, Z.; Huang, H.; Semenova, L.; and Zhong, C. 2022. Interpretable machine learning: Fundamental principles and 10 grand challenges. Statistic Surveys, 16: 1--85
2022
-
[37]
Simson, J.; Pfisterer, F.; and Kern, C. 2024. One Model Many Scores: Using Multiverse Analysis to Prevent Fairness Hacking and Evaluate the Influence of Model Design Decisions. In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024 ...
2024
-
[38]
Slack, D.; Hilgard, S.; Jia, E.; Singh, S.; and Lakkaraju, H. 2020. Fooling lime and shap: Adversarial attacks on post hoc explanation methods. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, AIES 2020, 180--186
2020
-
[39]
Ustun, B.; Tracà, S.; and Rudin, C. 2014. Supersparse Linear Integer Models for Interpretable Classification. arXiv
2014
-
[40]
Verma, S.; and Rubin, J. 2018. Fairness definitions explained. In Proceedings of the International Workshop on Software Fairness, FairWare 2018, 1–7. Association for Computing Machinery
2018
-
[41]
C.; and Ustun, B
Watson - Daniels, J.; Parkes, D. C.; and Ustun, B. 2023. Predictive Multiplicity in Probabilistic Classification. In Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023 , 10306--10314. AAAI Press
2023
-
[42]
Xin, R.; Zhong, C.; Chen, Z.; Takagi, T.; Seltzer, M.; and Rudin, C. 2022. Exploring the whole rashomon set of sparse decision trees. Advances in neural information processing systems, 35: 14071--14084
2022
-
[43]
Yeh, I.-C.; and hui Lien, C. 2009. The comparisons of data mining techniques for the predictive accuracy of probability of default of credit card clients. Expert Systems with Applications, 36(2, Part 1): 2473--2480
2009
-
[44]
Zhong, C.; Chen, Z.; Liu, J.; Seltzer, M.; and Rudin, C. 2024. Exploring and interacting with the set of good sparse generalized additive models. Advances in neural information processing systems, 36
2024
Reviewed August 8, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.