REVIEW 3 major objections 8 minor 28 references
Towards Robust and Reliable Concept Representations: Reliability-Enhanced Concept Embedding Model
T0 review · 3 major / 8 minor · reviewed 2026-08-09 · deepseek-v4-flash
Pith's one-line read A new concept-embedding model claims to resist background shifts by disentangling irrelevant features and aligning same-concept embeddings across samples.
desk verdict A solid, well-ablated empirical paper on making concept embeddings robust, but the signature mixup mechanism trains on mean-aligned inputs that differ from test-time inputs, so the gains may be partly a training artifact. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing objects are the positive and negative concept embeddings $\phi^+_k(h)$ and $\phi^-_k(h)$ of a Concept Embedding Model, which are blended into $\hat{c}_{i,k}$ by the predicted activation probability. RECEM adds two mechanisms on top: (1) Concept-Level Disentanglement, an encoder–decoder pair in which an auxiliary encoder $E_{\mathrm{dis}}$ extracts a concept-irrelevant vector $\hat{z}_i$, a Gradient Reversal Layer plus HSIC penalty pushes task information out of $\hat{z}_i$, and a decoder reconstructs the latent $h_i$ to preserve rich information; and (2) Concept Mixup, which replaces the active part of each concept embedding with a convex combination $\beta\bar{c}^+_k + (1-\beta)\hat{c}^+_{i,k}$ of the per-concept mean and the sample embedding, so the label predictor is trained on semantically aligned concepts. The final objective is $L_{\mathrm{task}} + \alpha L_{\mathrm{concept}} + \lambda_m L_m + \lambda_{\mathrm{cvd}} L_{\mathrm{cvd}} + \lambda_{\mathrm{rec}} L_{\mathrm{rec}}$.
What would settle it
Train RECEM exactly as specified, then evaluate the task classifier on the unadjusted embeddings $\hat{C}$ as the paper does, and compare against a variant trained directly on $\hat{C}$ with the same auxiliary losses. If the two accuracies are equal, Concept Mixup's benefit is real; if the mean-aligned training variant loses most or all of its TravelingBirds gain, the reported robustness is an artifact of the alignment shortcut rather than evidence of more reliable concepts.
Extended reading notes
Core claim
On its own terms, the paper's central discovery is that the two observed failure modes of Concept Embedding Models—entanglement with concept-irrelevant features and semantic inconsistency of the same concept across samples—can be treated as optimizable objectives rather than accepted limitations. By adding a disentanglement loss (adversarial cross-entropy with a Gradient Reversal Layer plus HSIC regularization) and a mixup loss that aligns active concept embeddings toward their class mean, RECEM produces concept embeddings with higher cosine similarity under background perturbation and higher Concept Alignment Score. On the three TravelingBirds variants, RECEM reaches 64.1%, 64.0%, and 65.0% task accuracy versus roughly 60–62% for the best baselines. The paper's conclusion is that reliability of the intermediate concept representation is the lever: when concepts are faithful, downstream accuracy, human intervention effectiveness, and domain-shift robustness all improve together.
Load-bearing premise
The central premise is that training the label predictor on concept embeddings pulled toward their per-concept means does not harm it when, at test time, it receives the raw unadjusted embeddings—this train/test distribution shift is never examined.
Editorial extensions
If this is right
- On the three TravelingBirds background-shift test sets, RECEM holds 63.99–65.00% task accuracy while the best baselines sit near 60–62%, so concept reliability translates directly into distribution-shift robustness.
- Concept Alignment Score rises sharply (CUB: 93.2 vs CEM's 86.1; CelebA: 84.4 vs 79.5), meaning the learned concepts line up with human ground-truth labels more faithfully.
- Human concept interventions become more effective: at higher intervention ratios RECEM approaches near-perfect task accuracy on CUB and CelebA, and it also leads on CelebA with incomplete concept annotations.
- The disentanglement and mixup mechanisms transfer to fuzzy concept bottleneck models, lifting Fuzzy-CBM task accuracy on CelebA by more than 10 points (33.8% to 44.3%), though Bool-CBM gains are marginal.
- Ablation confirms both components matter: removing either Concept Mixup or the disentanglement losses consistently degrades task accuracy across datasets.
Reading between the lines
- An unexamined gap: the task classifier is trained on mean-aligned embeddings $\dot{C}_i$ from Equations 14–17 but evaluated on unaligned embeddings $\hat{C}$ from Equation 1; if the decision boundary relies on the mean-shifted component, the claimed mixup benefit could shrink or reverse, and the paper does not analyse this mismatch.
- A natural extension would be to apply the same mean alignment at test time, or to train the classifier directly on unadjusted embeddings, and compare the two; this would isolate whether the robustness comes from genuinely disentangled concepts or from a train/test alignment shortcut.
- The higher OIS on CUB (56.5 vs CEM's 43.5) suggests the method may trade one form of leakage for another on correlated concepts; a leakage metric that does not assume concept independence could settle whether RECEM's representations are truly cleaner.
- Since Concept Mixup only aligns active concepts toward their mean, a testable extension would apply the same alignment to inactive concepts or to concept co-occurrence structure, which could further improve consistency in densely correlated attribute datasets like CUB.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes RECEM, an extension of Concept Embedding Models (CEM) with two additional mechanisms: Concept-Level Disentanglement, which uses an encoder-decoder with adversarial gradient reversal and HSIC regularization to remove concept-irrelevant information from concept embeddings, and Concept Mixup, which aligns active concept embeddings toward a per-concept mean during training. The authors evaluate RECEM on CUB, CelebA, AwA2, and TravelingBirds, reporting improved task accuracy, concept accuracy, and Concept Alignment Score over CBM, ProbCBM, Coop-CBM, and CEM, together with ablations and hyperparameter sensitivity experiments.
Significance. If the reported results hold, the paper makes a useful contribution to concept bottleneck models by addressing two concrete failure modes: sensitivity to background changes and intra-concept semantic inconsistency. The experimental study is reasonably thorough in its coverage of datasets and baselines, and the appendix contains meaningful additional checks: per-loss ablations (Table 1), hyperparameter sensitivity (Table 4), intervention curves (Figure 5), and attempts to port the mechanisms to Bool-CBM and Fuzzy-CBM (Appendix A.5). The main unresolved question is whether the gains attributed to Concept Mixup survive a correct train/test protocol, because the training-time input to the label predictor differs from the test-time input; this and the leakage metric result on CUB need to be addressed before the central claim can be accepted.
major comments (3)
- [4.4, Eqs. (14) and (17)] The label predictor f is trained on adjusted embeddings ˙C_i that use ground-truth masks and the training-set mean ¯c+_k, but at test time f receives unadjusted embeddings ˆC_i from Eq. (1). The paper never quantifies the distribution shift between ˙C_i and ˆC_i nor studies how f transfers across this shift; if f relies on the mean-aligned component, the task-accuracy gains in Table 3 and the L_m ablation gap in Table 1 could be inflated by the train/test mismatch rather than by improved concept reliability. Please provide an analysis of the input discrepancy, or train f only on unadjusted embeddings while keeping L_m as a regularizer on the concept encoder, or evaluate a test-time version of the alignment (e.g., predicted masks or a running mean) and show that the gains persist.
- [A.4, Table 5] On CUB, RECEM has a higher Oracle Impurity Score (56.541) than CEM (43.54), meaning more concept leakage according to this metric. The paper attributes this to correlated concepts and questions the validity of OIS, but this is the only direct leakage measurement reported, and it contradicts the abstract's claim that the disentanglement component isolates concept-irrelevant features. Please either provide an alternative leakage measure that supports the claim on correlated-concept datasets, or explicitly scope the disentanglement claim to datasets with near-independent concepts.
- [5.2, Table 2 with Eqs. (14)-(15)] The Concept Alignment Score improvement is partly by construction because L_m directly optimizes active embeddings toward the mean of the model's own embeddings, which mechanically reduces intra-concept variance and can increase alignment measures; the target is self-referential because the mean is computed from the current model. The CAS gap therefore does not by itself establish that the representations are more semantically faithful. Please report an independent evaluation of embedding quality (e.g., intervention accuracy under predicted masks, or a transfer/zero-shot check) and/or show that the improvement is not a collapse to a trivial point embedding.
minor comments (8)
- [4.2, Eq. (6)] The inequality asserting that prediction on mean embeddings is always better than on sample-specific embeddings is not generally true and is not proved; it should be presented as a heuristic motivation or empirically validated.
- [4.3 and 4.4] The symbol β is used for both the HSIC annealing weight in Eq. (11) and the mixup ratio in Eq. (14); clarify whether these are the same hyperparameter and specify the annealing schedule.
- [4.3, Eq. (10)] The gradient reversal coefficient λ is never given a value or schedule; please report it.
- [Figure 1 caption] The caption refers to 'CDCEM' while the method is called RECEM; unify the naming.
- [Figures 7 and 8] The two figure captions are identical, which appears to be a copy-paste error; make the captions describe the respective panels.
- [Table 2] Table 2 reports CAS for only CEM, Fuzzy-CBM, and RECEM; for completeness, report CAS for all baselines listed in Table 1.
- [5.1] The paper says all models use identical settings with SGD but does not report learning rate, weight decay, number of epochs, or batch size; include these for reproducibility.
- [4.4] The name 'Concept Mixup' is misleading: Eq. (14) implements attraction to a mean embedding, not a mixup between two or more samples; consider renaming the mechanism or clarifying the terminology.
Circularity Check
The concept-consistency evidence is partly by construction: Concept Mixup directly optimizes closeness to the model's own mean embedding, and the same closeness is then reported as a reliability gain.
-
self definitional
[Section 4.2 Eq. (5); Section 4.4 Eqs. (14)-(17); evidence in Section 5.2 and Fig. 7]
"Eri∼D h ∥ˆci,k − ¯ck∥2 2 i ... ˙ci,k = µi,k β¯c+ k + (1 − β)ˆc+ i,k + (1 − µi,k)ˆci,k ... Lm = − 1 N P i P m yi,j log fm [˙ci,1, . . . ,˙ci,K]"
The paper defines concept unreliability as distance from the mean embedding (Eq. 5), then defines Concept Mixup to pull active embeddings toward the training-set mean (Eqs. 14-15) and trains the downstream predictor on these mean-pulled inputs (Eq. 17). It then reports higher cosine similarity between same-concept embeddings and higher CAS as evidence of reliability. Since the reported consistency metric is precisely the quantity being minimized by the objective, the improvement is enforced by construction rather than independently verified. The target mean is computed from the model's own embeddings (Eq. 15), making the reference self-referential.
full rationale
The central circular step is confined to the concept-consistency claims. Eq. 5 defines inconsistency as variance around the mean embedding; Eqs. 14-17 directly minimize that variance by blending active embeddings with the training-set mean and training the classifier on the blended inputs. The paper's later statements that Concept Mixup 'ensures consistent, semantically aligned concept representations' and the Fig. 7 cosine-similarity evidence are therefore partly restatements of the training objective, not independent confirmations. The task-accuracy results in Tables 1 and 3, however, are measured on held-out test sets using the unadjusted embeddings of Eq. 1, so they are not forced by this construction. A separate weakness, which I treat as a correctness risk rather than circularity, is that Eq. 17 trains the label predictor on adjusted embeddings ˙Ci while inference uses unadjusted ˆCi; this train/test input-distribution shift is never analyzed, so attributing all task-accuracy gains to improved concept reliability is not fully supported. There is no load-bearing self-citation: the CEM framework is cited from external authors, and the paper does not invoke any uniqueness theorem from its own prior work. Overall, one metric is self-definitional, but the main benchmark numbers retain independent content, yielding a partial circularity score of 4.
Assumptions & free parameters
free parameters (5)
- lambda_m (concept mixup loss weight) =
0.1
- lambda_cvd (concept vector disentanglement loss weight) =
0.05
- lambda_rec (reconstruction loss weight) =
1.0
- beta (annealing coefficient) =
increases from 0, schedule unspecified
- lambda (GRL gradient reversal coefficient) =
not specified
assumptions (5)
- domain assumption Ground-truth concept labels are available for all training samples and are used to build the adjusted embeddings in Equations 8 and 14.
- domain assumption The Gradient Reversal Layer removes concept-relevant information from the irrelevant feature vector.
- domain assumption The semantic mean embedding is a stable, meaningful reference for each active concept.
- domain assumption The classifier trained on adjusted embeddings transfers to unadjusted embeddings at test time.
- domain assumption Standard dataset splits and evaluation protocols for CUB, CelebA, AwA2, and TravelingBirds are adopted without modification.
Cite this review
Pith. "Pith review of Towards Robust and Reliable Concept Representations: Reliability-Enhanced Concept Embedding Model." pith.science (2026). https://pith.science/paper/O4LO4BMK
@misc{pith2026250201191,
author = {Pith},
title = {Pith review of: Towards Robust and Reliable Concept Representations: Reliability-Enhanced Concept Embedding Model},
year = {2026},
howpublished = {\url{https://pith.science/paper/O4LO4BMK}},
note = {Machine review of arXiv:2502.01191}
}
read the original abstract
Concept Bottleneck Models (CBMs) aim to enhance interpretability by predicting human-understandable concepts as intermediates for decision-making. However, these models often face challenges in ensuring reliable concept representations, which can propagate to downstream tasks and undermine robustness, especially under distribution shifts. Two inherent issues contribute to concept unreliability: sensitivity to concept-irrelevant features (e.g., background variations) and lack of semantic consistency for the same concept across different samples. To address these limitations, we propose the Reliability-Enhanced Concept Embedding Model (RECEM), which introduces a two-fold strategy: Concept-Level Disentanglement to separate irrelevant features from concept-relevant information and a Concept Mixup mechanism to ensure semantic alignment across samples. These mechanisms work together to improve concept reliability, enabling the model to focus on meaningful object attributes and generate faithful concept representations. Experimental results demonstrate that RECEM consistently outperforms existing baselines across multiple datasets, showing superior performance under background and domain shifts. These findings highlight the effectiveness of disentanglement and alignment strategies in enhancing both reliability and robustness in CBMs.
Figures
Figures from the paper (5 more)
Reference graph
Works this paper leans on
-
[1]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION format.date year duplicate empty "emp...
-
[2]
Representation learning: A review and new perspectives
Bengio, Y., Courville, A., and Vincent, P. Representation learning: A review and new perspectives. IEEE transactions on pattern analysis and machine intelligence, 35 0 (8): 0 1798--1828, 2013
2013
-
[3]
Infogan: Interpretable representation learning by information maximizing generative adversarial nets
Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., and Abbeel, P. Infogan: Interpretable representation learning by information maximizing generative adversarial nets. Advances in neural information processing systems, 29, 2016
2016
-
[4]
C., and Wen, B
Cheng, H., Wang, Y., Li, H., Kot, A. C., and Wen, B. Disentangled feature representation for few-shot image classification. IEEE transactions on neural networks and learning systems, 2023
2023
-
[5]
Towards a Deeper Understanding of Concept Bottleneck Models Through End-to-End Explanation
Furby, J., Cunnington, D., Braines, D., and Preece, A. Towards a deeper understanding of concept bottleneck models through end-to-end explanation. arXiv preprint arXiv:2302.03578, 2023
work page Pith review arXiv 2023
-
[6]
Measuring statistical dependence with hilbert-schmidt norms
Gretton, A., Bousquet, O., Smola, A., and Sch \"o lkopf, B. Measuring statistical dependence with hilbert-schmidt norms. In International conference on algorithmic learning theory, pp.\ 63--77. Springer, 2005
2005
-
[7]
Addressing leakage in concept bottleneck models
Havasi, M., Parbhoo, S., and Doshi-Velez, F. Addressing leakage in concept bottleneck models. Advances in Neural Information Processing Systems, 35: 0 23386--23397, 2022
2022
-
[8]
Deep residual learning for image recognition
He, K., Zhang, X., Ren, S., and Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 770--778, 2016
2016
Show all 28 references
-
[9]
Towards a definition of disentangled representations
Higgins, I., Amos, D., Pfau, D., Racaniere, S., Matthey, L., Rezende, D., and Lerchner, A. Towards a definition of disentangled representations. arXiv preprint arXiv:1812.02230, 2018
2018 arXiv
-
[10]
Ib-gan: Disentangled representation learning with information bottleneck generative adversarial networks
Jeon, I., Lee, W., Pyeon, M., and Kim, G. Ib-gan: Disentangled representation learning with information bottleneck generative adversarial networks. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pp.\ 7926--7934, 2021
2021
-
[11]
Probabilistic concept bottleneck models
Kim, E., Jung, D., Park, S., Kim, S., and Yoon, S. Probabilistic concept bottleneck models. arXiv preprint arXiv:2306.01574, 2023
2023 arXiv
-
[12]
W., Nguyen, T., Tang, Y
Koh, P. W., Nguyen, T., Tang, Y. S., Mussmann, S., Pierson, E., Kim, B., and Liang, P. Concept bottleneck models. In International conference on machine learning, pp.\ 5338--5348. PMLR, 2020
2020
-
[13]
Oogan: Disentangling gan with one-hot sampling and orthogonal regularization
Liu, B., Zhu, Y., Fu, Z., De Melo, G., and Elgammal, A. Oogan: Disentangling gan with one-hot sampling and orthogonal regularization. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pp.\ 4836--4843, 2020
2020
-
[14]
Activity image-to-video retrieval by disentangling appearance and motion
Liu, L., Li, J., Niu, L., Xu, R., and Zhang, L. Activity image-to-video retrieval by disentangling appearance and motion. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pp.\ 2145--2153, 2021
2021
-
[15]
Deep learning face attributes in the wild
Liu, Z., Luo, P., Wang, X., and Tang, X. Deep learning face attributes in the wild. In Proceedings of the IEEE international conference on computer vision, pp.\ 3730--3738, 2015
2015
-
[16]
Promises and pitfalls of black-box concept learning models
Mahinpei, A., Clark, J., Lage, I., Doshi-Velez, F., and Pan, W. Promises and pitfalls of black-box concept learning models. arXiv preprint arXiv:2106.13314, 2021
2021 arXiv
-
[17]
Do concept bottleneck models learn as intended? arXiv preprint arXiv:2105.04289, 2021
Margeloiu, A., Ashman, M., Bhatt, U., Chen, Y., Jamnik, M., and Weller, A. Do concept bottleneck models learn as intended? arXiv preprint arXiv:2105.04289, 2021
2021 arXiv
-
[18]
and Ebrahimi Kahou, S
Sheth, I. and Ebrahimi Kahou, S. Auxiliary losses for learning generalizable concept-based models. Advances in Neural Information Processing Systems, 36, 2024
2024
-
[19]
Robustly disentangled causal mechanisms: Validating deep representations for interventional robustness
Suter, R., Miladinovic, D., Sch \"o lkopf, B., and Bauer, S. Robustly disentangled causal mechanisms: Validating deep representations for interventional robustness. In International Conference on Machine Learning, pp.\ 6056--6065. PMLR, 2019
2019
-
[20]
Disentangled representation learning gan for pose-invariant face recognition
Tran, L., Yin, X., and Liu, X. Disentangled representation learning gan for pose-invariant face recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 1415--1424, 2017
2017
-
[21]
Disentangling instructive information from ranked multiple candidates for multi-document scientific summarization
Wang, P., Li, S., Li, D., Long, K., Tang, J., and Wang, T. Disentangling instructive information from ranked multiple candidates for multi-document scientific summarization. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Informatio...
2024
-
[22]
Caltech-ucsd birds 200
Welinder, P., Branson, S., Mita, T., Wah, C., Schroff, F., Belongie, S., and Perona, P. Caltech-ucsd birds 200. 2010
2010
-
[23]
Improving robustness and generality of nlp models using disentangled representations
Wu, J., Li, X., Ao, X., Meng, Y., Wu, F., and Li, J. Improving robustness and generality of nlp models using disentangled representations. arXiv preprint arXiv:2009.09587, 2020
2009 arXiv
-
[24]
H., Schiele, B., and Akata, Z
Xian, Y., Lampert, C. H., Schiele, B., and Akata, Z. Zero-shot learning—a comprehensive evaluation of the good, the bad and the ugly. IEEE transactions on pattern analysis and machine intelligence, 41 0 (9): 0 2251--2265, 2018
2018
-
[25]
Multi-vae: Learning disentangled view-common and view-peculiar visual representations for multi-view clustering
Xu, J., Ren, Y., Tang, H., Pu, X., Zhu, X., Zeng, M., and He, L. Multi-vae: Learning disentangled view-common and view-peculiar visual representations for multi-view clustering. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 9234--9243, 2021
2021
-
[26]
Post-hoc concept bottleneck models
Yuksekgonul, M., Wang, M., and Zou, J. Post-hoc concept bottleneck models. arXiv preprint arXiv:2205.15480, 2022
2022 arXiv
-
[27]
E., Barbiero, P., Ciravegna, G., Marra, G., Giannini, F., Diligenti, M., Precioso, F., Melacci, S., Weller, A., Lio, P., et al
Zarlenga, M. E., Barbiero, P., Ciravegna, G., Marra, G., Giannini, F., Diligenti, M., Precioso, F., Melacci, S., Weller, A., Lio, P., et al. Concept embedding models. In NeurIPS 2022-36th Conference on Neural Information Processing Systems, 2022
2022
-
[28]
Places: A 10 million image database for scene recognition
Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., and Torralba, A. Places: A 10 million image database for scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40 0 (6): 0 1452--1464, 2018. doi:10.1109/TPAMI.2017.2723009
2018
Reviewed August 9, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.