REVIEW 4 major objections 6 minor 24 references
Completion of the DrugMatrix Toxicogenomics Database using 3-Dimensional Tensors
T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read Modeling DrugMatrix as a 3D tensor and completing it with an attention-augmented factorization yields lower error and preserves rare gene signals that 2D and CP baselines flatten.
desk verdict Plausible tensor-completion setup for DrugMatrix, but the headline numbers aren't in the text and the random holdout doesn't match the real missingness. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is a third-order tensor $\mathcal{X}\in\mathbb{R}^{R\times U\times I}$ built by mapping DrugMatrix's 2D rows and columns into tissue, gene, and treatment modes. ToxiTenCompl is a CP-style low-rank factorization into tissue, gene, and treatment factor matrices, with the predicted entry $\hat{y}_{r,u,i}=\sum_{d=1}^k r^{(d)}_r\,u^{(d)}_u\,i^{(d)}_i$ plus gene- and treatment-specific biases. Two additions carry the argument: an attention weight per latent component, computed by a softmax over component products, which lets the model modulate contributions for each tissue–gene–treatment triple; and a weighted MSE loss with a variance penalty $-\lambda\,\mathrm{Var}(\hat{y})$, which counteracts the pull toward the global mean in a dataset where 91.94% of fold changes are near zero. The non-negative version enforces non-negative factors after shifting the tensor, enabling tissue-factor cosine similarity clustering.
What would settle it
Retrain ToxiTenCompl with a tissue-stratified holdout that hides all brain and intestine entries (the tissues with the least data) and compare MAE and MSE against the 2D baseline; if the advantage disappears, the random-holdout gain does not transfer to the entries the completion is meant to fill.
Extended reading notes
Core claim
The paper's central claim is that DrugMatrix, conventionally viewed as a 2D matrix of endpoints by treatments, is better modeled as a 3D tensor indexed by tissue, gene, and treatment, and completed by a gradient-descent factorization the authors call ToxiTenCompl. With an attention term and a weighted loss that counteracts the dominance of near-zero fold changes, ToxiTenCompl reaches lower validation MAE, MSE, and weighted MAE than the 2D ToxiCompl method and than generic CP decomposition; it also produces predictions whose distribution stays closer to the observed data and preserves rare over- and under-expression signals that the baselines pull toward the mean. A non-negative version yields tissue factor vectors whose cosine similarities mark closer relationships among bone marrow, kidney, and intestine. The paper interprets these results as evidence that preserving multi-way structure helps complete the sparsely observed transcriptomic part of DrugMatrix and can support tissue-level toxicology analysis.
Load-bearing premise
The evaluation assumes a random holdout of observed entries represents the missing entries, though the unobserved entries are absent in a systematic, tissue-dependent way.
Editorial extensions
If this is right
- The full DrugMatrix tensor can be reconstructed with lower expected error than the previous 2D completion, giving toxicologists a more faithful version of the roughly 580-million-entry database to mine.
- Rare, biologically meaningful gene-expression shifts are less likely to be smoothed away, so downstream analyses of over- and under-expressed genes rest on more reliable imputed values.
- Tissue factor clustering can be used to generate hypotheses about shared biology across organs; the paper specifically finds higher similarity among bone marrow, kidney, and intestine.
- The gradient-descent, attention-augmented formulation establishes a practical alternative to classical alternating-minimization tensor completion for large sparse biological tensors.
- Because treatment factors are explicit, the same tensor framework can be extended to higher dimensions with dose or time as a separate mode, a direction the paper names as future work.
Reading between the lines
- Reading beyond the paper: the reported comparison is on a random holdout, so if DrugMatrix's real missingness is systematic (brain and intestine have far fewer observations than liver and kidney), the accuracy gain may not carry over to the entries the method is meant to fill.
- A natural next experiment the paper does not run is a tissue-stratified holdout that withholds whole tissues, which would directly test whether the 3D model helps where data are genuinely absent rather than randomly missing.
- The attention weights and tissue factors could be probed against known tissue-expression atlases or independent toxicology benchmarks; a match would turn the internal factor structure into an externally validated biological signal.
- If the distribution-preservation result transfers across species, the same tensor completion could be used to fill rat-to-human extrapolation gaps, though the paper only gestures at that possibility.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes ToxiTenCompl, a CP-style tensor completion method for the DrugMatrix toxicogenomics database. The authors convert the DrugMatrix 2D matrix into a 3D tensor over tissues, genes, and treatment conditions; add an attention mechanism over latent factors; and train with a weighted MSE loss augmented by a variance penalty. They report that ToxiTenCompl achieves lower validation MAE, MSE, weighted MAE, and MaxAE than the 2D ToxiCompl baseline and the generic CP baseline, and that its predictions better match the original data distribution, especially for rare and extreme gene-expression signals. A non-negative variant gives tissue factor vectors whose cosine similarities are interpreted as tissue-tissue relationships. The paper concludes that the completed database is more accurate than previous completions and that the tensor approach is promising for cross-species toxicogenomics.
Significance. If the quantitative claims held, the paper would make a useful applied contribution: it is a plausible next step beyond the 2D ToxiCompl baseline, it explicitly addresses the highly skewed distribution of DrugMatrix, and the non-negative tissue factors provide a concrete, interpretable output. The paper also deserves credit for framing completion as a machine-learning optimization problem rather than as a purely algebraic tensor routine, and for including a tissue-level analysis that goes beyond aggregate error. However, the reported evidence is substantially weaker than the claims: no numerical values, error bars, significance tests, or test-set sizes are given; all quantitative comparisons appear only in figures. The paper releases no code or data artifacts, and several load-bearing details of the method are underspecified. As presented, the manuscript is a reasonable research proposal but does not yet meet the reporting standard for a journal-level claim of improved completion accuracy.
major comments (4)
- [Section 4.1-4.2, Figs. 2-3] The central quantitative claim of the paper, that ToxiTenCompl has lower MAE, MSE, weighted MAE, and MaxAE than ToxiCompl and CP, is supported only by figures; no numeric values, validation-set sizes, standard deviations, or significance tests are reported. Without these numbers, a reader cannot assess the magnitude of the claimed gains or whether the differences are within run-to-run noise. Please report the exact final metrics for each method, the number of holdout entries, and preferably confidence intervals or repeated-run statistics.
- [Section 3.2, Section 5, Table 1] The random-entry holdout described in Section 3.2 does not match the systematic, tissue-dependent missingness of DrugMatrix. Table 1 shows that liver and kidney dominate the observed entries (34.5M and 19.0M, respectively), while brain and intestine have only 0.55M and 0.17M observations, and Section 5 concedes that ToxiTenCompl performs worse for tissues with little data. A random holdout therefore evaluates mostly liver and kidney entries, and aggregate MAE/MSE can improve even if the method is no better on brain and intestine or on entirely missing treatment-tissue blocks. Since the paper's goal is to complete the database, please add per-tissue error metrics and evaluate on a missingness-aware split, for example by holding out whole treatment-tissue blocks or by reporting errors separately for under-sampled tissues.
- [Section 3.1, Eq. (1)] The tensor construction equation X_{r,u,i} <- G_{r*8*|U|+u, i} is dimensionally inconsistent and ambiguous. If R is the number of tissues (or tissue-platform combinations) and U is the number of unique genes, the row index of G should depend on r, u, and the platform in a way that is not captured by r*8*|U|+u; the factor 8 appears without definition, and the expression double-counts the gene index. Because this mapping defines the entire 3D tensor, the current description is not reproducible and may indicate an indexing bug. Please rewrite the mapping with explicit ranges and definitions of all indices.
- [Section 3.4 and Section 4.3] The claims in Section 4.3 that ToxiTenCompl 'avoids central tendency' and 'preserves rare signals' are presented as empirical findings, but these behaviors are directly encouraged by the design of the loss function in Section 3.4: the weighted MSE assigns higher weights to over- and under-expressed genes, and the -lambda Var(yhat) term explicitly rewards prediction variance. The observed distributional behavior is therefore not an independent discovery; it is in part a consequence of the objective. Please reframe these statements as properties of the loss design, and provide a controlled comparison (e.g., with lambda=0 or with uniform weights) to show whether the tensor structure and attention mechanism add preservation of rare signals beyond what the loss itself enforces.
minor comments (6)
- [Section 4.3, Fig. 5] The figure caption says ToxiTenCompl predictions are closer to the input 'except for Heart (HE)', while the main text says the exception is brain tissue. Please correct this inconsistency and state explicitly which tissue(s) show larger deviation.
- [Section 3.4] The text 'Var(yhat) measures the deviation of ground truth from the mean values of gene expression' is not a definition of the variance of predictions; please clarify whether the variance term is taken over the predicted values, over a mini-batch, or over the reconstructed tensor, and specify how lambda is selected.
- [Section 3.2] The preprocessing details are underspecified: the z-score outlier threshold, the choice between Min-Max scaling and StandardScaler, and whether normalization is applied per transcript or per tissue are not stated. These choices can materially affect all reported metrics.
- [Section 4.2] Please state how the validation holdout was constructed beyond 'randomly selected subset': the fraction of held-out entries, the random seed, and whether the same holdout was used for all three methods.
- [Section 2.2 and throughout] There are several typographical errors that should be fixed before resubmission, including 'toxicogenomis-aware' in the Section 2.2 heading, 'ToxCompl' where ToxiCompl is meant, 'truggles' in Section 2.3, 'annotaitons' in Section 2.2, and 'withtin' in Section 1.
- [Table 2] The caption states that the distribution includes 'test predictions made by the original (ToxiCompl) model', but the table itself lists only category percentages and does not explain how these categories were derived from the predicted values; please clarify.
Circularity Check
The distribution-preservation and rare-signal results reduce to the training loss; the holdout MAE/MSE comparison is independent.
-
self definitional
[Section 3.4 (Custom Loss Functions and Metrics) vs. Section 4.3 (Prediction Distribution)]
"we adopt a revised, weighted MSE loss, assigning higher weights w_{r,u,i} to over- and under-expressed genes: L_weighted = 1/N Sum w_{r,u,i}(y_{r,u,i} - y_hat_{r,u,i})^2 - lambda * Var(y_hat). ... Weighted MSE loss balances overall prediction performance and performance for rare signals. ... ToxiTenCompl notably avoids the tendency to predict the mean of data (central tendency), a characteristic of the ToxiCompl predictions. ... ToxiTenCompl better preserves these significant variations, confirming it captures more nuanced biological responses in gene expression."
The training objective in Section 3.4 explicitly contains the properties that Section 4.3 reports as findings. The -lambda * Var(y_hat) term directly rewards prediction variance, which is the opposite of central tendency, and the per-entry weights w_{r,u,i} give extra importance to over- and under-expressed entries, i.e., rare signals. Therefore 'avoids central tendency' and 'better preserves rare signals' are consequences of the chosen loss by construction, not emergent properties revealed by the tensor or attention architecture. The comparison with ToxiCompl shows only that a model optimized with a variance-encouraging, rare-signal-weighted objective has more spread than one trained with plain MSE; it does not independently validate the 3D structure or attention mechanism.
full rationale
The core quantitative claim of the paper, lower validation MAE and MSE on a random holdout, is not circular: the ToxiTenCompl predictions are compared against ToxiCompl and CP on held-out entries, and no fitting of those baselines into the test set is described. The same-group ToxiCompl baseline is a normal comparison, not a load-bearing self-citation. The main circularity is confined to the distribution/rare-signal portion of the evaluation: the weighted MSE plus -lambda Var(y_hat) loss directly encodes the objectives that Section 4.3 then presents as empirical advantages. A separate external-validity concern (random holdout vs. systematic tissue-dependent missingness in DrugMatrix, acknowledged for BR/IN in Section 5) is a limitation of the evidence, not a circularity, and does not raise the score further. Overall, partial circularity: one prominent validation claim reduces by construction, while the holdout-error comparison retains independent content.
Assumptions & free parameters
free parameters (6)
- rank k =
300
- variance penalty coefficient lambda
- per-sample loss weights w_{r,u,i}
- z-score outlier threshold
- data normalization choice =
Min-Max or StandardScaler
- attention MLP architecture
assumptions (6)
- domain assumption DrugMatrix rows can be losslessly rearranged into a 3D tensor with dimensions (tissue, gene, treatment) using the stated mapping.
- domain assumption A low-rank CP-style model with shared latent factors captures the biological signal in gene expression.
- domain assumption A random holdout of observed entries has the same distribution as the missing entries.
- domain assumption The variance term and weights in the loss reflect biological importance rather than only statistical goals.
- domain assumption Non-negative factors after subtracting the minimum and clipping are biologically interpretable.
- standard math Standard SGD/ADAM optimization converges to a useful solution for this non-convex factorization.
Cite this review
Pith. "Pith review of Completion of the DrugMatrix Toxicogenomics Database using 3-Dimensional Tensors." pith.science (2026). https://pith.science/paper/EFM3QHYD
@misc{pith2026250703024,
author = {Pith},
title = {Pith review of: Completion of the DrugMatrix Toxicogenomics Database using 3-Dimensional Tensors},
year = {2026},
howpublished = {\url{https://pith.science/paper/EFM3QHYD}},
note = {Machine review of arXiv:2507.03024}
}
read the original abstract
We explore applying a tensor completion approach to complete the DrugMatrix toxicogenomics dataset. Our hypothesis is that by preserving the 3-dimensional structure of the data, which comprises tissue, treatment, and transcriptomic measurements, and by leveraging a machine learning formulation, our approach will improve upon prior state-of-the-art results. Our results demonstrate that the new tensor-based method more accurately reflects the original data distribution and effectively captures organ-specific variability. The proposed tensor-based methodology achieved lower mean squared errors and mean absolute errors compared to both conventional Canonical Polyadic decomposition and 2-dimensional matrix factorization methods. In addition, our non-negative tensor completion implementation reveals relationships among tissues. Our findings not only complete the world's largest in-vivo toxicogenomics database with improved accuracy but also offer a promising methodology for future studies of drugs that may cross species barriers, for example, from rats to humans.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[1]
Scott S. Auerbach, Ruchir R. Shah, Deepak Mav, Cynthia S. Smith, Nigel J. Walker, Molly K. Vallant, Gary A. Boorman, and Richard D. Irwin. 2010. Predicting the hepatocarcinogenic potential of alkenylbenzene flavoring agents using toxicogenomics and machine learning. Toxicology and Applied Pharmacology 243, 3 (March 2010), 300–314. doi:10.1016/j.taap.2009.11.021
-
[2]
Florian Baier, Stefan Mair, and Serafin G. Fadel. 2023. Self-supervised Siamese Autoencoders. arXiv preprint arXiv:2304.02549. http://arxiv.org/abs/2304.02549
work page Pith review arXiv 2023
-
[3]
Dror Bank, Noam Koenigstein, and Raja Giryes. 2020. Autoencoders. arXiv preprint arXiv:2003.05991 (2020). http://arxiv.org/abs/2003. 05991
arXiv 2020
-
[4]
Boaz Barak and Ankur Moitra. 2016. Noisy tensor completion via the sum-of-squares hierarchy. In Conference on Learning Theory (COLT). 417–445
work page 2016
-
[5]
Minjun Chen, Min Zhang, Jürgen Borlak, and Weida Tong. 2012. A decade of toxicogenomic research and its contribution to toxicological science. Toxicological Sciences 130, 2 (Jul 2012), 217–228. doi:10.1093/toxsci/kfs223
-
[6]
Eric C. Chi and Tamara G. Kolda. 2013. On tensors, sparsity, and nonnegative factorizations. SIAM J. Matrix Anal. Appl. 33 (2013), 1272–1299
work page 2013
-
[7]
Guojing Cong, Robert M. Patton, Frank Chao, Daniel L. Svoboda, Warren M. Casey, Charles P. Schmitt, Charles Murphy, Jeremy N. Erickson, Parker Combs, and Scott S. Auerbach. 2024. Completion of the DrugMatrix Toxicogenomics Database using ToxCompl. bioRxiv preprint. doi:10.1101/2024.03.26.586669 https://doi.org/10.1101/2024.03.26.586669
-
[8]
Bernd Ganter, R. David Snyder, David N. Halbert, and Michael D. Lee. 2006. Toxicogenomics in drug discovery and development: mechanistic analysis of compound/class-dependent effects using the DrugMatrix database. Pharmacogenomics 7, 7 (2006), 1025–1044
work page 2006
Show all 24 references
-
[9]
M. N. Hasan, M. B. Malek, A. A. Begum, M. Rahman, and M. N. H. Mollah. 2019. Assessment of Drugs Toxicity and Associated Biomarker Genes Using Hierarchical Clustering. Medicina 55, 8 (2019), 451
2019
-
[10]
Yoshinobu Igarashi, Noriyuki Nakatsu, Tomoya Yamashita, Atsushi Ono, Yasuo Ohno, Tetsuro Urushidani, and Hiroshi Yamada. 2014. Open TG-gates: A large-scale Toxicogenomics database. Nucleic Acids Research 43, D1 (Oct 2014). doi:10.1093/nar/gku955
2014 doi
-
[11]
Prateek Jain and Sewoong Oh. 2014. Provable tensor factorization with missing data. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 27. 1431–1439
2014
-
[12]
Jolliffe and Jorge Cadima
Ian T. Jolliffe and Jorge Cadima. 2016. Principal component analysis: a review and recent developments. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 374, 2065 (2016), 20150202. doi:10.1098/rsta.2015.0202
2016
-
[13]
Kilmer and Carla D
Misha E. Kilmer and Carla D. Martin. 2011. Factorization strategies for third-order tensors. Linear Algebra Appl. 435, 3 (Aug. 2011), 641–658. doi:10.1016/j.laa.2010.09.020
2011 doi
-
[14]
Kingma and Max Welling
Diederik P. Kingma and Max Welling. 2019. An Introduction to Variational Autoencoders. Foundations and Trends in Machine Learning 12, 4 (2019), 307–392
2019
-
[15]
Kolda and Brett W
Tamara G. Kolda and Brett W. Bader. 2009. Tensor decompositions and applications. SIAM Rev. 51, 3 (2009), 455–500
2009
-
[16]
Crawford, and et
Justin Lamb, Emily D. Crawford, and et. al. 2006. The Connectivity Map: Using Gene-Expression Signatures to Connect Small Molecules, Genes, and Disease. Science 313, 5795 (29 9 2006), 1929–1935. doi:10.1126/science.1132939
2006 doi
-
[17]
Allen Liu and Ankur Moitra. 2020. Tensor completion made practical. Advances in Neural Information Processing Systems 33 (2020), 18905–18916
2020
-
[18]
Alireza Makhzani, Jonathon Shlens, Navdeep Jaitly, Ian Goodfellow, and Brendan Frey. 2015. Adversarial Autoencoders. arXiv preprint arXiv:1511.05644. http://arxiv.org/abs/1511.05644 , Vol. 1, No. 1, Article . Publication date: August 2025. 11
2015 arXiv
-
[19]
Qingquan Song, Hancheng Ge, James Caverlee, and Xia Hu. 2019. Tensor completion algorithms in big data analytics. ACM Transactions on Knowledge Discovery from Data (TKDD) 13, 1 (2019), 6
2019
-
[20]
Srivatsan, José L
Sanjay R. Srivatsan, José L. McFaline-Figueroa, and et al. 2020. Massively multiplex chemical transcriptomics at single-cell resolution. Science 367, 6473 (3 1 2020), 45–51. doi:10.1126/science.aax6234
2020 doi
-
[21]
Corsello, David D
Aravind Subramanian, Rajiv Narayan, Steven M. Corsello, David D. Peck, Ted E. Natoli, Xiaodong Lu, and et. al. 2017. A Next Generation Connectivity Map: L1000 Platform and the First 1,000,000 Profiles. Cell 171, 6 (11 2017), 1437–1452.e17. doi:10.1016/j.cell.2017.10.049
2017 doi
-
[22]
Ho, Marilisa Neri, and et
Chaoyang Ye, Daniel J. Ho, Marilisa Neri, and et. al. 2018. DRUG-seq for miniaturized high-throughput transcriptome profiling in drug discovery. Nature Communications 9, 1 (17 10 2018). doi:10.1038/s41467-018-06500-x
2018 doi
-
[23]
Ming Yuan and Cun-Hui Zhang. 2016. On Tensor Completion via Nuclear Norm Minimization.Foundations of Computational Mathematics 16, 4 (2016), 1031–1068. doi:10.1007/s10208-015-9261-0
2016 doi
-
[24]
Kai Zhao, Sen Huang, Cuichan Lin, Pak Chung Sham, Hon-Cheong So, and Zhixiang Lin. 2024. INSIDER: Interpretable sparse matrix decomposition for RNA expression data analysis. PLoS Genet. 20, 3 (March 2024), e1011189. , Vol. 1, No. 1, Article . Publication date: August 2025
2024
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.