Pith. sign in

REVIEW 4 major objections 6 minor 17 references

Cancer cytoplasm segmentation in hyperspectral cell image with data augmentation

T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read Cancer cytoplasm can be segmented from noisy hyperspectral images by training the U-Net segmentation model on CMOS-derived pseudo-noisy augmentations, lifting IoU from 0.7255 to 0.7362 and Dice from 0.8392 to 0.8466.

desk verdict A useful augmentation idea and new dataset, but the main result is undercut by a class-label mismatch and test-set-informed parameter choice. read the letter →

arxiv 2507.03325 v1 pith:PK42YEKU submitted 2025-07-04 eess.IV cs.CVphysics.med-ph

classification eess.IVcs.CVphysics.med-ph
keywords cancercytoplasmsegmentationhyperspectralpathologyimagesH&E-stainedcelldataaugmentationinstrumentalnoiselinepush-broomcameraU-Netdeeplearning
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that instrumental line noise in hyperspectral pathology images can be turned from a training obstacle into a data-augmentation resource. Because real noisy hyperspectral images are hard to obtain and annotate, the authors synthesize pseudo-noisy images from easily annotated CMOS images, inject vertical and horizontal line artifacts modeled on push-broom camera noise, and train a U-Net on the mixture. On 56 real test images, the augmented model reaches IoU 0.7362 and Dice 0.8466, against 0.7255 and 0.8392 for the model trained on 44 original noisy images alone. If this holds, cancer-cytoplasm segmentation no longer requires large collections of annotated noisy hyperspectral images, and the paper presents it as the first deep-learning segmentation of cancer cytoplasm in hyperspectral pathology images.

What carries the argument

The carrying mechanism is a parameterized line-noise injection model paired with the U-Net segmentation architecture. Vertical noise lines count 19 to 29 (plus or minus 5) with pixel value 128; horizontal noise lines are placed in rows 26 to 32 (plus or minus 3), with information loss up to 2 pixels and left or right shifts up to 3 pixels; the source image is the converted and brightened CMOS frame with gamma 0.3 and constant 100. These parameters are meant to emulate the slit- and sensor-derived stripes of a push-broom hyperspectral camera, and the ablation isolates the injected noise as the decisive augmentation.

What would settle it

Compare the distribution of line artifacts in the generated pseudo-noisy images with the real hyperspectral test images, including line count, width, spacing, pixel intensity, and shift statistics; if the synthetic noise does not match the real noise, or if a model trained on pseudo-noisy images fails to improve on images from a different push-broom camera, the transfer claim collapses.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that a small stack of 44 original noisy hyperspectral images can be stretched into 836 training images by converting CMOS RGB images to grayscale, adjusting brightness with gamma correction and histogram equalization, overlaying a constant value, and then randomly adding vertical and horizontal line noise plus geometric transforms; U-Net trained on this mix segments cancer cytoplasm better than U-Net trained on the originals alone. The ablation studies attribute the gain specifically to the noise injection: pseudo-noisy images outperform color-adjusted images without noise and outperform most geometric augmentations, and combining all five general augmentations with noise gives the best score. The paper also asserts this is the first deep-learning application to segment cancer cytoplasm from hyperspectral pathology images.

Load-bearing premise

The synthetic line-noise model faithfully mimics the real instrumental noise of the hyperspectral camera, so that training on pseudo-noisy CMOS-derived images transfers to real test images.

Editorial extensions

If this is right

  • A model trained on 44 original plus 792 pseudo-noisy images outperforms one trained on 44 originals, so small noisy hyperspectral datasets can be amplified without acquiring new real images.
  • The ablation attributes most of the gain to noise injection rather than geometric transforms, so explicit modeling of instrumental noise is the load-bearing part of the augmentation.
  • CMOS images, which are visually clearer and faster to annotate, can serve as annotation proxies for hyperspectral training data.
  • The same noise-injection augmentation may transfer to other tasks on push-broom hyperspectral images, such as object detection, as the paper suggests.
  • The remaining weakness on darker image types implies that adding more dark pseudo-images could further improve the method, a direction the paper itself raises.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Beyond the paper, the noise model's parameters were tuned to one camera and one dataset; transferring to another push-broom hyperspectral camera would likely require re-estimating the line statistics or learning the noise distribution from unlabeled real images.
  • Since the experiments use only a single spectral band, a testable extension is to feed the full spectral cube into the network; the paper does not test whether multiband input would amplify the augmentation gain.
  • The pseudo-noisy images are all derived from 44 CMOS images, so a held-out CMOS-derived test set would reveal whether the gain is genuine generalization or overfitting to those source patterns; this experiment is not in the paper.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper proposes a data augmentation strategy for segmenting cancer cytoplasm in hyperspectral H&E images. The method converts CMOS RGB images to grayscale, applies gamma correction and histogram equalization, adds a uniform color offset, injects synthetic vertical and horizontal line noise meant to mimic hyperspectral camera artifacts, and then applies geometric augmentations. A U-Net is trained on 44 original hyperspectral images plus 792 pseudo-noisy images and evaluated on 56 held-out hyperspectral images. The main quantitative result is an IoU improvement from 0.7255 to 0.7362 and Dice from 0.8392 to 0.8466, with additional ablation experiments on the number of augmented images and the effect of individual augmentation techniques.

Significance. If the result holds, the paper makes a useful practical contribution by addressing the scarcity of annotated hyperspectral pathology images and by showing that a simple, GAN-free augmentation pipeline can simulate instrumental noise. The authors are transparent about their imaging setup, parameters, and limitations, and they provide multiple ablation tables. However, the central comparison is currently undermined by an unresolved label-class mismatch, the absence of statistical grounding, and test-set-informed selection of noise parameters, so the claimed improvement cannot yet be attributed specifically to the proposed noise augmentation.

major comments (4)
  1. [§3.3 and §4.2] The U-Net output layer has five classes and cross-entropy loss is used 'because of the five segmentation classes,' but the hyperspectral ground truth is annotated only for cancer cytoplasm, nuclear regions, and empty areas, while the CMOS-derived pseudo-images have five classes including red blood cells and fibroblasts. The paper never explains how the three-class hyperspectral labels are encoded for a five-class softmax. If the three-class labels are expanded in some way, or if the extra classes are simply ignored, the training objective differs between the original and pseudo images. This makes the Table 3 gain (0.7255 to 0.7362 IoU) uninterpretable, because it could reflect the additional RBC/fibroblast supervision from the 792 CMOS-derived images rather than the proposed noise augmentation.
  2. [§4.5 and Table 3] The headline improvement is based on a single training run per method, with no error bars, no repeated seeds, and no significance testing. The reported IoU difference is only 0.0107, while Table 5 shows that the noise-specific effect is about 0.005 (0.6535 vs. 0.6485), so run-to-run variation could easily account for the headline result. The authors should report mean and standard deviation over at least three to five seeds and, ideally, a paired statistical test across seeds.
  3. [§4.1 and §4.3] The noise-model parameters (N1=19 to N2=29, C2=128, r1=26 to r2=32, etc.) are selected using statistics computed from all 100 hyperspectral images, specifically the counts of vertical and horizontal noise lines described in §4.1. Since 56 of those images are used as the test set, the augmentation parameters are informed by test-set statistics. This is a form of test-set leakage that biases the evaluation; the noise parameters should be derived only from the 44 training images or from a separate validation subset, then frozen before evaluating on the test set.
  4. [§4.5 and Table 4] The comparison in Table 3 confounds augmentation type with training-set size: Method 1 uses 44 images while the proposed method uses 836 images. Table 4 shows that increasing the number of pseudo-images from 44 to 792 (Methods 1–3) raises IoU from 0.6535 to 0.7059 even without any original hyperspectral images, so the additional 0.0303 gain in Method 4 may come from the inclusion of the original images rather than from the noise-augmentation mechanism. A controlled comparison with equal training-set size (e.g., 836 images with noise vs. 836 images without noise) is needed to isolate the effect of the proposed augmentation.
minor comments (6)
  1. [Abstract and §1] The novelty claim of being 'the first application of deep learning for segmenting cancer cytoplasm from hyperspectral pathology images' is strong and should be supported by a more systematic comparison with the cited literature, since works such as Cx22 already address cancer cytoplasm annotation, albeit not in hyperspectral images.
  2. [§3.2 and Fig. 2] The pipeline description is clear at a high level, but the relationship between the 'three pseudo-noisy images are generated' statement and the later creation of 792 pseudo-images is not explained; a short formula or pseudocode would remove the ambiguity.
  3. [§4.3 and Table 2] There is a typo in the table heading: 'Trianing parameter' should be 'Training parameter'. Additionally, the table would be easier to read if the loss function were described in a separate row from the environment.
  4. [Equations in §4.4] The IoU and Dice formulas are presented inline and are visually incomplete; they should be typeset as numbered display equations.
  5. [Table 5] The checkmark columns in Table 5 are hard to interpret; it is not immediately clear which augmentation techniques are applied in each row, and the text refers to 'Method 2' in a way that is ambiguous with the method numbering in Table 4.
  6. [§4.1] The sentence describing '81 images for one H&E-stained sample across different wavelength bands' is confusing because the paper later treats images as independent samples; clarify whether these are spectral bands of a single scene or separate physical images.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the segmentation gain is measured on held-out hyperspectral images; augmentation hyperparameters are inputs, not fitted predictions.

full rationale

The paper's central claim is empirical: training U-Net on 44 original hyperspectral images plus 792 pseudo-noisy CMOS-derived images gives IoU 0.7362 and Dice 0.8466, versus 0.7255 and 0.8392 for original-only training (Table 3). The evaluation is performed on 56 held-out original hyperspectral images from seven types, and the pseudo-images are generated from a separate set of 44 CMOS images. No load-bearing step is derived from the claimed outcome. The augmentation parameters in Sec 4.3 (C2=128, N1=19 to N2=29, r1=26 to r2=32, m=2, d=3) are input hyperparameters, not outputs fitted to the segmentation metric. There are no self-citations or imported uniqueness theorems. Two methodological caveats are worth noting but are not circularity. First, the synthetic noise statistics in Sec 4.1 were summarized from all 100 hyperspectral images, including the 56 test images, so the augmentation is calibrated to the evaluation distribution; this is experimental leakage, not a definitional reduction. Second, Sec 3.3 specifies five output classes while Sec 4.2 states hyperspectral ground truth has only three classes, and the paper does not reconcile this mismatch; this affects interpretability of the IoU gain but does not make the result equivalent to its inputs. Accordingly, no circular step can be exhibited and the circularity score is 0.

Assumptions & free parameters 13 free parameters · 5 assumptions · 0 invented entities

The central claim depends on roughly a dozen hand-set augmentation parameters and three domain assumptions: that line noise is constant-valued and additive, that the 580 nm band suffices for cytoplasm segmentation, and that noise statistics measured over the entire 100-image set (including test images) are representative. No new physical entities are introduced.

free parameters (13)
  • gamma correction gamma = 0.3
    Gamma correction exponent for brightness adjustment, chosen by hand to visually match hyperspectral band appearance (Sec 3.2, Sec 4.3).
  • added color constant C1 = 100
    Single-color pixel value added to produce the pseudo spectral image; chosen by hand (Sec 3.2, Sec 4.3).
  • noise line pixel value C2 = 128
    Pixel value used for synthetic vertical noise lines; chosen by hand (Sec 3.2, Sec 4.3).
  • vertical line count range N1-N2 = 19-29
    Range of number of vertical noise lines per image; based on observed approximately 24 noisy vertical lines in the 100-image set (Sec 4.1, Sec 4.3).
  • vertical line variability sigma1 = 5
    Balanced distribution range around the line count, hand-set (Sec 3.2, Sec 4.3).
  • horizontal line region r1-r2 = 26-32
    Position range for horizontal noise lines, hand-set (Sec 3.2, Sec 4.3).
  • horizontal line variability sigma2 = 3
    Pixel-position variability for horizontal lines, hand-set (Sec 3.2, Sec 4.3).
  • slice height range h1-h2 = 15-30
    Range of heights for horizontal information-loss slices, hand-set (Sec 3.2, Sec 4.3).
  • max pixel loss m = 2
    Maximum pixel loss per horizontal line, hand-set (Sec 3.2, Sec 4.3).
  • max pixel shift d = 3
    Maximum left/right pixel shift per horizontal line, hand-set (Sec 3.2, Sec 4.3).
  • crop width c_w = 800
    Maximum cropping width for geometric augmentation, hand-set (Sec 3.2, Sec 4.3).
  • crop height c_s (also c_h) = 700
    Maximum cropping height, listed as c_s in Sec 4.3 while the text names it c_h; hand-set.
  • spectral band 580 nm = 580 nm
    Selected as the brightest band across all cell images; other bands are not evaluated, so the choice is a hand-picked operating point (Sec 4.1).
assumptions (5)
  • domain assumption Line push-broom hyperspectral cameras produce instrumental noise that can be represented as additive vertical and horizontal lines of constant pixel intensity.
    Sec 3.1 describes line noise from slit dust and sensor sensitivity; Sec 3.2 models it as constant-value lines, but no quantitative comparison to real noise is provided.
  • domain assumption The 580 nm band is sufficient for cancer cytoplasm segmentation, so single-band grayscale images (real and pseudo) are used instead of the full hyperspectral cube.
    Sec 4.1 selects 580 nm because it is brightest; the paper does not test other bands or multi-band fusion.
  • domain assumption Noise statistics measured over all 100 hyperspectral images (including test images) are representative of the noise in the test set and can be used to set augmentation parameters.
    Sec 4.1 reports line counts over the 100-image set, which includes the 56 test images; this assumes stationarity and creates a mild test-set leak.
  • domain assumption Manual annotations by veterinary researchers, validated by a professor, are accurate enough to serve as ground truth for training and evaluation.
    Sec 4.2 states annotations were performed by veterinary researchers and validated, but no inter-annotator agreement is reported.
  • standard math U-Net with 5 output classes and cross-entropy loss is an appropriate segmentation model for this task.
    Standard, well-established architecture; not a source of circularity.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Cancer cytoplasm segmentation in hyperspectral cell image with data augmentation." pith.science (2026). https://pith.science/paper/PK42YEKU

@misc{pith2026250703325,
  author       = {Pith},
  title        = {Pith review of: Cancer cytoplasm segmentation in hyperspectral cell image with data augmentation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/PK42YEKU}},
  note         = {Machine review of arXiv:2507.03325}
}
read the original abstract

Hematoxylin and Eosin (H&E)-stained images are commonly used to detect nuclear or cancerous regions in cells from images captured by a microscope. Identifying cancer cytoplasm is crucial for determining the type of cancer; hence, obtaining accurate cancer cytoplasm regions in cell images is important. While CMOS images often lack detailed information necessary for diagnosis, hyperspectral images provide more comprehensive cell information. Using a deep learning model, we propose a method for detecting cancer cell cytoplasm in hyperspectral images. Deep learning models require large datasets for learning; however, capturing a large number of hyperspectral images is difficult. Additionally, hyperspectral images frequently contain instrumental noise, depending on the characteristics of the imaging devices. We propose a data augmentation method to account for instrumental noise. CMOS images were used for data augmentation owing to their visual clarity, which facilitates manual annotation compared to original hyperspectral images. Experimental results demonstrate the effectiveness of the proposed data augmentation method both quantitatively and qualitatively.

Figures

Figures reproduced from arXiv: 2507.03325 by the authors.

Figure 1
Figure 1. Instrumental noise in hyperspectral camera image pixels. Pixel shifting involves displacing image information left or right by 𝑑 pixels. Consequently, three pseudo-noisy images are generated from a single CMOS image using this method. Data augmentation (General): To mitigate bias in image patterns caused by limited datasets, this study also em￾ployed general data augmentation techniques. The geometric transformation… view at source ↗
Figure 2
Figure 2. Proposed data augmentation method sample across different wavelength bands, ranging from 400 to 800 nm at 5 nm intervals. Representative band images of different cells are shown in [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. U-net model architecture 4.3. Experimental condition For data augmentation, the parameters were as follows: 𝛾 = 0.3, 𝐶1 = 100, 𝑁1 = 19, 𝑁2 = 29, 𝜎1 = 5, 𝐶2 = 128, 𝑟1 = 26, 𝑟2 = 32, 𝜎2 = 3, ℎ1 = 15, ℎ2 = 30, 𝑚 = 2, 𝑑 = 3, 𝑐𝑤 = 800, 𝑐𝑠 = 700, and 𝑁 = 5. The experiment used 44 original CMOS images and 44 original hyperspectral images for training and augmentation. From the 44 CMOS images, a total of 792 pseudo-noisy im… view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Example of different types of images [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 5
Figure 5. Figure 5: Example of hyperspectral images of different band of different cells Rebeka Sultana et al.: Preprint submitted to Elsevier Page 8 of 15 [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: Imaging system [PITH_FULL_IMAGE:figures/full_fig_p009_6.png]
Figure 7
Figure 7. Figure 7: Annotated data where TP, FN, and FP indicate True Positive, False Negative, and False Positive, respectively. Dice Coefficient = 2 × TP 2 × TP + FP + FN For both metrics, a score of 1.0 indicates that the pre￾dicted and ground-truth maps are identical, while a score of…
Figure 8
Figure 8. Figure 8: Qualitative results. The red area represents the cancer cytoplasm, while blue indicates other areas. White and dark brown highlight areas with false detections, where the predicted cancer cytoplasm overlaps with other areas. The comparison method was trained using only…
Figure 9
Figure 9. Figure 9: Mean image of each type of test images 6. Conclusion The identification of cancer cytoplasm in H&E-stained cell images is crucial for determining cancer type. Hyper￾spectral imaging provides more detailed data compared to CMOS imaging. However, instrumental noise cause…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

17 extracted references · 12 canonical work pages

  1. [3]

    Artificial Intelligence Review 56, 12561–12605

    Medical image data augmentation: techniques, com- parisons and interpretations. Artificial Intelligence Review 56, 12561–12605. Graham,S.,C.H.G.J.D.Q.H.P.A.S.D.T.Y.W.R.N.,2019. Mild-net:Minimal information loss dilated network for gland instance segmentation in colon histology images. Medical Image Analysis 52, 199–211. Graham, S., J.M.A.A.N.M.T.Y.W.D.K.H...

  2. [4]

    Amulti-organnucleussegmenta- tion challenge

    Kumar,N.,V.R.A.D.Z.Y.O.O.e.a.,2020. Amulti-organnucleussegmenta- tion challenge. IEEE Transactions on Medical Imaging 39, 1380–1391. Kumar, N., V.R.S.S.B.S.V.A.S.A.,

  3. [5]

    Training a universal instance segmentation network for live cell images of various cell types and imaging modalities

    Training a universal instance segmentation networkforlivecellimagesofvariouscelltypesandimagingmodalities. arXiv preprint arXiv:2207.14347 . Hatamizadeh, A., N.V.T.Y.Y.D.R.H.X.D.,

  4. [6]

    Infrared,

    Comprehensive ai model develop- ment for gleason grading: From scanning, cloud-based annotation to pathologist-ai interaction . Infrared, . Near infrared hyperspectral image dataset, last access january 27, 2025 from https://www.kaggle.com/datasets/hacarus/near-infrared- hyperspectral-image?resource=download . Janowczyk, A., M.A.,

  5. [10]

    Computers in Biology and Medicine 132, 104349

    Cryonuseg: A dataset for nuclei instance segmentation of cryosectioned h&e-stained histological images. Computers in Biology and Medicine 132, 104349. Moshkov,N.,M.B.K.F.A.H.R.H.P.,2020. Test-timeaugmentationfordeep learning-based cell segmentation on microscopy images. Scientific reports 10,

  6. [11]

    arXiv preprint arXiv:1712.04621

    The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621 . Ramin, N., P.F.,

  7. [12]

    Perineural Invasion Detection in Multiple Organ Cancer Based on Deep Convolutional Neural Network

    Perineural invasion detection in multiple organ cancer based on deep convolutional neural network. arXiv preprint arXiv:2110.12283 . Ronneberger, O., F.P.B.T.,

  8. [13]

    arXiv preprint arXiv:2206.11943

    Tiager: Tumor- infiltrating lymphocyte scoring in breast cancer for the tiger challenge. arXiv preprint arXiv:2206.11943 . Siddique, N., P.S.E.C.D.V.,

Show all 17 references
  1. [14]

    IEEE Access 9, 82031–82057

    U-net and its variants for medical image segmentation: A review of theory and applications. IEEE Access 9, 82031–82057. Simon,G.,V.Q.R.S.A.A.T.Y.K.J.R.N.,2019. Hover-net:Simultaneousseg- mentation and classification of nuclei in multi-tissue histology images. Medical image ana...

  2. [17]

    Biomedical Optics Express 15, 4584–4604

    Taj-net: a two-stage clustered cell segmentation network with adaptive joint learning of spatial and spectral information. Biomedical Optics Express 15, 4584–4604. Zhao,A.,B.G.D.F.G.J.D.A.,2019. Dataaugmentationusinglearnedtrans- formationsforone-shotmedicalimagesegmentation. ...

  3. [2016]

    IEEE Reviews in Biomedical Engineering 9, 234–263

    Robust nucleus/cell detection and segmentation in digital pathology and microscopy images: A comprehensive review. IEEE Reviews in Biomedical Engineering 9, 234–263. Xu,J.,L.M.Z.Z.,2020. Automaticdataaugmentationfor3dmedicalimage segmentation. International Conference on Medic...

  4. [2017]

    IEEE Transactions on Medical Imaging 36, 1550–1560

    A dataset and a technique for generalized nuclear segmentation for computational pathology. IEEE Transactions on Medical Imaging 36, 1550–1560. labelme, . wkentaro/labelme, last access june 6, 2024 from https://github.com/wkentaro/labelme . Lai, Q., W.W.S.H.S.J.,

  5. [2020]

    arXiv preprint arXiv:2003.10778

    Pannuke dataset extension, insights and baselines. arXiv preprint arXiv:2003.10778 . Garcea,F.,S.A.L.F.M.L.,2023. Dataaugmentationformedicalimaging:A systematic literature review. Computers in Biology and Medicine 152, 106391. Gelasca,E.D.,B.J.O.B.M.B.,2008. Evaluationandbench...

  6. [2021]

    Medical Image Analysis

    Paip 2019: Liver cancer segmentation challenge. Medical Image Analysis

  7. [2022]

    Guo, T., W.Y.S.L.A.J.,

    arXiv preprint arXiv:2111.14485 . Guo, T., W.Y.S.L.A.J.,

  8. [2023]

    arXiv preprint arXiv:2303.01178

    Augmenting medical imaging: A comprehensive cat- alogue of 65 techniques for enhanced data analysis. arXiv preprint arXiv:2303.01178 . Eaton-Rosen, Z., B.F.O.S.C.M.J.,

  9. [2024]

    Computerized Medical Imaging and Graphics 112, 102339

    Crossu-net: Dual- modality cross-attention u-net for segmentation of precancerous lesions in gastric cancer. Computerized Medical Imaging and Graphics 112, 102339. Wilm,F.,F.M.B.C.A.S.N.O.M.Q.J.,2023. Multi-scannercaninecutaneous squamous cell carcinoma histopathology dataset....

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.