pith. sign in

arxiv: 1710.01927 · v1 · pith:7XGN2G2Jnew · submitted 2017-10-05 · 💻 cs.LG

Data Augmentation of Spectral Data for Convolutional Neural Network (CNN) Based Deep Chemometrics

classification 💻 cs.LG
keywords dataaugmentationcnnsdeepmodelsspectralconvolutionalemsc
0
0 comments X
read the original abstract

Deep learning methods are used on spectroscopic data to predict drug content in tablets from near infrared (NIR) spectra. Using convolutional neural networks (CNNs), features are ex- tracted from the spectroscopic data. Extended multiplicative scatter correction (EMSC) and a novel spectral data augmentation method are benchmarked as preprocessing steps. The learned models perform better or on par with hypothetical optimal partial least squares (PLS) models for all combinations of preprocessing. Data augmentation with subsequent EMSC in combination gave the best results. The deep learning model CNNs also outperform the PLS models in an extrapolation chal- lenge created using data from a second instrument and from an analyte concentration not covered by the training data. Qualitative investigations of the CNNs kernel activations show their resemblance to wellknown data processing methods such as smoothing, slope/derivative, thresholds and spectral region selection.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Reconstructing Randomly Masked Spectra Helps DNNs Identify Discriminant Wavenumbers

    cs.LG 2026-06 unverdicted novelty 5.0

    TeaNet augments scarce spectroscopic data via masked spectrum reconstruction to train DNNs that outperform CNNs and better identify key wavenumbers.

  2. Spectroscopy Analysis with Machine Learning Regression for the Quantification of Carbon and Nitrogen Contents in Inceptisol and Oxisol Soil Types: Comparing Different Preprocessing and Validation methods as well as Feature Importance

    cs.LG 2026-07 unverdicted novelty 4.0

    Stacking ensembles of PLS, SVR and Ridge regression on preprocessed NIR spectra achieve RPD greater than 2.0 for C and N prediction in Inceptisol and Oxisol soils using cross-validation and Kennard-Stone holdout.