REVIEW 1 major objections 2 minor 19 references
Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Model
T0 review · 1 major / 2 minor · reviewed 2026-05-10 · grok-4.3
Pith's one-line read MFCC features fed into an LSTM network recognize speech emotions at 99 percent accuracy.
desk verdict The 99% accuracy is probably not reliable because TESS has only two speakers and the paper gives no sign of a speaker-independent split. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Mel-Frequency Cepstral Coefficients extracted from speech signals, used as input to a Long Short-Term Memory neural network for classifying emotional states.
What would settle it
Testing the model on an independent speech dataset recorded under different conditions or with new speakers and finding significantly lower accuracy would disprove the claim of effective emotion pattern capture.
Extended reading notes
Core claim
The authors show that transforming pre-processed speech signals from the TESS dataset into MFCC features and inputting them to an LSTM model enables the network to learn long-term sequential dependencies, resulting in highly accurate classification of emotions such as those present in the dataset. This LSTM-based classifier outperforms a classical SVM with RBF kernel, which reaches only 98 percent accuracy. The results confirm that such architectures are suitable for the task of speech emotion recognition.
Load-bearing premise
The model's high performance on the TESS dataset means it has learned generalizable features of emotional speech rather than patterns unique to that collection of recordings.
Editorial extensions
If this is right
- The MFCC-LSTM approach captures emotional patterns in speech effectively.
- It delivers highly realistic classifications for all selected emotion classes.
- The LSTM model can be applied to address speech emotion recognition tasks.
- Potential uses include virtual assistants and mental health surveillance systems.
Reading between the lines
- If the accuracy holds on datasets beyond TESS, the system could handle real-world variations in speakers and conditions more reliably.
- Combining this audio-based method with visual cues might create more robust multimodal emotion recognition.
- Further testing on diverse recording environments would clarify the model's practical limits.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents a speech emotion recognition (SER) system that extracts Mel-Frequency Cepstral Coefficients (MFCC) from the Toronto Emotional Speech Set (TESS) dataset and feeds them into an LSTM classifier, reporting 99% accuracy versus 98% for an SVM baseline with RBF kernel. The abstract claims the MFCC-LSTM approach captures emotion patterns and yields highly realistic classifications across the dataset's emotion classes.
Significance. If the 99% accuracy were obtained under a speaker-independent protocol with proper cross-validation, the result would provide empirical evidence that LSTM networks can model sequential dependencies in MFCC features for SER on TESS. The inclusion of an SVM baseline offers a minimal but useful point of comparison. However, the current lack of methodological detail on evaluation prevents any assessment of whether the performance reflects genuine emotion modeling or dataset artifacts.
major comments (1)
- [Abstract and Results] Abstract and Results: The central claim that the LSTM model 'succeeds in capturing the patterns of emotions in speech' and achieves '99% accuracy' is unsupported because the manuscript supplies no information on the train-test split, cross-validation scheme, hyperparameter selection, or error analysis. TESS contains utterances from only two speakers; without an explicit speaker-disjoint (leave-one-speaker-out) partition, the reported accuracy cannot be interpreted as evidence of emotion-specific generalization rather than speaker or recording artifacts.
minor comments (2)
- [Abstract] Abstract: The phrasing 'the author introduces' is inconsistent with standard academic style; 'this work introduces' or 'we introduce' would be preferable. The clause 'the sound similarity between specific feelings' is unclear and should be rephrased for precision.
- [Methods] Overall: No architecture diagram, layer dimensions, or training hyperparameters for the LSTM are provided, making the model non-reproducible from the text alone.
Simulated Author's Rebuttal
We thank the referee for their thorough review and constructive criticism. We respond to the major comment as follows and will incorporate the suggested improvements in the revised manuscript.
read point-by-point responses
-
Referee: [Abstract and Results] Abstract and Results: The central claim that the LSTM model 'succeeds in capturing the patterns of emotions in speech' and achieves '99% accuracy' is unsupported because the manuscript supplies no information on the train-test split, cross-validation scheme, hyperparameter selection, or error analysis. TESS contains utterances from only two speakers; without an explicit speaker-disjoint (leave-one-speaker-out) partition, the reported accuracy cannot be interpreted as evidence of emotion-specific generalization rather than speaker or recording artifacts.
Authors: We acknowledge the validity of this comment. The submitted manuscript indeed omitted key details about the evaluation methodology, which is a significant shortcoming. In the revised version, we will add a detailed 'Experimental Setup' section that specifies the train-test split procedure, the cross-validation scheme employed, the hyperparameter selection process, and an error analysis including confusion matrices. Furthermore, we will explicitly discuss the dataset's composition (only two speakers) and the implications for generalization. We will clarify the nature of the split used and include additional analysis to support the claims about capturing emotion patterns. The abstract will be revised to more accurately reflect the supported claims. revision: yes
Circularity Check
No circularity: standard empirical ML pipeline with no derivations
full rationale
The paper presents an empirical speech emotion recognition system that extracts MFCC features from the TESS dataset and trains an LSTM classifier, reporting 99% accuracy against an SVM baseline. No mathematical derivations, equations, first-principles results, or predictions are claimed that could reduce to fitted parameters or self-citations by construction. The accuracy metric is a direct experimental outcome of model training on the provided data split, with no load-bearing self-referential steps or ansatzes imported via citation. This is a typical applied ML study whose central claim rests on empirical results rather than any closed derivation chain.
Assumptions & free parameters
free parameters (1)
- LSTM architecture hyperparameters
assumptions (1)
- domain assumption MFCC features capture the emotional content of speech signals
Cite this review
Pith. "Pith review of Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Model." pith.science (2026). https://pith.science/paper/2604.25938
@misc{pith2026260425938,
author = {Pith},
title = {Pith review of: Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Model},
year = {2026},
howpublished = {\url{https://pith.science/paper/2604.25938}},
note = {Machine review of arXiv:2604.25938}
}
read the original abstract
Speech Emotion Recognition (SER) is the use of machines to detect the emotional state of humans based on the speech, which is gaining importance in natural human-computer interaction. Speech is a very valuable source of information, as emotions modify the patterns of speech; pitch, energy and even timing. Nonetheless, SER is not an easy task because speakers are not constant, and situations vary when recording and the sound similarity between specific feelings. In this work, the author introduces a speech emotion recognition system relying on the Mel-Frequency Cepstral Coefficient and Long Short-Term Memory (LSTM) neural network, as a feature extraction method. The Toronto Emotional Speech Set (TESS) speech signal was pre-processed, and transformed into MFCC features to understand the important aspects in terms of time. The resultant features were then introduced to LSTM model, which is able to learn long term features of sequential audio data. The trained model was measured over several emotion classes occurring in the dataset. As seen in the results of experiments, the proposed MFCC-LSTM approach succeeds in capturing the patterns of emotions in speech and provides highly realistic classifications in all the chosen emotion classifications. This study presents a speech emotion recognition system using Mel-Frequency Cepstral Coefficients (MFCCs) as features and a deep learning LSTM classifier. A Support Vector Machine (SVM) with an RBF kernel served as a classical baseline, achieving 98% accuracy, against which the proposed LSTM model, achieving 99% accuracy, was validated. Overall, it is possible to confirm that LSTM-based architectures can be used to address the task of speech emotion recognition. Actual applications of the proposed system may be virtual assistants and mental health surveillance.
Reference graph
Works this paper leans on
-
[1]
DISCUSSIONS The experimental results demonstrate that a single-layer LSTM model trained on MFCC features can achieve very high classification accuracy for speech emotion recognition. This highlights the effectiveness of temporal modeling in capturing emotional patterns embedded in speech signals, even without the use of convolutional or hybrid architectur...
work page 2020
-
[2]
Zhao, J., Mao, X., & Chen, L. (2019). Speech emotion recognition using deep 1D & 2D CNN LSTM networks. Biomedical signal processing and control , 47 , 312-323
work page 2019
-
[3]
Ingale, A. B., & Chaudhari, D. S. (2012). Speech emotion recognition. International Journal of Soft Computing and Engineering (IJSCE) , 2 (1), 235-238
work page 2012
-
[4]
Andayani, F., Theng, L. B., Tsun, M. T., & Chua, C. (2022). Hybrid LSTM-transformer model for emotion recognition from speech audio files. IEEE Access , 10 , 36018-36027
work page 2022
-
[5]
Fayek, H. M., Lech, M., & Cavedon, L. (2017). Evaluating deep learning architectures for speech emotion recognition. Neural Networks , 92 , 60-68
work page 2017
-
[6]
Leelavathi, R., Deepthi, S. A., & Aruna, V. (2021). Speech emotion recognition using LSTM. International Research Journal of Engineering and Technology
work page 2021
-
[7]
Xie, Y., Liang, R., Liang, Z., Huang, C., Zou, C., & Schuller, B. (2019). Speech emotion classification using attention-based LSTM. IEEE/ACM Transactions on Audio, Speech, and Language Processing , 27 (11), 1675-1685
work page 2019
-
[8]
Kumbhar, H. S., & Bhandari, S. U. (2019, September). Speech emotion recognition using MFCC features and LSTM network. In 2019 5th international conference on computing, communication, control and automation (ICCUBEA) (pp. 1-3). IEEE
work page 2019
Show all 19 references
-
[9]
Etienne, C., Fidanza, G., Petrovskii, A., Devillers, L., & Schmauch, B. (2018). Cnn+ lstm architecture for speech emotion recognition with data augmentation. arXiv preprint arXiv:1802.05630
2018
-
[10]
Makhmudov, F., Kutlimuratov, A., & Cho, Y. I. (2024). Hybrid LSTM–attention and CNN model for enhanced speech emotion recognition. Applied Sciences , 14 (23), 11342
2024
-
[11]
Kerkeni, L., Serrestou, Y., Mbarki, M., Raoof, K., & Mahjoub, M. A. (2018). Speech Emotion Recognition: Methods and Cases Study. ICAART (2) , 20
2018
-
[12]
Fernandes, B., & Mannepalli, K. (2021). Speech Emotion Recognition Using Deep Learning LSTM for Tamil Language. Pertanika Journal of Science & Technology , 29 (3)
2021
-
[13]
Speech emotion recognition with deep learning
Aouani, Hadhami, and Yassine Ben Ayed. "Speech emotion recognition with deep learning." Procedia Computer Science 176 (2020): 251-260
2020
-
[14]
A., Jones, E., Babar, M
Khalil, R. A., Jones, E., Babar, M. I., Jan, T., Zafar, M. H., & Alhussain, T. (2019). Speech emotion recognition using deep learning techniques: A review. IEEE access , 7 , 117327-117345
2019
-
[15]
K., Shekhawat, H
Pandey, S. K., Shekhawat, H. S., & Prasanna, S. M. (2019, April). Deep learning techniques for speech emotion recognition: A review. In 2019 29th international conference RADIOELEKTRONIKA (RADIOELEKTRONIKA) (pp. 1-6). IEEE
2019
-
[16]
F., & Yazici, A
Issa, D., Demirci, M. F., & Yazici, A. (2020). Speech emotion recognition with deep convolutional neural networks. Biomedical Signal Processing and Control , 59 , 101894
2020
-
[17]
Lalitha, S., Geyasruti, D., & Narayanan, R. (2015). Emotion detection using MFCC and cepstrum features. Procedia Computer Science , 70 , 29-35
2015
-
[18]
S., Gupta, S
Likitha, M. S., Gupta, S. R. R., Hasitha, K., & Raju, A. U. (2017, March). Speech based human emotion recognition using MFCC. In 2017 international conference on wireless communications, signal processing and networking (WiSPNET) (pp. 2257-2260). IEEE
2017
-
[19]
Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation , 9 (8), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
1997 doi
Reviewed May 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.