On the SW1 challenge dataset, weighted attention fusion with acoustic, linguistic, and handcrafted features achieved the best test accuracy (56%), but all systems remained near chance.
Suicide Risk Assessment Using Multimodal Speech Features: A Study on the SW1 Challenge Dataset
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
The 1st SpeechWellness Challenge conveys the need for speech-based suicide risk assessment in adolescents. This study investigates a multimodal approach for this challenge, integrating automatic transcription with WhisperX, linguistic embeddings from Chinese RoBERTa, and audio embeddings from WavLM. Additionally, handcrafted acoustic features -- including MFCCs, spectral contrast, and pitch-related statistics -- were incorporated. We explored three fusion strategies: early concatenation, modality-specific processing, and weighted attention with mixup regularization. Results show that weighted attention provided the best generalization, achieving 69% accuracy on the development set, though a performance gap between development and test sets highlights generalization challenges. Our findings, strictly tied to the MINI-KID framework, emphasize the importance of refining embedding representations and fusion mechanisms to enhance classification reliability.
citation-role summary
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
support 1representative citing papers
citing papers explorer
-
Suicide Risk Assessment Using Multimodal Speech Features: A Study on the SW1 Challenge Dataset
On the SW1 challenge dataset, weighted attention fusion with acoustic, linguistic, and handcrafted features achieved the best test accuracy (56%), but all systems remained near chance.