Pith. sign in

REVIEW 4 major objections 5 minor 2 cited by

MVANet: Multi-Stage Video Attention Network for Sound Event Localization and Detection with Source Distance Estimation

T0 review · 4 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read MVANet uses multi-stage audio-guided video attention to beat its top-ranked DCASE 2024 system on 3D sound localization, without ensembling.

desk verdict A competent DCASE system paper whose headline gain is real but partly attributable to a changed pretraining setup, not just the attention module. read the letter →

arxiv 2411.14153 v1 pith:EREO3DDL submitted 2024-11-21 eess.AS

Hengyi Hong , Qing Wang , Jun Du , Ruoyu Wei , Mingqi Cai , Xin Fang This is my paper · ORCID
classification eess.AS
keywords soundeventlocalizationanddetectionsourcedistanceestimationaudio-visualfusionmulti-stageattentionCartesiancoordinaterepresentationdataaugmentationSTARSS23DCASE2024
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

MVANet claims that for audio-visual 3D sound event localization and detection—identifying what is sounding, from which direction, and at what distance—letting audio features from multiple network stages re-weight video frames picks out the parts of the frame that actually produce sound. The paper couples this with an output format that multiplies the normalized direction-of-arrival vector by the source distance, so a single regression target, the true Cartesian coordinates, carries both DOA and distance information. With audio-visual pixel swapping, simulated audio-visual training data, and audio-only pre-training, the full system reaches an F-score of 0.567, a DOA error of 12.37°, and a relative distance error of 0.239 on the STARSS23 dev-test set. That beats the authors' own previous top-ranked DCASE 2024 system on all three metrics with a single model and no ensemble. If the claim holds, multi-stage cross-modal attention and a unified coordinate target are sufficient ingredients to improve 3D SELD.

What carries the argument

The load-bearing component is the multi-stage attention module: at each of four stages, an attention function $Att(V_t, A_t)$ projects audio and video feature vectors into a shared dimension, sums them, and applies a sigmoid to generate spatial attention weights that re-weight the video feature map, focusing it on sounding objects. The other key ingredient is the source Cartesian coordinate output format: the normalized DOA unit vector is multiplied by the source distance, so the SCE branch regresses $(x, y, z)$ coordinates whose direction encodes azimuth and elevation and whose Euclidean norm encodes distance. The system is trained with a two-term loss (binary cross-entropy for SED, mean squared error for SCE) and uses two augmentations: audio-visual pixel swapping that flips and rotates video frames, and simulated audio-visual data generated by convolving sound events with measured room impulse responses.

What would settle it

Inspect the released code or the AVPS data loader for one training sample: take a horizontally flipped video frame and check whether the ambisonic W-X-Y-Z channels have been correspondingly re-ordered and the azimuth label negated. If the spatial channels and labels are not transformed to match the flipped frame, the training signal is spatially inconsistent and the reported gains cannot be attributed cleanly to the proposed architecture.

Watch

Extended reading notes

Core claim

The central discovery is that applying an audio-guided attention module at four different stages of a ResNet-Conformer audio-visual network, instead of fusing audio and visual features once, more fully exploits the location cues embedded in video frames for both direction and distance estimation. The SCE branch predicts the true Cartesian coordinates of each active source, with the vector's direction giving the DOA and its length giving the distance, and trains under a single MSE loss alongside the SED branch's binary cross-entropy. On the STARSS23 dev-test set, the ENH2+PT configuration reaches an F20°/1 of 0.567, a DOAE of 12.37°, and an RDE of 0.239, surpassing the authors' own first-place DCASE 2024 system (0.550, 13.16°, 0.250) without model ensembling.

Load-bearing premise

The weakest assumption is that the audio-visual pixel swapping augmentation transforms video frames and the spatial audio and labels together: the paper flips and rotates video frames but never states whether the first-order ambisonic channels and the DOA/distance labels are co-transformed (for example, azimuth negation on horizontal flips); if they are not, the augmented training pairs carry contradictory spatial supervision.

Editorial extensions

If this is right

  • A single MVANet model, without ensemble, outperforms the previous top-ranked system, so ensembling is not required to reach the state of the art in this challenge setup.
  • Unifying DOA and distance into one Cartesian-coordinate regression target makes source distance estimation a direct extension of prior ACCDOA-style outputs, simplifying multi-task 3D SELD.
  • Audio-only pre-training on simulated spatial data transfers to the audio-visual model, reducing reliance on the scarce real audio-visual recordings.
  • The multi-stage attention mechanism can be inserted into existing audio-visual backbones to improve spatial localization even when the visual content is cluttered with non-sounding objects.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same multi-stage audio-guided attention could be transplanted to other audio-visual spatial tasks, such as sound separation or active speaker localization, wherever video should attend to the sounding source.
  • Regressing true Cartesian coordinates suggests an additional evaluation metric: a Euclidean error on the $(x,y,z)$ vector, which may expose failures that angle-only and distance-only metrics obscure.
  • Whether the AVPS co-transform is actually implemented or not, checking it would give a concrete test of how much of the reported gain comes from augmentation versus the multi-stage attention design.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes MVANet, a multi-stage video attention network for audio-visual 3D sound event localization and detection (SELD) with source distance estimation. The network uses audio features from multiple stages to attend to relevant spatial regions in video frames, and introduces a 'source Cartesian coordinate' output that represents DOA and distance by multiplying normalized DOA vectors by the estimated distance. Training uses the STARSS23 dev-set with audio-visual pixel swapping (AVPS) and simulated data augmentation, plus initialization from a pre-trained audio-only ResNet-Conformer. On the STARSS23 dev-test set, the best configuration (ENH2+PT) reports F20°/1 = 0.567, DOAE = 12.37°, RDE = 0.239, outperforming the authors' previous top-ranked DCASE 2024 system (F20°/1 = 0.550, DOAE = 13.16°, RDE = 0.250) without model ensemble.

Significance. If the reported results are robust, the paper makes a modest but useful contribution to the DCASE community: it demonstrates that multi-stage audio-guided video attention can improve audio-visual 3D SELD, and it proposes a simple output representation that jointly encodes DOA and distance. The use of an official challenge dataset and comparison with the authors' own prior challenge submission are appropriate. However, the central claim of superiority over the previous system is weakened by a lack of controlled comparison (two variables change simultaneously), by the absence of error bars or multiple seeds, and by an underspecified augmentation step that may create contradictory spatial supervision. The paper is technically plausible but needs additional experiments and clarifications before the claim can be accepted.

major comments (4)
  1. [Section II-C] The AVPS augmentation is described as generating new video frames by flipping and rotating the original frames [11], but the paper never states whether the first-order ambisonic audio channels and the DOA/distance labels are transformed correspondingly (e.g., azimuth negation for horizontal flips, elevation and channel permutation for rotations). If the audio and labels are not co-transformed, the augmented training pairs contain contradictory spatial supervision, which would directly corrupt the SCE branch and undermine the very learning the central claim relies on. The authors must specify the exact co-transformations applied to the FOA audio, the Cartesian coordinate labels, and the distance labels, or correct the augmentation procedure.
  2. [Table II and Section III-C] The main comparison between MVANet (ENH2+PT) and Wang [31] (ENH2+PT) is not controlled. The Wang [31] row is taken from the prior DCASE 2024 challenge submission, which used a pre-trained audio model optimized for SED and DOA estimation without source distance pre-training, whereas MVANet uses an AO-RC model trained with the SDE task under ENH3. Thus two variables change at once: the fusion/attention architecture and the pre-trained audio encoder. The RDE improvement from 0.250 to 0.239 is larger than the corresponding no-pretraining gap (0.251 to 0.250 in Table I), suggesting that much of the gain may be attributable to the new pre-training rather than the proposed attention module. To establish the stated claim, the authors need to retrain the Wang [31] system under identical conditions (same pre-trained audio model, same AVPS implementation, same data splits, same seed protocol) or run an ablation that controls for pre-training.
  3. [Tables I and II] All reported metrics are single-run results on the official dev-test split, with no error bars or significance testing. The improvement in DOAE from 13.16° to 12.37° is a 0.79° difference that may easily fall within run-to-run variation for models of this complexity, especially given the stochastic nature of training. The paper should report means and standard deviations over at least three random seeds, or otherwise justify that the differences are statistically meaningful.
  4. [Table I and Section III-B] The ablation comparing MVANet with Wang [31] does not control for parameter count, computational cost, or training recipe beyond the stated setup. The reader cannot tell whether the observed improvements come from the proposed multi-stage attention or simply from a larger/more expressive model. A controlled ablation that matches capacity or reports parameter counts and FLOPs is needed to support the claim that the attention mechanism itself is the source of the gains.
minor comments (5)
  1. [Abstract and Introduction] The phrase 'an novel' in the Introduction should be corrected to 'a novel'.
  2. [Section II-B] In the sentence following Eq. (5), the term 'DOA loss L2' is inaccurate; Eq. (7) is the source coordinate estimation (SCE) loss, not a DOA loss. Please rename it to 'SCE loss' or 'coordinate loss'.
  3. [Section III-B] The text contains the typo 'EHN2' in 'under the “EHN2” setup'; this should read 'ENH2' consistently with the table captions.
  4. [Section III-A] Implementation details are incomplete for reproducibility: batch size, total number of training epochs, optimizer hyperparameters other than the learning-rate upper bound, and the exact tri-stage scheduler settings are not reported.
  5. [Section III-B and Table I] The baseline row 'Baseline BASE' (F20°/1 = 0.113) is not defined in the text or in the table caption; please specify which system this refers to (e.g., the official challenge baseline or a local implementation).

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: MVANet's claims are empirically tested on a public benchmark; self-citations are method references, not load-bearing.

full rationale

The paper's central claims are empirical: MVANet is trained and evaluated on the public STARSS23 dev-test set, and its performance (F20°/1=0.567, DOAE=12.37°, RDE=0.239 under ENH2+PT) is compared with published challenge results, including the authors' own previous system [31]. This is an external benchmark comparison, not a derivation from a definition, so it cannot reduce to its inputs by construction. The SED-SCE output representation (unit-vector DOA multiplied by distance) is a coordinate transformation of the labels, not a fitted parameter renamed as a prediction. References to the authors' prior work ([13], [28], [31]) supply data-augmentation recipes and baseline numbers rather than uniqueness theorems or unsupported premises; none is used to forbid alternatives. The comparison with [31] does change two variables at once (architecture and pre-trained audio model), and the missing AVPS label co-transformation is a documentation concern, but these are experimental-fairness or correctness risks, not circularity. No quoted equation reduces to its own input, and no load-bearing step is justified solely by a self-citation. Accordingly, no circular steps are identified.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The paper's empirical gains rest on unstated label-consistency assumptions in data augmentation and on hand-chosen loss weights. No new physical or mathematical entities are introduced.

free parameters (3)
  • β1 (SED loss weight) = 1
    Chosen by hand in Eq. (5); not derived or tuned by a reported search.
  • β2 (SCE loss weight) = 2
    Chosen by hand in Eq. (5); affects balance between classification and coordinate regression.
  • Video frame repetition factor = 5
    Visual features repeated 5 times per frame to align with audio features; a design choice that affects temporal alignment and computational cost.
assumptions (4)
  • domain assumption First-order ambisonic audio and panoramic video frames are temporally synchronized and spatially aligned as provided by STARSS23
    Required for attention fusion and for the loss to be meaningful; stated implicitly in Section III-A.
  • ad hoc to paper Flipping and rotating video frames during augmentation preserves the validity of the audio-visual training pairs
    Section II-C applies AVPS but does not specify corresponding transformations to FOA channels or labels; if false, augmented labels are corrupted.
  • domain assumption Simulated audio-visual data from [24], [25] is distributionally close enough to real STARSS23 data to transfer
    Used to expand training data from 3.8h to about 80h; no domain-gap analysis is provided.
  • domain assumption Pre-trained ImageNet ResNet-50 visual features and the audio-only ResNet-Conformer provide useful initializations
    Taken as given in Section II and III-C; no analysis of negative transfer.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MVANet: Multi-Stage Video Attention Network for Sound Event Localization and Detection with Source Distance Estimation." pith.science (2026). https://pith.science/paper/EREO3DDL

@misc{pith2026241114153,
  author       = {Pith},
  title        = {Pith review of: MVANet: Multi-Stage Video Attention Network for Sound Event Localization and Detection with Source Distance Estimation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/EREO3DDL}},
  note         = {Machine review of arXiv:2411.14153}
}
read the original abstract

Sound event localization and detection with source distance estimation (3D SELD) involves not only identifying the sound category and its direction-of-arrival (DOA) but also predicting the source's distance, aiming to provide full information about the sound position. This paper proposes a multi-stage video attention network (MVANet) for audio-visual (AV) 3D SELD. Multi-stage audio features are used to adaptively capture the spatial information of sound sources in videos. We propose a novel output representation that combines the DOA with distance of sound sources by calculating the real Cartesian coordinates to address the newly introduced source distance estimation (SDE) task in the Detection and Classification of Acoustic Scenes and Events (DCASE) 2024 Challenge. We also employ a variety of effective data augmentation and pre-training methods. Experimental results on the STARSS23 dataset have proven the effectiveness of our proposed MVANet. By integrating the aforementioned techniques, our system outperforms the top-ranked method we used in the AV 3D SELD task of the DCASE 2024 Challenge without model ensemble. The code will be made publicly available in the future.

Figures

Figures reproduced from arXiv: 2411.14153 by the authors.

Figure 1
Figure 1. An illustration of the MVANet architecture and the details of the attention module. * denotes frozen pre-trained parameters. “TP1” and “TP2” refer to [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Visualization comparison of the results under ‘ENH2 + PT’ with [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Integrating Spatial and Semantic Embeddings for Stereo Sound Event Localization in Videos

    eess.AS 2025-09 conditional novelty 5.0 of 10

    A Cross-Modal Conformer that fuses CLAP audio and OWL-ViT visual embeddings with a CNN-Conformer SELD backbone, trained on large synthetic data, ranks second in DCASE 2025 Task 3 Track B.

  2. Spatial and Semantic Embedding Integration for Stereo Sound Event Localization and Detection in Regular Videos

    eess.AS 2025-07 conditional novelty 5.0 of 10

    Fusing frozen CLAP and OWL-ViT embeddings via a Cross-Modal Conformer, plus autocorrelation-based features, improves stereo SELD over DCASE 2025 baselines.

Reference graph

Works this paper leans on

33 extracted references · 29 canonical work pages · cited by 2 Pith papers

  1. [31]

    The nerc-slip system for sound event localization and detection with source distance estimation of DCASE 2024 challenge,

    Q. Wang, Y . Dong, H. Hong, R. Wei, M. Hu, S. Cheng, Y . Jiang, M. Cai, X. Fang, and J. Du, “The nerc-slip system for sound event localization and detection with source distance estimation of DCASE 2024 challenge,” DCASE2024 Challenge, Tech. Rep., 2024

    work page 2024

  2. [8]

    Sound event detection and localization with distance estimation,

    D. A. Krause, A. Politis, and A. Mesaros, “Sound event detection and localization with distance estimation,” arXiv preprint arXiv:2403.11827, 2024

    arXiv 2024

  3. [11]

    Fusion of audio and visual embeddings for sound event localization and detection,

    D. Berghi, P. Wu, J. Zhao, W. Wang and P. J. B. Jackson, “Fusion of audio and visual embeddings for sound event localization and detection,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024, pp. 8816–8820

    work page 2024

  4. [1]

    Overview and evaluation of sound event localization and detection in DCASE 2019,

    A. Politis, A. Mesaros, S. Adavanne, T. Heittola and T. Virtanen, “Overview and evaluation of sound event localization and detection in DCASE 2019,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 29, pp. 684–698, 2020

    work page 2019

  5. [2]

    A sequence matching network for polyphonic sound event localization and detection,

    T. N. Tho Nguyen, D. L. Jones and W. -S. Gan, “A sequence matching network for polyphonic sound event localization and detection,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, pp. 71–75

    work page 2020

  6. [3]

    Sound event localization and detection of overlapping sources using convolutional recurrent neural networks,

    S. Adavanne, A. Politis, J. Nikunen and T. Virtanen, “Sound event localization and detection of overlapping sources using convolutional recurrent neural networks,” IEEE Journal of Selected Topics in Signal Processing, vol. 13, pp. 34–48, 2019

    work page 2019

  7. [4]

    ACCDOA: Activity-coupled cartesian direction of arrival representation for sound event localization and detection,

    K. Shimada, Y . Koyama, N. Takahashi, S. Takahashi and Y . Mitsufuji, “ACCDOA: Activity-coupled cartesian direction of arrival representation for sound event localization and detection,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2021, pp. 915–919

    work page 2021

  8. [5]

    An improved event-independent network for polyphonic sound event local- ization and detection,

    Y . Cao, T. Iqbal, Q. Kong, F. An, W. Wang and M. D. Plumbley, “An improved event-independent network for polyphonic sound event local- ization and detection,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2021, pp. 885–889

    work page 2021

Show all 33 references
  1. [6]

    Multi-ACCDOA: Localizing and detecting overlapping sounds from the same class with auxiliary duplicating permutation invariant training,

    K. Shimada, Y . Koyama, S. Takahashi, N. Takahashi, E. Tsunoo and Y . Mitsufuji, “Multi-ACCDOA: Localizing and detecting overlapping sounds from the same class with auxiliary duplicating permutation invariant training,” in IEEE International Conference on Acoustics, Speech and...

    2022

  2. [7]

    AD-YOLO: You look only once in training multiple sound event localization and detection,

    J. S. Kim, H. Joon Park, W. Shin and S. W. Han, “AD-YOLO: You look only once in training multiple sound event localization and detection,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023, pp. 1–5

    2023

  3. [9]

    Binaural sound source distance estimation and localization for a moving listener,

    D. A. Krause, G. Garc ´ıa-Barrios, A. Politis and A. Mesaros, “Binaural sound source distance estimation and localization for a moving listener,” IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 32, pp. 996–1011, 2024

    2024

  4. [10]

    Speaker distance estimation in enclosures from single-channel audio,

    M. Neri, A. Politis, D. A. Krause, M. Carli and T. Virtanen, “Speaker distance estimation in enclosures from single-channel audio,”IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 32, pp. 2242–2254, 2024

    2024

  5. [12]

    Egocentric deep multi-channel audio-visual active speaker localization,

    H. Jiang, C. Murdock and V . K. Ithapu, “Egocentric deep multi-channel audio-visual active speaker localization,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2022, pp. 10534– 10542

    2022

  6. [13]

    The nerc-slip system for sound event localization and detection of DCASE2023 challenge,

    Q. Wang, Y . Jiang, S. Cheng, M. Hu, Z. Nian, P. Hu, Z. Liu, Y . Dong, M. Cai, J. Du, and C.-H. Lee, “The nerc-slip system for sound event localization and detection of DCASE2023 challenge,” DCASE2023 Challenge, Tech. Rep., 2023

    2023

  7. [14]

    Exploring audio-visual information fusion for sound event localization and detection in low- resource realistic scenarios,

    Y . Jiang, Q. Wang, J. Du, M. Hu, P. Hu, Z. Liu, S. Cheng, Z. Nian, Y . Dong, M. Cai, X. Fang, and C.-H. Lee, “Exploring audio-visual information fusion for sound event localization and detection in low- resource realistic scenarios,” Accepted by International Conference on Mu...

    2024

  8. [15]

    The distillation system for sound event localization and detection of DCASE2023 challenge,

    S.-I. Kang, K. Cho, M. Keum, and Y . Park, “The distillation system for sound event localization and detection of DCASE2023 challenge,” DCASE2023 Challenge, Tech. Rep., 2023

    2023

  9. [16]

    Data augmentation, neural networks, and ensemble methods for sound event localization and detection,

    G. Kim and H. Ko, “Data augmentation, neural networks, and ensemble methods for sound event localization and detection,” DCASE2023 Challenge, Tech. Rep., 2023

    2023

  10. [17]

    Audio-visual event localization in unconstrained videos,

    Y . Tian, J. Shi, B. Li, “Audio-visual event localization in unconstrained videos,” in European Conference on Computer Vision , 2018, pp. 247– 263

    2018

  11. [18]

    An experimental study on sound event localization and detection under realistic testing conditions,

    S. Niu, J. Du, Q. Wang, L. Chai, H. Wu, Z. Nian, L. Sun, Y . Fang, J. Pan, and C.-H. Lee, “An experimental study on sound event localization and detection under realistic testing conditions,” in International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 202...

    2023

  12. [19]

    Deep residual learning for image recognition,

    K. He, X. Zhang, S. Ren and J. Sun, “Deep residual learning for image recognition,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2016, pp. 770–778

    2016

  13. [20]

    Conformer: Convolution- augmented transformer for speech recognition,

    A. Gulati, J. Qin, C.-C. Chiu, N. Parmar, Y . Zhang, J. Yu, W. Han, S. Wang, Z. Zhang, Y . Wu, and R. Pang, “Conformer: Convolution- augmented transformer for speech recognition,” in Interspeech, 2020, pp. 5036–5040

    2020

  14. [21]

    Audioscopev2: Audio-visual attention architectures for calibrated open-domain on- screen sound separation,

    E. Tzinis, S. Wisdom, T. Remez, and J. R. Hershey, “Audioscopev2: Audio-visual attention architectures for calibrated open-domain on- screen sound separation,” arXiv preprint arXiv:2207.10141 , 2022

    2022 arXiv

  15. [22]

    Audio-visual event localization by learning spatial and semantic co-attention,

    C. Xue, X. Zhong, M. Cai, H. Chen and W. Wang, “Audio-visual event localization by learning spatial and semantic co-attention,” IEEE Transactions on Multimedia , vol. 25, pp. 418–429, 2023

    2023

  16. [23]

    STARSS23: An audio-visual dataset of spatial recordings of real scenes with spatiotemporal annotations of sound events,

    K. Shimada, A. Politis, P. Sudarsanam, D. A. Krause, K. Uchida, S. Adavanne, A. Hakala, Y . Koyama, N. Takahashi, S. Takahashi, T. Virtanen, and Y . Mitsufuji, “STARSS23: An audio-visual dataset of spatial recordings of real scenes with spatiotemporal annotations of sound even...

    2023

  17. [24]

    Enhanced sound event localization and detection in real 360-degree audio-visual sound- scapes,

    A. S. Roman, B. Balamurugan, and R. Pothuganti, “Enhanced sound event localization and detection in real 360-degree audio-visual sound- scapes,” arXiv preprint arXiv:2401.17129 , 2024

    2024 arXiv

  18. [25]

    Spatial scaper: A library to simulate and augment soundscapes for sound event localization and detection in realistic rooms,

    I. R. Roman, C. Ick, S. Ding, A. S. Roman, B. McFee and J. P. Bello, “Spatial scaper: A library to simulate and augment soundscapes for sound event localization and detection in realistic rooms,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICAS...

    2024

  19. [26]

    METU SPARG eigenmike em32 acoustic impulse response dataset v0. 1.0,

    O. Olgun and H. Hacihabiboglu, “METU SPARG eigenmike em32 acoustic impulse response dataset v0. 1.0,” Graduate School Inform., Middle East Tech. Univ., Ankara, Turkey, Tech. Rep , 2019

    2019

  20. [27]

    A dataset of reverberant spatial sound scenes with moving sources for sound event localization and detection,

    A. Politis, S. Adavanne, and T. Virtanen, “A dataset of reverberant spatial sound scenes with moving sources for sound event localization and detection,” in DCASE Workshop, 2020, pp. 165–169

    2020

  21. [28]

    A four-stage data augmentation approach to resnet-conformer based acoustic model- ing for sound event localization and detection,

    Q. Wang, J. Du, H. -X. Wu, J. Pan, F. Ma and C. -H. Lee, “A four-stage data augmentation approach to resnet-conformer based acoustic model- ing for sound event localization and detection,”,IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 31, pp. 1251–1264, 2023

    2023

  22. [29]

    Adam: A method for stochastic optimization,

    D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980 , 2014

    2014 arXiv

  23. [30]

    SpecAugment: A simple data augmentation method for automatic speech recognition,

    D. S. Park, W. Chan, Y . Zhang, et al., “SpecAugment: A simple data augmentation method for automatic speech recognition,” in Interspeech, 2019, pp. 2613–2617

    2019

  24. [32]

    Leveraging reverberation and visual depth cues for sound event localization and detection with distance estimation,

    D. Berghi and P. J. B. Jackson, “Leveraging reverberation and visual depth cues for sound event localization and detection with distance estimation,” DCASE2024 Challenge, Tech. Rep., 2024

    2024

  25. [33]

    Data augmentation and cross-fusion for audiovisual sound event localization and detection with source distance estimation,

    Y . Li, C. Wang, and Q. Huang, “Data augmentation and cross-fusion for audiovisual sound event localization and detection with source distance estimation,” DCASE2024 Challenge, Tech. Rep., 2024

    2024

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.