REVIEW 2 major objections 5 minor 27 references
Sample Rate Offset Compensated Acoustic Echo Cancellation For Multi-Device Scenarios
T0 review · 2 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read Sample rate offsets between devices no longer have to break acoustic echo cancellation.
desk verdict A solid empirical integration paper whose real contribution is the decoupling finding for correlated playback; the ideal-VAD dependence and lack of error bars are the soft spots, not the math. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the frequency-domain phase-rotation model $\Lambda(k,m)$, which turns a drifting auxiliary signal into a stationary reference at the primary device's clock. The DWACD algorithm estimates $\epsilon_{1,2}$ from the phase slope of the complex coherence between the auxiliary reference and a chosen error signal, using golden-search refinement for the fractional time lag; the estimated rotation then resamples $X_2$ to produce $\tilde X_2$ for the two-channel Kalman filter. The second key piece is Variant 2's independent single-channel AEC, whose error $E_0$ removes the primary device's own echo before coherence estimation, decoupling SRO estimation from the slow-converging multi-channel filter.
What would settle it
Use the same setup but replace the clean pre-transmission $X_2$ with the delayed or mixed signal a primary device could actually observe after transmission; if ERLE and PESQ no longer recover to the no-SRO baseline, the pre-transmission-access assumption, not the SRO-estimation and resampling method, is what carries the result.
Extended reading notes
Core claim
The central claim is that the divergence of a multi-channel Kalman AEC filter under sample rate offset can be mitigated by estimating the offset with the dynamic weighted average coherence drift algorithm and resampling the auxiliary far-end signal before filtering. Concretely, the SRO appears in the frequency domain as the phase rotation $\Lambda(k,m) = e^{-j2\pi k/N_w \cdot mN_h \epsilon_{1,2}/f_1}$ on $X_2(k,m)$, so resampling means multiplying the auxiliary reference by this rotation and using $\tilde X_2 = X_2\Lambda$ as the second channel's input to the partitioned-block Kalman filter. In two-device experiments, this restores no-offset ERLE and PESQ for uncorrelated playback, and for correlated playback the decoupled Variant 2 matches oracle performance in echo-only; a residual gap in double-talk is attributed to less robust SRO estimation when near-end speech is present.
Load-bearing premise
The primary device must have access to the auxiliary far-end signal $X_2$ before it is transmitted, so the SRO estimator and resampler always see a clean reference; if only a delayed, mixed, or post-transmission copy is available, the synchronous compensation chain cannot be set up.
Editorial extensions
If this is right
- For uncorrelated playback, SRO compensation makes the two-device Kalman AEC reach the no-SRO baseline for offsets within at least ±75 ppm and keeps most of that gain up to ±150 ppm.
- For correlated playback, the SRO estimator must be fed by an independent single-channel AEC; without that decoupling, the proposed system performs no better than doing no compensation.
- SRO estimates remain stable across echo path changes in echo-only conditions, so moving a device or switching a microphone does not force re-convergence of the offset estimate.
- The resampling-based compensation does not add algorithmic delay, since the SRO estimate uses two previous 0.512-second segments.
- In double-talk with correlated playback, even the oracle-SRO system leaves a performance gap, indicating that SRO estimation robustness, not the Kalman structure alone, is the remaining bottleneck.
Reading between the lines
- The same phase-rotation and resampling recipe should generalize to $Q$ devices by estimating each auxiliary SRO independently, but the paper only validates the two-device case, so behavior across many devices is untested.
- The energy-based ideal VAD used for coherence gating means real-world noise and double-talk may weaken SRO estimates; a robust voice activity detector or a non-speech reference would be a natural next test.
- A fully blind setup, where the primary device only hears the auxiliary loudspeaker through the microphone instead of receiving a clean reference, escapes the paper's access assumption and is the main scenario the method cannot yet serve.
- If SRO estimation accuracy is the double-talk bottleneck, improving the coherence estimator, for example by longer temporal smoothing or a multi-tap lag search, could close the correlated-playback gap without changing the two-channel Kalman structure.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper addresses acoustic echo cancellation in a two-device scenario where an auxiliary loudspeaker runs on an independent clock, introducing sample rate offset (SRO) between the far-end reference and the primary device's microphone. The authors propose a synchronous compensation scheme: estimate the SRO using the DWACD algorithm and resample the auxiliary signal before feeding it to a two-channel frequency-domain Kalman AEC. Two variants are presented: Variant 1 uses the two-channel AEC error for SRO estimation, while Variant 2 uses the error of an independent single-channel AEC to decouple SRO estimation from filter convergence. Experiments with 50 simulated two-device settings compare these variants against no-SRO, no-compensation, and oracle-SRO baselines for both uncorrelated and correlated playback, in echo-only and double-talk scenarios. The results show that for uncorrelated playback both variants reach the no-SRO baseline, whereas for correlated playback Variant 2 matches the oracle in echo-only but leaves a performance gap in double-talk.
Significance. If the results are reproducible, the paper offers a practical step toward handling clock drift between consumer devices in spatial teleconferencing, and the Variant 2 decoupling idea is a useful design insight. The authors are honest about the correlated double-talk gap and the limitations at higher SRO values, and they link to an online resource for reproducibility. The treatment is empirical rather than analytical, but the experimental design is reasonable for the scope. The main qualification is that the SRO estimator relies on an energy-based ideal VAD, which makes the double-talk claims weaker than they first appear for real systems.
major comments (2)
- [Sec. 3.1, Eqs. (5)-(9)] The SRO estimator is gated by an 'energy-based ideal VAD' that knows the ground-truth speech activity in I(k,m). In the double-talk experiments this oracle makes the estimator immune to near-end speech interference, because frames containing near-end speech are excluded from the coherence updates. The abstract claims the system 'mitigates the divergence ... during ... double-talk', but Fig. 5 shows that Variant 2 already falls short of the oracle-SRO baseline in double-talk for correlated playback; with a practical VAD, misclassified speech-active frames would corrupt the GCC phase in Eq. (9) and likely enlarge the gap. Please add an ablation that replaces the ideal VAD with a realistic speech-activity detector (or with a VAD at controlled error rates) and report whether the double-talk results are preserved. Without this, the double-talk claim is not established for non-oracle conditions.
- [Sec. 4.2, Figs. 4-5] All ERLE and PESQ values are reported as averages over 50 test files with no measure of variance. The claim in Sec. 4.2 that Variant 2 and the oracle have 'almost identical performance' in the echo-only correlated case is a comparison of two point estimates; without error bars or paired significance testing, the reader cannot judge whether the small differences around ±75-150 ppm are meaningful. Report per-SRO standard deviations or confidence intervals, or provide a statistical test for the key comparisons.
minor comments (5)
- [Sec. 3.2, sentence after Eq. (12)] The passage 'we use ˜X2 (k, m) instead X2 (k, m) of as the reference signal' is ungrammatical; rewrite as 'we use ~X2(k,m), instead of X2(k,m), as the reference signal.'
- [Sec. 4.2, correlated playback paragraph] The sentence 'the filter bH1,1 and bH1,2 do not converge to the true AIR H1,1 and H2,2 respectively' contains an index typo: H2,2 should be H1,2.
- [Sec. 4.2, SRO estimation description] The statement 'For the estimation of the SRO, two previous segments, each of length 8192 samples corresponding to 0.512 s, are used' is unclear: are the two segments overlapping or disjoint, and is the SRO estimate updated every 8192 samples? Please clarify the update schedule.
- [References] Reference [19] is cited for the WSJ0 corpus but is actually a speech-separation paper; please cite the WSJ0 corpus directly (e.g., Garofolo et al., 1993).
- [Eq. (4), condition following it] The condition m Nh epsilon_1,2 / f1 << Nw is stated but never checked for the experimental parameters (e.g., SRO ±150 ppm, hop 256, 36 s signals). Please confirm that the condition is satisfied for the farthest evaluated frame.
Circularity Check
No circular derivation: the SRO estimator and the AEC are evaluated against external metrics and ground-truth SRO values.
full rationale
The paper's claimed derivation chain is self-contained and does not reduce to its inputs. The SRO estimate is obtained from the coherence-drift method in Eqs. (5)-(9), using the input signal I(k,m) and reference X2(k,m); it is then validated directly against the simulated true SRO in Figs. 6-7 and indirectly through ERLE and PESQ in Figs. 4-5. The two-channel AEC is a standard partitioned-block Kalman filter, and the proposed variants differ only in which error signal feeds the SRO estimator. The resampled reference is constructed from the estimated SRO and then used by the AEC; this is the intended signal-processing loop, not a fitted parameter renamed as a prediction, because the SRO estimate is not optimized to maximize the reported metrics and the AEC performance is measured by independent quality measures. The only self-reference appears to be the RIR generator tool by one of the authors, used for synthesizing test room impulse responses; this is a standard simulation utility and is not load-bearing for any conclusion. The use of an 'energy-based ideal VAD' is an oracle assumption that raises a practical robustness concern for double-talk operation, but it does not make the evaluation circular: the SRO estimator could fail under non-ideal VADs without the paper's claims being true by construction. No circularity is found.
Assumptions & free parameters
free parameters (4)
- Smoothing factor alpha =
0.95
- Kalman transition factor A =
0.999
- Filter taps, FFT length, hop size =
10 taps, 512, 256
- SRO estimator segment length =
8192 samples (0.512 s)
assumptions (5)
- domain assumption The resampled auxiliary signal can be approximated as a phase ramp e^{-j 2 pi k/Nw * m Nh epsilon/f1}, valid when m Nh epsilon/f1 << Nw.
- domain assumption Filter partitions are mutually uncorrelated with zero mean; process noise covariance and transition factor A are known.
- domain assumption The SRO is constant, and there is no packet loss, sampling time offset, or variable SRO.
- ad hoc to paper Energy-based ideal VAD provides ground-truth speech activity to gate coherence estimation.
- domain assumption The room impulse responses are simulated with a generator rather than measured.
Cite this review
Pith. "Pith review of Sample Rate Offset Compensated Acoustic Echo Cancellation For Multi-Device Scenarios." pith.science (2026). https://pith.science/paper/BJ4B7RZJ
@misc{pith2026250705399,
author = {Pith},
title = {Pith review of: Sample Rate Offset Compensated Acoustic Echo Cancellation For Multi-Device Scenarios},
year = {2026},
howpublished = {\url{https://pith.science/paper/BJ4B7RZJ}},
note = {Machine review of arXiv:2507.05399}
}
read the original abstract
Acoustic echo cancellation (AEC) in multi-device scenarios is a challenging problem due to sample rate offset (SRO) between devices. The SRO hinders the convergence of the AEC filter, diminishing its performance. To address this , we approach the multi-device AEC scenario as a multi-channel AEC problem involving a multi-channel Kalman filter, SRO estimation, and resampling of far-end signals. Experiments in a two-device scenario show that our system mitigates the divergence of the multi-channel Kalman filter in the presence of SRO for both correlated and uncorrelated playback signals during echo-only and double-talk. Additionally, for devices with correlated playback signals, an independent single-channel AEC filter is crucial to ensure fast convergence of SRO estimation.
Reference graph
Works this paper leans on
-
[1]
In spatial teleconferencing systems [5] using multiple devices, as il- lustrated in Fig
INTRODUCTION Acoustic echo cancellation (AEC) is a critical acoustic signal pro- cessing technique employed to mitigate the echo caused by the acoustic coupling between loudspeakers and microphones [1–4]. In spatial teleconferencing systems [5] using multiple devices, as il- lustrated in Fig. 1, a primary device (such as a smartphone or a laptop) is typic...
-
[2]
Sample Rate Offset Compensated Acoustic Echo Cancellation For Multi-Device Scenarios
MULTI-DEVICE SCENARIO Let us consider a room with Q devices. Without loss of generality, we assume one microphone and one loudspeaker per device. The time-domain microphone signal of the primary device with index arXiv:2507.05399v1 [eess.AS] 7 Jul 2025 ++ ˆH1,2ˆH1,1 ResamplingSRO Estimation ˆϵ1,2 ˜X2(k,m ) E1(k,m )Y1(k,m ) X1(k,m ) X2(k,m ) E(k,m ) −− Fig...
work page Pith review arXiv 2025
-
[3]
PROPOSED METHOD The two variants of the proposed two-device AEC envisioned as a two-channel AEC system with SRO compensation are shown in Figs. 2 and 3, respectively. The SRO compensation comprises of SRO estimation and resampling, which is described in Sec. 3.1. The two-channel AEC filter is described in detail in Sec. 3.2. The main difference between th...
-
[4]
EXPERIMENTAL RESULTS The performance of our proposed system is evaluated under both correlated cases, where the devices are playing back the same sig- nal, and uncorrelated cases, where the devices are playing back different signals. In the echo-only scenario, echo return loss en- hancement (ERLE) [1] is used to evaluate the performance whereas, perceptua...
work page 2024
-
[5]
CONCLUSION We proposed two variants of two-channel AEC for addressing the two-device AEC problem in the presence of SRO and evaluated them for both uncorrelated or correlated playback signals in echo-only and double-talk scenarios. We showed that for uncorrelated playback signals, it is possible to compensate for SRO and reach the perfor- mance of the sys...
-
[6]
E. Hansler and G. Schmidt, Acoustic Echo and Noise Control: A Practical Approach, Wiley-Interscience, USA, 2004
work page 2004
-
[7]
Frequency-domain adaptive Kalman filter for acoustic echo control in hands-free telephones,
G. Enzner and P. Vary, “Frequency-domain adaptive Kalman filter for acoustic echo control in hands-free telephones,” Sig- nal Processing, vol. 86, no. 6, pp. 1140–1156, June 2006
work page 2006
-
[8]
Recursive Bayesian Control of Multi- channel Acoustic Echo Cancellation,
S. Malik and G. Enzner, “Recursive Bayesian Control of Multi- channel Acoustic Echo Cancellation,” IEEE Signal Processing Letters, vol. 18, no. 11, pp. 619–622, Nov. 2011
work page 2011
Show all 27 references
-
[9]
State-space architec- ture of the partitioned-block-based acoustic echo controller,
F. Kuech, E. Mabande, and G. Enzner, “State-space architec- ture of the partitioned-block-based acoustic echo controller,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , Florence, Italy, May 2014, pp. 1295–1299, IEEE
2014
-
[10]
Interactive teleconferencing combining spatial audio object coding and dirac technology,
J. Herre, C. Falch, D. Mahane, G. Del Galdo, M. Kallinger, and O. Thiergart, “Interactive teleconferencing combining spatial audio object coding and dirac technology,” J. Audio Eng. Soc , vol. 59, no. 12, pp. 924–935, 2012
2012
-
[11]
Clock- Drift: a mobile application for measuring drift in multimedia devices,
M. Guggenberger, M. Lux, and L. B ¨osz¨ormenyi, “Clock- Drift: a mobile application for measuring drift in multimedia devices,” in Proceedings of the 22nd ACM international con- ference on Multimedia , Orlando Florida USA, Nov. 2014, pp. 767–768, ACM
2014
-
[12]
An Analysis of Time Drift in Hand-Held Recording Devices,
M. Guggenberger, M. Lux, and L. B ¨osz¨ormenyi, “An Analysis of Time Drift in Hand-Held Recording Devices,” in MultiMe- dia Modeling, vol. 8935, pp. 203–213. Springer International Publishing, Cham, 2015, Series Title: Lecture Notes in Com- puter Science
2015
-
[13]
On Deal- ing with Sampling Rate Mismatches in Blind Source Separa- tion and Acoustic Echo Cancellation,
E. Robledo-Arnuncio, T. S. Wada, and B-H. Juang, “On Deal- ing with Sampling Rate Mismatches in Blind Source Separa- tion and Acoustic Echo Cancellation,” in IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, NY , USA, Oct. 2007, pp. 34–37, IEEE
2007
-
[14]
Adaptive Sampling Rate Correction for Acoustic Echo Control in V oice-Over-IP,
M. Pawig, G. Enzner, and P. Vary, “Adaptive Sampling Rate Correction for Acoustic Echo Control in V oice-Over-IP,”IEEE Transactions on Signal Processing, vol. 58, no. 1, pp. 189–199, Jan. 2010
2010
-
[15]
Frequency domain acoustic echo canceller that handles asynchronous A/D and D/A clocks,
M. Abe and M. Nishiguchi, “Frequency domain acoustic echo canceller that handles asynchronous A/D and D/A clocks,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , Florence, Italy, May 2014, pp. 5924–5928, IEEE
2014
-
[16]
Asynchronous Acoustic Echo Cancellation Over Wireless Channels,
R. Ayrapetian, P. Hilmes, M. Mansour, T. Kristjansson, and C. Murgia, “Asynchronous Acoustic Echo Cancellation Over Wireless Channels,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , Toronto, ON, Canada, June 2021, pp. 116–120, IEEE
2021
-
[17]
Clock Skew Robust Acoustic Echo Cancella- tion,
K. Helwani, E. Soltanmohammadi, M. M Goodwin, and A. Kr- ishnaswamy, “Clock Skew Robust Acoustic Echo Cancella- tion,” in Interspeech 2022. Sept. 2022, pp. 2533–2537, ISCA
2022
-
[18]
On Synchronization of Wireless Acoustic Sensor Networks in the Presence of Time-Varying Sampling Rate Offsets and Speaker Changes,
T. Gburrek, J. Schmalenstroeer, and R. Haeb-Umbach, “On Synchronization of Wireless Acoustic Sensor Networks in the Presence of Time-Varying Sampling Rate Offsets and Speaker Changes,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , Singa...
2022
-
[19]
Multi-stage coherence drift based sam- pling rate synchronization for acoustic beamforming,
J. Schmalenstroeer, J. Heymann, L. Drude, C. Boeddecker, and R. Haeb-Umbach, “Multi-stage coherence drift based sam- pling rate synchronization for acoustic beamforming,” inIEEE 19th International Workshop on Multimedia Signal Processing (MMSP), Luton, Oct. 2017, pp. 1–6, IEEE
2017
-
[20]
Online Estimation of Sampling Rate Offsets in Wireless Acoustic Sensor Networks with Packet Loss,
A. Chinaev, G. Enzner, T. Gburrek, and J. Schmalenstroeer, “Online Estimation of Sampling Rate Offsets in Wireless Acoustic Sensor Networks with Packet Loss,” in 29th Euro- pean Signal Processing Conference (EUSIPCO) , Dublin, Ire- land, Aug. 2021, pp. 1110–1114, IEEE
2021
-
[21]
Blind sam- pling rate offset estimation and compensation in wireless acoustic sensor networks with application to beamforming,
S. Markovich-Golan, S. Gannot, and I. Cohen, “Blind sam- pling rate offset estimation and compensation in wireless acoustic sensor networks with application to beamforming,” in International Workshop on Acoustic Signal Enhancement , 2012, pp. 1–4
2012
-
[22]
Correlation maximization-based sam- pling rate offset estimation for distributed microphone arrays,
L. Wang and S. Doclo, “Correlation maximization-based sam- pling rate offset estimation for distributed microphone arrays,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 24, no. 3, pp. 571–582, 2016
2016
-
[23]
P.862: Perceptual evaluation of speech quality (pesq): An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs,
ITU-T, “P.862: Perceptual evaluation of speech quality (pesq): An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs,” 2001
2001
-
[24]
Single-channel multi-speaker separation using deep cluster- ing,
Y . Z. Isik, J. Le Roux, Z. Chen, S. Watanabe, and J. R. Hershey, “Single-channel multi-speaker separation using deep cluster- ing,” CoRR, vol. abs/1607.02173, 2016
2016 arXiv
-
[25]
Room impulse response (RIR) gener- ator,
Emanu ¨el A. P. Habets, “Room impulse response (RIR) gener- ator,” 2008
2008
-
[26]
Lib- riW ASN: A data set for meeting separation, diarization, and recognition with asynchronous recording devices,
J. Schmalenstroeer, T. Gburrek, and R. Haeb-Umbach, “Lib- riW ASN: A data set for meeting separation, diarization, and recognition with asynchronous recording devices,” inITG con- ference on Speech Communication (ITG 2023) , Sep 2023
2023
-
[27]
Efficient sampling rate offset compensation - an overlap-save based approach,
J. Schmalenstroeer and R. Haeb-Umbach, “Efficient sampling rate offset compensation - an overlap-save based approach,” in 26th European Signal Processing Conference (EUSIPCO) , 2018, pp. 499–503
2018
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.