Focus on the Sound around You: Monaural Target Speaker Extraction via Distance and Speaker Information

Heinrich Dinkel; Jiuxin Lin; Junbo Zhang; Jun Chen; Peng Wang; Yongqing Wang; Yujun Wang; Zhiyong Wu; Zhiyong Yan

Focus on the Sound around You: Monaural Target Speaker Extraction via Distance and Speaker Information

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2306.16241 v2 pith:S5Z32XZN submitted 2023-06-28 cs.SD eess.AS

Jiuxin Lin , Peng Wang , Heinrich Dinkel , Jun Chen , Zhiyong Wu , Zhiyong Yan , Yongqing Wang , Junbo Zhang

show 1 more author

Yujun Wang

This is my paper · ORCID

classification cs.SDeess.AS

keywords speakerinformationsoundapplicationdistanceenvironmentsextractionns-extractor

verification ladder T0 review T1 audit T2 compute T3 formal

0 comments

read the original abstract

Previously, Target Speaker Extraction (TSE) has yielded outstanding performance in certain application scenarios for speech enhancement and source separation. However, obtaining auxiliary speaker-related information is still challenging in noisy environments with significant reverberation. inspired by the recently proposed distance-based sound separation, we propose the near sound (NS) extractor, which leverages distance information for TSE to reliably extract speaker information without requiring previous speaker enrolment, called speaker embedding self-enrollment (SESE). Full- & sub-band modeling is introduced to enhance our NS-Extractor's adaptability towards environments with significant reverberation. Experimental results on several cross-datasets demonstrate the effectiveness of our improvements and the excellent performance of our proposed NS-Extractor in different application scenarios.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

Single-Channel Target Speech Extraction Utilizing Distance and Room Clues
eess.AS 2025-05 conditional novelty 6.0 of 10

Adding room dimensions and reverberation time as inputs to a distance-based target speech extraction model improves SDR by about 1.2 dB on unseen simulated and real rooms.

Pith tools