Pith. sign in

REVIEW 2 major objections 4 minor 1 cited by

A simple linear map turns WavLM features into a low-rank content code that suppresses speaker timbre, enabling zero-shot voice conversion from a few seconds of target speech.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.5

2026-07-15 12:20 UTC pith:QSIN4PCI

load-bearing objection Clean open-set extension of SCF with transparent least-squares math, solid in-domain evidence, and public code; speaker similarity is the soft spot and true out-of-domain universality is untested. the 2 major comments →

arxiv 2603.08977 v2 pith:QSIN4PCI submitted 2026-03-09 eess.AS cs.SD

Universal Speech Content Factorization

Henry Li Xinyuan , Zexin Cai , Lin Zhang , Leibny Paola Garc\'ia-Perera , Berrak Sisman , Sanjeev Khudanpur , Nicholas Andrews , Matthew Wiesner This is my paper
classification eess.AS cs.SD
keywords voice conversionspeech content factorizationWavLMspeaker disentanglementzero-shot VCtext-to-speechlinear factorization
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This paper claims that the linear structure already known to exist among self-supervised speech features of a closed set of speakers generalizes to completely unseen speakers. By solving a single least-squares problem on the closed-set factorization, the authors obtain a universal speech-to-content matrix; any new speaker’s content-to-speech matrix can then be recovered from only a few seconds of that speaker’s audio. The resulting low-rank representation keeps phonetic content while discarding most speaker-identifying information, so that voice conversion becomes a pair of matrix multiplications and the same features can serve as training targets for text-to-speech models that should ignore timbre. The practical payoff is competitive intelligibility, naturalness and speaker similarity without the large target-speaker corpora or extra neural training required by earlier systems.

Core claim

USCF shows that a single least-squares map W, learned once from a closed-set SVD of content-aligned WavLM features, converts any speaker’s frames into a shared low-rank content representation, while a speaker-specific matrix Sm can be estimated from as little as a few hundred frames of target speech; the composition yields invertible, zero-shot voice conversion whose quality matches methods that need far more data or additional training.

What carries the argument

Universal speech-to-content mapping W (three candidate least-squares formulations W1–W3) together with the linear recovery Sm ≈ (X′m W)† X′m; these two matrices factor every utterance into content C and speaker transform S.

Load-bearing premise

The linear content-and-timbre geometry observed among the speakers used for the initial factorization continues to hold for completely new speakers, so that one fixed map W and a short linear estimate of Sm remain accurate.

What would settle it

Measure whether the same fixed W and a 10-second estimate of Sm still produce intelligible, speaker-similar conversion on speakers drawn from a domain far outside the closed-set training speakers (for example, heavily accented or noisy conversational speech); a sharp drop in WER or speaker similarity would falsify the claimed generalization.

Watch this falsifier — get emailed when new claim-graph text bears on it.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 4 minor

Summary. The paper introduces Universal Speech Content Factorization (USCF), an open-set extension of closed-set Speech Content Factorization (SCF). It learns a single universal speech-to-content linear map W (via three least-squares formulations W1–W3 on content-aligned WavLM features from a closed set of speakers) and estimates a speaker-specific content-to-speech matrix Sm from as little as ~10 s of target speech via the pseudoinverse relation Sm ≈ (X'm W)† X'm. The resulting low-rank representation is claimed to suppress speaker timbre while preserving phonetic content, enabling zero-shot voice conversion that is competitive in WER, UTMOS, MOS/SMOS and speaker similarity with kNN-VC, LinearVC, closed-set SCF and SeedVC, plus serving as an efficient acoustic target for flow-matching TTS. Supporting evidence includes embedding probes on TIMIT (Table 3), rank and enrollment-length ablations (Tables 4–5), and a TTS transfer experiment (Table 6).

Significance. If the linear subspace structure generalizes, USCF supplies a simple, closed-form, invertible and training-free alternative to neural disentanglement or large-enrollment matching methods for open-set VC and for producing timbre-suppressed features usable as TTS targets. The public code and samples, the explicit comparison of three W formulations, the phoneme/speaker-ID probes showing better speaker removal than ContentVec or kNN-normalized WavLM, and the demonstration that USCF targets reduce TTS training epochs while improving WER are concrete strengths that make the work immediately usable and falsifiable. The contribution is incremental on SCF/LinearVC but practically valuable for data-efficient pipelines.

major comments (2)
  1. [§1, §2.2–2.3 (Eqs. 1–7), Table 1] The claim of a ‘universal’ speech-to-content map (Abstract, §1, §2.2–2.3, Eqs. 1–7) that works for arbitrary unseen speakers is evaluated exclusively on held-out LibriSpeech partitions (and TIMIT for probes). The introduction motivates the method precisely for diverse, crowd-sourced corpora such as CommonVoice and Emilia, yet no experiment tests whether the closed-set SVD subspace or the least-squares W continues to hold under domain shift (accents, spontaneous speech, recording conditions). Objective speaker similarity is already lower than closed-set baselines even in-domain (Table 1: 0.52 vs 0.60–0.66); if the linear structure degrades outside LibriSpeech the competitiveness of zero-shot VC and the utility of USCF features as general TTS targets become domain-limited rather than universal. This is a load-bearing assumption that currently lacks supporting evidence for the stated use-ca
  2. [Abstract, §4.4, Table 6, §5] Abstract and §5 claim that USCF features ‘can serve as the acoustic representation for training timbre-prompted text-to-speech models’ and enable ‘zero-shot style-conditioned TTS systems that are timbre-agnostic.’ The only experiment (§4.4, Table 6) trains a standard flow-matching TTS (ZipVoice-style) on LibriSpeech using USCF versus mel targets and reports WER/UTMOS; there is no speaker/style prompt, no zero-shot conditioning, and no demonstration that the model can be driven by a timbre reference. The result shows that a content-like target improves training efficiency, but does not substantiate the stronger ‘timbre-prompted’ claim as written.
minor comments (4)
  1. [§2.1, §3] Synthesis path from converted WavLM features back to waveform is never stated (vocoder architecture, training data, or whether a frozen HiFi-GAN-style model is used). Although code is released, the manuscript itself should contain this detail for reproducibility of the reported WER/UTMOS/MOS numbers.
  2. [Table 2] Table 2 lists two rows both labelled ‘USCFW 1’; the second is presumably the 100 s enrollment variant. Clarify the label.
  3. [§2.2, Eqs. 3–6] Justification of W3 (Eqs. 3–6) invokes approximate orthogonality of content and timbre subspaces and of different speakers’ timbre subspaces; the argument is heuristic and the resulting Spk Sim is markedly lower (0.42). A short quantitative check of the residual ||Si S†j – I|| on the closed-set speakers would strengthen the derivation.
  4. [passim] Several typographic artefacts appear throughout (‘V oice’, missing spaces after commas in equations, inconsistent subscript formatting of W1/W2/W3). A careful proof-reading pass is needed.

Circularity Check

0 steps flagged

No circularity: USCF maps are ordinary least-squares / pseudoinverse constructions from closed-set SVD; VC/TTS claims are measured by independent external metrics on held-out data.

full rationale

The derivation chain is self-contained linear algebra. Closed-set SCF produces C and speaker matrices Sj via truncated SVD of content-aligned WavLM stacks (Sec. 2.1). Universal W is then obtained by three explicit least-squares problems (Eqs. 1–2) or by taking a pseudoinverse under an orthogonality assumption (W3); Sm for an unseen speaker is the ordinary pseudoinverse estimate (Eq. 7) from a few seconds of that speaker’s frames. None of these targets is defined in terms of the final evaluation quantities (Whisper WER, UTMOS, ECAPA cosine similarity, human MOS/SMOS, or TTS WER). The paper never fits parameters to those metrics and never renames a fitted quantity as a “prediction.” Self-citations (e.g., GenVC) are peripheral; the load-bearing prior result SCF is by a disjoint author set. Empirical claims of content preservation and speaker suppression are therefore falsifiable against external models and held-out partitions, not true by construction. The open-set generalization assumption is an empirical risk, not a circularity.

Axiom & Free-Parameter Ledger

3 free parameters · 3 axioms · 2 invented entities

The method rests on the geometric properties of WavLM already established by prior work, plus a handful of free choices (rank, enrollment length, speaker set size) and three alternative least-squares formulations. No new physical entities are postulated; the only invented objects are the universal map W and the open-set procedure itself.

free parameters (3)
  • content rank r = 75
    Truncation rank of the SVD; set to 75 after ablation (Table 4). Directly controls the dimension of the content representation and therefore all downstream metrics.
  • target enrollment frames = 500
    Number of WavLM frames used to estimate Sm; default 500 (~10 s). Ablated in Table 5; performance drops sharply below this value.
  • number of closed-set speakers for SVD = 40
    40 speakers drawn from held-out LibriSpeech partitions used to form the stacked matrix X and therefore the universal maps W1/W2.
axioms (3)
  • domain assumption WavLM feature frames of the same phoneme form tight, speaker-consistent clusters, so that a low-rank linear content subspace exists.
    Stated in the introduction and used as the geometric justification for both SCF and USCF; taken from prior analyses of WavLM.
  • ad hoc to paper Content and timbre components are approximately linearly separable and their column spaces are nearly orthogonal across speakers (justifying W3 ≈ S_i^†).
    Explicit simplifying assumption in Section 2.2, Eqs. 3–6; not independently verified beyond the empirical success of W3.
  • domain assumption A single least-squares map W learned on a closed set of speakers generalizes to completely unseen speakers.
    Core premise of the open-set extension (Section 2.2); supported by the VC and embedding experiments but not proved.
invented entities (2)
  • universal speech-to-content mapping W (W1/W2/W3) independent evidence
    purpose: Maps any speaker’s WavLM frames into a shared low-rank content space without requiring that speaker to have been present in the original SVD.
    Defined by the three least-squares problems in Section 2.2; the central technical object of the paper.
  • open-set speaker transformation Sm estimated from few seconds of speech independent evidence
    purpose: Reconstructs target-speaker WavLM features from the universal content representation for zero-shot VC.
    Derived in Eq. 7; enables the open-set claim.

pith-pipeline@v1.1.0-grok45 · 14219 in / 2724 out tokens · 23634 ms · 2026-07-15T12:20:26.132116+00:00 · methodology

0 comments
read the original abstract

We propose Universal Speech Content Factorization (USCF), a simple and invertible linear method for extracting a low-rank speech representation in which speaker timbre is suppressed while phonetic content is preserved. USCF extends Speech Content Factorization, a closed-set voice conversion (VC) method, to an open-set setting by learning a universal speech-to-content mapping via least-squares optimization and deriving speaker-specific transformations from only a few seconds of target speech. We show through embedding analysis that USCF effectively removes speaker-dependent variation. As a zero-shot VC system, USCF achieves competitive intelligibility, naturalness, and speaker similarity compared to methods that require substantially more target-speaker data or additional neural training. Finally, we demonstrate that as a training-efficient timbre-disentangled speech feature, USCF features can serve as the acoustic representation for training timbre-prompted text-to-speech models. Speech samples and code are publicly available.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Interpreting Content and Speaker Characteristics in Factorised Self-Supervised Subspaces

    eess.AS 2026-06 unverdicted novelty 4.0

    SVD factorisation of WavLM features reveals content dimensions encoding intensity, formants and voicing while speaker dimensions encode pitch and gender, enabling dimension-level control in speech synthesis.

Reference graph

Works this paper leans on

49 extracted references · 9 linked inside Pith · cited by 1 Pith paper

  1. [1]

    Introduction Recent self-supervised learning (SSL) models for speech, such as WavLM, exhibit pronounced geometric structure in their fea- ture spaces, with empirical analyses demonstrate that phonetic content dominates feature variance, and that frames correspond- ing to the same phoneme forming tight clusters across speak- ers [1, 2]. This finding has si...

    Pith/arXiv arXiv 2026

  2. [2]

    However, SCF is a closed-set method, as both content extrac- tion and reconstruction require speaker-specific transformation matrices obtained during the original factorization

    Universal Speech Content Factorization Speech Content Factorization (SCF) jointly decomposes content-aligned WavLM features from multiple speakers into a shared low-rank representation encoding phonetic content, enabling high-quality VC without additional model training. However, SCF is a closed-set method, as both content extrac- tion and reconstruction ...

  3. [3]

    Selectkspeakers, each with sufficient speech for k-nearest- neighbor (kNN) matching (e.g., at least5minutes)

  4. [4]

    Stack the matricesX 1 throughX k along their feature dimensions to produceXof shape(n, kd)

    For some anchor speakeri∈[1..k]and associated speech WavLM framesX i of shapen(number of speech frames) byd(WavLM feature dimension), find matching WavLM framesX j using nearest neighbors for each speakerj∈ [1..k], j̸=i. Stack the matricesX 1 throughX k along their feature dimensions to produceXof shape(n, kd)

  5. [5]

    We writeC=UΣof shape(n, r)as the content-factorized representation ofX

    Perform rank-r-truncated Singular Value Decomposition (SVD) onX, givingX≈UΣS. We writeC=UΣof shape(n, r)as the content-factorized representation ofX. We further splitSof shape(r, kd)into chunksS 1 through Sk, each of size(r, d), such that∀j∈[1..k],X j ≈CS j. It follows thatX jS† j ≈C, whereS † j is the Moore-Penrose inverse ofS j. We refer toS j as thespe...

  6. [6]

    For speakerss, t∈[1..k]and input speechX ′ s, perform VC by ˆX′t ≈X ′ sS† sSt. 2.2. Approaches for Universal Speech to Content Mapping To extend SCF to unseen speakers, we seek:

  7. [7]

    A matrixW, such that for any speakermand unseen speech X′ m, including those speakersmnot in[1..k],X ′ mW≈C ′

  8. [8]

    Recall the truncated SVD formulationX≈UΣS

    For a small number of WavLM framesX ′ m from an unseen speakerm, derive the speaker transformation matrixS m cor- responding to speakerm. Recall the truncated SVD formulationX≈UΣS. We can solve the least-squares optimization problemW 0 = arg minW Pk j=1 ||XjW−C||, which directly attempts to re- construct the content-factorized representationC=UΣ, to findW...

  9. [9]

    Experimental setup 3.1. Test Data For our VC experiments, we select4non-overlapping sets of 20speakers from LibriSpeech [23]: source speakers (from test- clean), target speakers (from test-other), held-out 1 (from test- clean), and held-out 2 (from dev-clean). For each of the source speakers, we randomly choose20utterances for testing, and5 target speaker...

  10. [10]

    V oice Conversion Quality Objective evaluation results for voice conversion are presented in table 1

    Results 4.1. V oice Conversion Quality Objective evaluation results for voice conversion are presented in table 1. We note that USCF excel at content preservation, and is capable of producing natural-sounding speech. Speaker similarity tests show that while USCF is able to produce speech that is highly similar to the target speaker, the level of simi- lar...

    2000

  11. [11]

    Ground truth phoneme labels for each test frame are inferred using TIMIT’s time-phoneme align- ment

    Phoneme recognition. Ground truth phoneme labels for each test frame are inferred using TIMIT’s time-phoneme align- ment. Classification is performed by taking the argmin cosine distance to each reference phoneme embedding

  12. [12]

    For each phoneme, we find all the frames from TIMIT TEST with the corresponding phoneme label, then perform speaker ID on feature vectors corresponding to these frames

    Speaker recognition per-phoneme. For each phoneme, we find all the frames from TIMIT TEST with the corresponding phoneme label, then perform speaker ID on feature vectors corresponding to these frames. We compare USCF to two SSL-based baselines: WavLM and ContentVec, shown in table 3. We found that USCF is on par with WavLM as a phoneme classifier, and th...

  13. [13]

    We extend an existing closed-set method for linear factorization of WavLM features, SCF, into an open-set method, transforming it into a zero-shot voice conver- sion system

    Conclusion We propose USCF, a method for extracting content-preserving and speaker-agnostic features from WavLM features using a simple linear transformation. We extend an existing closed-set method for linear factorization of WavLM features, SCF, into an open-set method, transforming it into a zero-shot voice conver- sion system. We show through embeddin...

  14. [14]

    Generative AI Disclosure Generative AI was used for the following in this work:

  15. [15]

    Conversion of table formats

  16. [16]

    Limited language polishing of the Introduction section

  17. [17]

    Acknowledgments This work was supported by the Office of the Director of Na- tional Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA), via the ARTS Program under con- tract D2023-2308110001. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official...

  18. [18]

    Leveraging allophony in self-supervised speech models for atyp- ical pronunciation assessment,

    K. Choi, E. Yeo, K. Chang, S. Watanabe, and D. R. Mortensen, “Leveraging allophony in self-supervised speech models for atyp- ical pronunciation assessment,” inProceedings of the 2025 Con- ference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2025, pp. 2613–2628

    2025

  19. [19]

    Self-Supervised Models for Phoneme Recognition: Applications in Children’s Speech for Reading Learning,

    L. Block Medin, T. Pellegrini, and L. Gelin, “Self-Supervised Models for Phoneme Recognition: Applications in Children’s Speech for Reading Learning,” inInterspeech 2024, 2024, pp. 5168–5172

    2024

  20. [20]

    V oice Conversion With Just Nearest Neighbors,

    M. Baas, B. van Niekerk, and H. Kamper, “V oice Conversion With Just Nearest Neighbors,” inInterspeech 2023, pp. 2053–2057

    2023

  21. [21]

    LinearVC: Linear Transformations of Self-Supervised Features Through the Lens of V oice Conversion,

    H. Kamper, B. van Niekerk, J. Za ¨ıdi, and M.-A. Carbonneau, “LinearVC: Linear Transformations of Self-Supervised Features Through the Lens of V oice Conversion,” inInterspeech 2025, 2025, pp. 1398–1402

    2025

  22. [22]

    Common V oice: A Massively-Multilingual Speech Corpus,

    R. Ardila, M. Branson, K. Davis, M. Kohler, J. Meyer, M. Hen- retty, R. Morais, L. Saunders, F. Tyers, and G. Weber, “Common V oice: A Massively-Multilingual Speech Corpus,” inProceedings of the Twelfth Language Resources and Evaluation Conference, 2020, pp. 4218–4222

    2020

  23. [23]

    Emilia: An extensive, multilingual, and diverse speech dataset for large-scale speech generation,

    H. He, Z. Shang, C. Wang, X. Li, Y . Gu, H. Hua, L. Liu, C. Yang, J. Li, P. Shi, Y . Wang, K. Chen, P. Zhang, and Z. Wu, “Emilia: An extensive, multilingual, and diverse speech dataset for large-scale speech generation,” in2024 IEEE Spoken Language Technology Workshop (SLT), 2024, pp. 885–890

    2024

  24. [24]

    Auto-encoding variational bayes,

    D. P. Kingma and M. Welling, “Auto-encoding variational bayes,”

  25. [25]

    Available: https://arxiv.org/abs/1312.6114

    [Online]. Available: https://arxiv.org/abs/1312.6114

    Pith/arXiv arXiv

  26. [26]

    Speaker and style disentanglement of speech based on contrastive predictive coding supported factorized variational au- toencoder

    Y . Xie, M. Kuhlmann, F. Rautenberg, Z.-H. Tan, and R. Haeb- Umbach, “Speaker and style disentanglement of speech based on contrastive predictive coding supported factorized variational au- toencoder.” inEUSIPCO. IEEE, 2024, pp. 436–440

    2024

  27. [27]

    Speechsplit 2.0: Unsupervised speech disentanglement for voice conversion without tuning autoencoder bottlenecks,

    C. H. Chan, K. Qian, Y . Zhang, and M. Hasegawa-Johnson, “Speechsplit 2.0: Unsupervised speech disentanglement for voice conversion without tuning autoencoder bottlenecks,” 2022. [Online]. Available: https://arxiv.org/abs/2203.14156

    Pith/arXiv arXiv 2022

  28. [28]

    Adversar- ially Learning Disentangled Speech Representations for Robust Multi-Factor V oice Conversion,

    J. Wang, J. Li, X. Zhao, Z. Wu, S. Kang, and H. Meng, “Adversar- ially Learning Disentangled Speech Representations for Robust Multi-Factor V oice Conversion,” inInterspeech 2021, 2021, pp. 846–850

    2021

  29. [29]

    ContentVec: An improved self- supervised speech representation by disentangling speakers,

    K. Qian, Y . Zhang, H. Gao, J. Ni, C.-I. Lai, D. Cox, M. Hasegawa- Johnson, and S. Chang, “ContentVec: An improved self- supervised speech representation by disentangling speakers,” in Proceedings of the 39th International Conference on Machine Learning, ser. Proceedings of Machine Learning Research, vol. 162, 2022, pp. 18 003–18 017

    2022

  30. [30]

    Speech Resynthesis from Discrete Disentangled Self-Supervised Representations,

    A. Polyak, Y . Adi, J. Copet, E. Kharitonov, K. Lakhotia, W.-N. Hsu, A. Mohamed, and E. Dupoux, “Speech Resynthesis from Discrete Disentangled Self-Supervised Representations,” inInter- speech 2021, 2021, pp. 3615–3619

    2021

  31. [31]

    Naturalspeech 3: Zero-shot speech synthesis with factorized codec and diffusion models

    Z. Ju, Y . Wang, K. Shen, X. Tan, D. Xin, D. Yang, E. Liu, Y . Leng, K. Song, S. Tang, Z. Wu, T. Qin, X. Li, W. Ye, S. Zhang, J. Bian, L. He, J. Li, and S. Zhao, “Naturalspeech 3: Zero-shot speech synthesis with factorized codec and diffusion models.” inICML, vol. 235, 2024, pp. 22 605–22 623

    2024

  32. [32]

    Automatic Speech Disentangle- ment for V oice Conversion using Rank Module and Speech Aug- mentation,

    Z. Liu, S. Wang, and N. Chen, “Automatic Speech Disentangle- ment for V oice Conversion using Rank Module and Speech Aug- mentation,” inInterspeech 2023, 2023, pp. 2298–2302

    2023

  33. [33]

    Genvc: Self-supervised zero-shot voice conversion,

    Z. Cai, H. L. Xinyuan, A. Garg, L. P. Garc ´ıa-Perera, K. Duh, S. Khudanpur, M. Wiesner, and N. Andrews, “Genvc: Self-supervised zero-shot voice conversion,” 2025. [Online]. Available: https://arxiv.org/abs/2502.04519

    Pith/arXiv arXiv 2025

  34. [34]

    An overview of voice conversion and its challenges: From statistical modeling to deep learning,

    B. Sisman, J. Yamagishi, S. King, and H. Li, “An overview of voice conversion and its challenges: From statistical modeling to deep learning,”IEEE/ACM transactions on audio, speech, and language processing, vol. 29, pp. 132–157, 2020

    2020

  35. [35]

    CCSRD: Content- centric speech representation disentanglement learning for end-to- end speech translation,

    X. Zhao, H. Sun, Y . Lei, S. Zhu, and D. Xiong, “CCSRD: Content- centric speech representation disentanglement learning for end-to- end speech translation,” inFindings of the Association for Com- putational Linguistics: EMNLP 2023, 2023, pp. 5920–5932

    2023

  36. [36]

    Universal semantic disentangled privacy-preserving speech representation learning,

    B. T. Vecino, S. Maji, A. Varier, A. Bonafonte, I. Valles, M. Owen, L. R ¨adel, G. Strimel, S. Feyisetan, R. B. Chicote, A. Rastrow, C. Papayiannis, V . Leutnant, and T. Wood, “Universal semantic disentangled privacy-preserving speech representation learning,”

  37. [37]

    Available: https://arxiv.org/abs/2505.13085

    [Online]. Available: https://arxiv.org/abs/2505.13085

    Pith/arXiv arXiv

  38. [38]

    NPU-NTU System for V oice Privacy 2024 Challenge,

    J. Yao, N. Kuzmin, Q. Wang, P. Guo, Z. Ning, D. Guo, K. A. Lee, E.-S. Chng, and L. Xie, “NPU-NTU System for V oice Privacy 2024 Challenge,” in4th Symposium on Security and Privacy in Speech Communication, 2024, pp. 67–71

    2024

  39. [39]

    Fac-facodec: Controllable zero-shot foreign accent conversion with factorized speech codec,

    Y . Halychanskyi, C. Churchwell, Y . Wen, and V . Kindratenko, “Fac-facodec: Controllable zero-shot foreign accent conversion with factorized speech codec,” 2026. [Online]. Available: https://arxiv.org/abs/2510.10785

    Pith/arXiv arXiv 2026

  40. [40]

    Ac- cent conversion in text-to-speech using multi-level vae and adver- sarial training,

    J. Melechovsky, A. Mehrish, B. Sisman, and D. Herremans, “Ac- cent conversion in text-to-speech using multi-level vae and adver- sarial training,” inTENCON 2024-2024 IEEE Region 10 Confer- ence (TENCON). IEEE, 2024, pp. 473–476

    2024

  41. [41]

    Accented text-to-speech synthesis with a conditional vari- ational autoencoder,

    ——, “Accented text-to-speech synthesis with a conditional vari- ational autoencoder,” inTENCON 2024-2024 IEEE Region 10 Conference (TENCON). IEEE, 2024, pp. 343–346

    2024

  42. [42]

    Lib- rispeech: An asr corpus based on public domain audio books,

    V . Panayotov, G. Chen, D. Povey, and S. Khudanpur, “Lib- rispeech: An asr corpus based on public domain audio books,” in2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015, pp. 5206–5210

    2015

  43. [43]

    Zero-shot voice conversion with diffusion transformers,

    S. Liu, “Zero-shot voice conversion with diffusion transformers,”

  44. [44]

    Available: https://arxiv.org/abs/2411.09943

    [Online]. Available: https://arxiv.org/abs/2411.09943

    Pith/arXiv arXiv

  45. [45]

    Robust speech recognition via large- scale weak supervision,

    A. Radford, J. W. Kim, T. Xu, G. Brockman, C. McLeavey, and I. Sutskever, “Robust speech recognition via large- scale weak supervision,” 2022. [Online]. Available: https: //arxiv.org/abs/2212.04356

    Pith/arXiv arXiv 2022

  46. [46]

    UTMOS: UTokyo-SaruLab System for V oice- MOS Challenge 2022,

    T. Saeki, D. Xin, W. Nakata, T. Koriyama, S. Takamichi, and H. Saruwatari, “UTMOS: UTokyo-SaruLab System for V oice- MOS Challenge 2022,” inInterspeech 2022, 2022, pp. 4521– 4525

    2022

  47. [47]

    ECAPA- TDNN: Emphasized Channel Attention, Propagation and Ag- gregation in TDNN Based Speaker Verification,

    B. Desplanques, J. Thienpondt, and K. Demuynck, “ECAPA- TDNN: Emphasized Channel Attention, Propagation and Ag- gregation in TDNN Based Speaker Verification,” inInterspeech 2020, 2020, pp. 3830–3834

    2020

  48. [48]

    TIMIT : acoustic-phonetic continuous speech corpus

    J. S. Garofolo, N. I. of Standards, T. U.S., U. States, D. A. R. P. Agency., I. Science, T. Office, and L. D. Consortium., “TIMIT : acoustic-phonetic continuous speech corpus.” 1993. [Online]. Available: http://www.worldcat.org/isbn/1585630195

    arXiv 1993

  49. [49]

    Zipvoice: Fast and high-quality zero-shot text-to-speech with flow matching,

    H. Zhu, W. Kang, Z. Yao, L. Guo, F. Kuang, Z. Li, W. Zhuang, L. Lin, and D. Povey, “Zipvoice: Fast and high-quality zero-shot text-to-speech with flow matching,” 2025. [Online]. Available: https://arxiv.org/abs/2506.13053

    Pith/arXiv arXiv 2025