Pith. sign in

REVIEW 1 cited by

Zero-Shot Sing Voice Conversion: built upon clustering-based phoneme representations

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2409.08039 v2 pith:OXPQH6VY submitted 2024-09-12 cs.SD eess.AS

classification cs.SDeess.AS
keywords voiceconversionsingingtimbrezero-shotclustering-basedphonemerepresentation
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This study presents an innovative Zero-Shot any-to-any Singing Voice Conversion (SVC) method, leveraging a novel clustering-based phoneme representation to effectively separate content, timbre, and singing style. This approach enables precise voice characteristic manipulation. We discovered that datasets with fewer recordings per artist are more susceptible to timbre leakage. Extensive testing on over 10,000 hours of singing and user feedback revealed our model significantly improves sound quality and timbre accuracy, aligning with our objectives and advancing voice conversion technology. Furthermore, this research advances zero-shot SVC and sets the stage for future work on discrete speech representation, emphasizing the preservation of rhyme.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Private kNN-VC: Interpretable Anonymization of Converted Speech

    eess.AS 2025-05 conditional novelty 6.0 of 10

    Phone duration prediction and per-phone k-means quantization raise kNN-VC's privacy EER from 10% to nearly 50%, but target-selection changes can erase most of that gain.

Pith tools