Adversarial and Sequential Training for Cross-lingual Prosody Transfer TTS
- Authors
- Kim, Min-Kyung; Chang, Joon-Hyuk
- Issue Date
- Sep-2022
- Publisher
- International Speech Communication Association
- Keywords
- adversarial training; continual learning; cross-lingual; prosody; text-to-speech
- Citation
- Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, v.2022-September, pp.4556 - 4560
- Indexed
- SCOPUS
- Journal Title
- Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
- Volume
- 2022-September
- Start Page
- 4556
- End Page
- 4560
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/173088
- DOI
- 10.21437/Interspeech.2022-865
- ISSN
- 2308-457X
- Abstract
- This study presents a method for improving the performance of the text-to-speech (TTS) model by using three global speech-style representations: language, speaker, and prosody. Synthesizing different languages and prosody in the speaker's voice regardless of their own language and prosody is possible. To construct the embedding of each representation conditioned in the TTS model such that it is independent of the other representations, we propose an adversarial training method for the general architecture of TTS models. Furthermore, we introduce a sequential training method that includes rehearsal-based continual learning to train complex and small amounts of data without forgetting previously learned information. The experimental results show that the proposed method can generate good-quality speech and yield high similarity for speakers and prosody, even for representations that the speaker in the dataset does not contain.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/173088)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.