Audio-to-Facial Landmarks Generator for Talking Face Video Synthesis
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Jeong, D. | - |
dc.contributor.author | Lee, I. | - |
dc.contributor.author | Paik, Joon Ki | - |
dc.date.accessioned | 2023-09-15T02:49:13Z | - |
dc.date.available | 2023-09-15T02:49:13Z | - |
dc.date.issued | 2023 | - |
dc.identifier.issn | 0000-0000 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/67635 | - |
dc.description.abstract | Audio driven talking face methods have been studied to process the accuracy lip synchronization. However, how to create movement of head poses and personalized facial features is a challenging problem. In order to solve this problem, it is necessary to identify the context based on the audio, create the head pose and lip motion, and synthesize the personalized face. We introduce a facial landmark generation method including audio-based head pose and lip motion using an audio transformer. The audio transformer extracts audio features containing contextual information and creates generalized head pose and lip motion landmarks. In order to synthesize personalized features on the generated landmarks, a talking face video is generated by applying the method learned through meta-learning. With just a few single images, even unknown faces can be spoken in the audio you want. In addition, the proposed method is applicable to various languages, and enables photo-realistic synthesis and fast inference. © 2023 IEEE. | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | - |
dc.title | Audio-to-Facial Landmarks Generator for Talking Face Video Synthesis | - |
dc.type | Article | - |
dc.identifier.doi | 10.1109/ICEIC57457.2023.10049847 | - |
dc.identifier.bibliographicCitation | 2023 International Conference on Electronics, Information, and Communication, ICEIC 2023 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.scopusid | 2-s2.0-85150424740 | - |
dc.citation.title | 2023 International Conference on Electronics, Information, and Communication, ICEIC 2023 | - |
dc.type.docType | Conference Paper | - |
dc.subject.keywordAuthor | Talking Head Generation | - |
dc.subject.keywordAuthor | Video Generation | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.