NAS-TasNet: Neural Architecture Search for Time-Domain Speech Separationopen access
- Authors
- Lee, Joo-Hyun; Chang, Joon-Hyuk; Yang, Jae-Mo; Moon, Han-Gil
- Issue Date
- May-2022
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Computational modeling; Computer architecture; Convolution; Deep learning; Training; Time-domain analysis; Task analysis; Automated machine learning (AutoML); convolutional neural network (CNN); deep learning; end-to-end; speech processing; speech separation; neural architecture search; time-domain speech separation
- Citation
- IEEE ACCESS, v.10, pp.56031 - 56043
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE ACCESS
- Volume
- 10
- Start Page
- 56031
- End Page
- 56043
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/138376
- DOI
- 10.1109/ACCESS.2022.3176003
- ISSN
- 2169-3536
- Abstract
- The fully convolutional time-domain speech separation network (Conv-TasNet) has been used as a backbone model in various studies because of its structural excellence. To maximize the performance and efficiency of Conv-TasNet, we attempt to apply a neural architecture search (NAS). NAS is a branch of automated machine learning that automatically searches for an optimal model structure while minimizing human intervention. In this study, we introduce a candidate operation to define the search space of NAS for Conv-TasNet. In addition, we introduce a low computational cost NAS to overcome the limitations of the backbone model that consumes large GPU memory for training. Next, we determine the optimized separation module structures using two search strategies based on gradient descent and reinforcement learning. In addition, when NAS is simply applied, there is an imbalance in the updating of architecture parameters, which are NAS parameters. Therefore, we introduce an auxiliary loss method that is appropriate for the Conv-TasNet architecture for a balanced architecture parameter update of the entire model. Furthermore, we determine that the auxiliary loss technique mitigates the imbalance of architecture parameter updates and improves the separation accuracy.
- Files in This Item
-
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.