Advanced First-order Optimization Algorithm with Sophisticated Search Control for Convolutional Neural Networks
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Kyung Soo | - |
dc.contributor.author | Choi, Yong Suk | - |
dc.date.accessioned | 2023-09-26T09:44:02Z | - |
dc.date.available | 2023-09-26T09:44:02Z | - |
dc.date.created | 2023-08-17 | - |
dc.date.issued | 2023-07 | - |
dc.identifier.issn | 2169-3536 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/191263 | - |
dc.description.abstract | As the performance of computing devices such as graphics processing units (GPUs) has improved dramatically, many deep neural network models, especially convolutional neural networks (CNNs), have been widely applied to various applications such as image classification, semantic segmentation, and object recognition. However, effective first-order optimization methods for CNNs have rarely been studied, although many CNN models have been successfully developed. Accordingly, this paper investigates various advanced adaptive solution search methods and proposes a new first-order optimization algorithm for CNNs called Adam-ASC. Our approach uses four sophisticated adaptive solution search methods to adjust its search strength in the complicated large-dimensional weight solution space spanned by a loss function. At the same time, we explain how they can be combined compensatively to form a complete optimizer with a detailed implementation. From the experiments, we found that our Adam-ASC can significantly improve the image recognition performance of practical CNNs in both the image classification and segmentation tasks. These experimental results show that the four fundamental methods of Adam-ASC and their compensative combination strategy play a crucial role in training CNNs by effectively finding their optimal weights. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | - |
dc.title | Advanced First-order Optimization Algorithm with Sophisticated Search Control for Convolutional Neural Networks | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Choi, Yong Suk | - |
dc.identifier.doi | 10.1109/ACCESS.2023.3300034 | - |
dc.identifier.scopusid | 2-s2.0-85166768851 | - |
dc.identifier.wosid | 001045247400001 | - |
dc.identifier.bibliographicCitation | IEEE ACCESS, v.11, pp.80656 - 80679 | - |
dc.relation.isPartOf | IEEE ACCESS | - |
dc.citation.title | IEEE ACCESS | - |
dc.citation.volume | 11 | - |
dc.citation.startPage | 80656 | - |
dc.citation.endPage | 80679 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | Y | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordPlus | MODEL | - |
dc.subject.keywordAuthor | Machine learning | - |
dc.subject.keywordAuthor | deep learning | - |
dc.subject.keywordAuthor | convolutional neural networks | - |
dc.subject.keywordAuthor | optimization methods | - |
dc.subject.keywordAuthor | gradient methods | - |
dc.subject.keywordAuthor | image classification | - |
dc.subject.keywordAuthor | image segmentation | - |
dc.identifier.url | https://ieeexplore.ieee.org/document/10197412 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.