Effective Transfer Learning with Label-Based Discriminative Feature Learning
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Gyunyeop | - |
dc.contributor.author | Kang, Sangwoo | - |
dc.date.accessioned | 2022-04-11T05:40:05Z | - |
dc.date.available | 2022-04-11T05:40:05Z | - |
dc.date.created | 2022-04-06 | - |
dc.date.issued | 2022-03 | - |
dc.identifier.issn | 1424-8220 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/83918 | - |
dc.description.abstract | The performance of natural language processing with a transfer learning methodology has improved by applying pre-training language models to downstream tasks with a large number of general data. However, because the data used in pre-training are irrelevant to the downstream tasks, a problem occurs in that it learns general features rather than those features specific to the downstream tasks. In this paper, a novel learning method is proposed for embedding pre-trained models to learn specific features of such tasks. The proposed method learns the label features of downstream tasks through contrast learning using label embedding and sampled data pairs. To demonstrate the performance of the proposed method, we conducted experiments on sentence classification datasets and evaluated whether the features of the downstream tasks have been learned through a PCA and a clustering of the embeddings. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | MDPI | - |
dc.relation.isPartOf | SENSORS | - |
dc.title | Effective Transfer Learning with Label-Based Discriminative Feature Learning | - |
dc.type | Article | - |
dc.type.rims | ART | - |
dc.description.journalClass | 1 | - |
dc.identifier.wosid | 000771166600001 | - |
dc.identifier.doi | 10.3390/s22052025 | - |
dc.identifier.bibliographicCitation | SENSORS, v.22, no.5 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.scopusid | 2-s2.0-85125889187 | - |
dc.citation.title | SENSORS | - |
dc.citation.volume | 22 | - |
dc.citation.number | 5 | - |
dc.contributor.affiliatedAuthor | Kim, Gyunyeop | - |
dc.contributor.affiliatedAuthor | Kang, Sangwoo | - |
dc.type.docType | Article | - |
dc.subject.keywordAuthor | natural language processing | - |
dc.subject.keywordAuthor | transfer learning | - |
dc.subject.keywordAuthor | pre-training | - |
dc.subject.keywordAuthor | word embedding | - |
dc.relation.journalResearchArea | Chemistry | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Instruments & Instrumentation | - |
dc.relation.journalWebOfScienceCategory | Chemistry, Analytical | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Instruments & Instrumentation | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
1342, Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Republic of Korea(13120)031-750-5114
COPYRIGHT 2020 Gachon University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.