Weakly labeled data augmentation for social media named entity recognition
- Authors
- Kim, Juae; Kim, Yejin; Kang, Sangwoo
- Issue Date
- Dec-2022
- Publisher
- PERGAMON-ELSEVIER SCIENCE LTD
- Keywords
- Named entity recognition; Social-media text mining; Weakly labeled data; Transfer learning
- Citation
- EXPERT SYSTEMS WITH APPLICATIONS, v.209
- Journal Title
- EXPERT SYSTEMS WITH APPLICATIONS
- Volume
- 209
- URI
- https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/85854
- DOI
- 10.1016/j.eswa.2022.118217
- ISSN
- 0957-4174
- Abstract
- Named entity recognition is a task that extracts entities corresponding to predefined categories. Although NER is important in processing user-generated texts such as those obtained from social media, it remains challenging because such texts tend to contain numerous unseen words or abbreviations. To address this issue, we propose two methods for weakly labeled data generation that can extract named entities from social media texts more effectively: alias augmentation and typo augmentation. Using these methods, weakly labeled data are generated through the automatic annotation of unlabeled Wikipedia texts and Tweets and then trained through transfer learning. Our experimental results suggest that the proposed approach improves NER performance, with our best F1-score of 51.43% representing the highest score ever reported.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - IT융합대학 > 소프트웨어학과 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.