TwiSNER: Semi-supervised Method for Named Entity Recognition from Text Streams on Twitter
- Authors
- Van Cuong Tran; Hwang, Dosam; Jung, Jason J.
- Issue Date
- 2016
- Publisher
- GRAZ UNIV TECHNOLGOY, INST INFORMATION SYSTEMS COMPUTER MEDIA-IICM
- Keywords
- Named Entity Recognition; SNS Analysis; Semi-supervised Learning
- Citation
- JOURNAL OF UNIVERSAL COMPUTER SCIENCE, v.22, no.6, pp 782 - 801
- Pages
- 20
- Journal Title
- JOURNAL OF UNIVERSAL COMPUTER SCIENCE
- Volume
- 22
- Number
- 6
- Start Page
- 782
- End Page
- 801
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/8740
- DOI
- 10.3217/jucs-022-06-0782
- ISSN
- 0948-695X
0948-6968
- Abstract
- The data on Social Network Services (SNSs) has recently become an interesting source for researchers conducting different Natural Language Processing (NLP) experiments, such as sentiment analysis, information extraction, Named Entity Recognition (NER), and so on. The characteristics of SNS data are usually described as short, noisy, with insufficient supplemental information. They often contain grammatical errors, misspellings, and unreliable capitalization. Thus, standard NLP tools (e.g., NER systems) have difficulty obtaining good results when they are applied on these data, even if they perform well on well-formatted texts. Most of the traditional NER methods are based on supervised learning techniques that often require a large amount of standard training data to train a classifier. In this paper, we propose a method called TwiSNER to classify named entities in Twitter data (called tweets) by using a semi-supervised learning approach combined with the conditional random field model, hand-made rules, and the co-occurrence coefficient of the featured words surrounding entities. In the experiments, TwiSNER is applied on a dataset collected from Twitter, which includes 11,425 tweets for training with 4,716 labeled tweets and 1,450 tweets for testing. TwiSNER produces promising results, where the best F-measure is better than the baselines.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Software > School of Computer Science and Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.