A document similarity measurement technique based on Smith-Waterman algorithm

Abstract

Measurement of document similarity of text-based is utilized data cleaning and detection of plagiarism, collaborative filtering in various fields. Also, for this research has been actively. In particular, research needs to be to handle large document such as big data to reduce the increasing complexity of time is growing. Accuracy of the candidate data with similarities are also important. Therefore, in this paper, we propose a method that can increase accuracy and simplify the process of calculation of measurement algorithms similarity existing. © 2015 International Information Institute.