Developing and Evaluating a Classification Model for Construction Defect Control: A Text Mining and Ensemble Learning Approach

Abstract

In the construction industry, customer satisfaction is of paramount importance, as it significantly impacts company success and reputation. In Korea’s competitive apartment market, customer satisfaction—particularly feedback on newly built apartments—is vital for construction companies, as it fosters growth and customer loyalty. To gain an understanding of the sentiments and patterns within this feedback, text mining can be utilized. This study aims to extract such insights from textual data on apartment building defect complaints, using text mining and ensemble learning to develop models with high prediction accuracy. It analyzes the accuracy of the Word2Vec and term frequency–inverse document frequency (TF-IDF) models, as well as the individual performance of different classification models, including naïve Bayes, decision trees, logistic regression, k-nearest neighbors, support vector machines (SVMs), and random forests. This analysis was conducted to validate the effectiveness of ensemble learning. Data were collected from a total of 230 apartment building projects in South Korea between 2018 and 2023, resulting in a data set of 101,387 data points, which underwent analysis to validate the model. The validation results consistently showed that TF-IDF outperforms Word2Vec, with the SVM model achieving the highest performance, attaining an average F1 score of 0.7439. Ensemble learning models demonstrated an improvement in accuracy of up to 34% over single models, reaching an average accuracy of 97.47% after the removal of human error. While this study acknowledges its limitations, which include potential biases in the data set, the impact of language evolution on model precision, and difficulties in classifying complex defects, the ensemble model demonstrated substantial improvements in defect classification accuracy and provided practical insights for defect management in construction. Moving forward, future work could explore integrating multidimensional data, utilizing speech-to-text technology, prioritizing defects by severity, and employing artificial intelligence for real-time defect prediction to further enhance defect management practices.