Ensemble Machine Learning Models for Simulating the Missile Defense System

Abstract

This paper simulated the missile engagement situation using a simulator and conducted a machine learning study based on the generated data. The simulator simulates missile engagements between the enemy and our forces and collects data. The collected data is learned using random forest, XGBoost, and LGBM models after preprocessing. In addition, hyperparameter adjustments were performed for each model to find the optimal parameters. Different metrics for accuracy, F1-score, and ROC-AUC were used for performance comparison. As a result of the experiment, XGBoost showed the best performance in performance indicators, and LGBM was the fastest in terms of learning speed. This paper suggests that XGBoost, which is slow in learning speed but has the best accuracy and performance indicators, is suitable for one-to-one interception situations, and LGBM, which is fast in learning and has excellent performance indicators, is suitable for many-to-many interception situations.