Reinforcement learning-based simulation and automation for tower crane 3D lift planning

Abstract

Tower crane lift planning is important to timely provide resources to workplaces. However, previous planning approaches are still impractical because the lifting time of a plan is barely considered and the lifting path is frequently non-executable by operators. This paper describes a reinforcement learning-based method that incorporates the actuator system of a tower crane into spatio-temporal lift planning in three-dimensional virtual environments wherein various strategies of algorithm types and learning rules are tested. The results show stable and practical lift planning with a failure ratio of 3%, coordination ratio of 28%, and positive evaluation of lifting procedures by expert operators. In addition, the estimated lifting time shows a correlation of 0.6857 with the actual time from field observation. Thus, the proposed approach is promising for planning feasible lifting paths and estimating reasonable lifting times, which help generate and review lifting plans given the site conditions.