Logistics box recognition in robotic industrial de-palletising procedure with systematic RGB-D image processing supported by multiple deep learning methods
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Yoon, Jonghun | - |
dc.contributor.author | Han, Jooyeop | - |
dc.contributor.author | Nguyen, Thong Phi | - |
dc.date.accessioned | 2023-07-05T05:43:19Z | - |
dc.date.available | 2023-07-05T05:43:19Z | - |
dc.date.issued | 2023-08 | - |
dc.identifier.issn | 0952-1976 | - |
dc.identifier.issn | 1873-6769 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/113246 | - |
dc.description.abstract | In an automated box de-palletisation system that utilises robots, vision-based box recognition on the pallet plays the main role in providing picking guidelines. The complexity of the working condition and the target object, particularly the cluttered arrangement and various outer surfaces of the boxes, significantly affect the quality of the outcome. Typically, a large-scale vision dataset is required to train a deep learning object-detection model. However, considerable effort and time is required to achieve this. Therefore, this study proposes a Mask R-CNN-based detection approach for box objects, which is supported by a cycle generative adversarial network (Cycle GAN). The purpose of the Cycle-GAN is to optimise the outer surfaces of boxes by automatically erasing tags, stickers, labels, and symbols that exist on the boxes before loading them to the Mask R-CNN for detection. Subsequently, the obtained result was combined with the output from the developed boundary-enhancing technique that was applied to a depth map. Consequently, the box detection performance was significantly improved, and it was confirmed through experiments with a practical robot system in picking tasks. In the experiments, the success rate of the proposed method was validated using 200 cases of orderly and disorderly arrangements of boxes, respectively. Furthermore, the metric of the mean absolute error between the predicted picking point and the ground truth values for the test cases in the implementation process for the robot operation was also researched. | - |
dc.format.extent | 11 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Pergamon Press Ltd. | - |
dc.title | Logistics box recognition in robotic industrial de-palletising procedure with systematic RGB-D image processing supported by multiple deep learning methods | - |
dc.type | Article | - |
dc.publisher.location | 영국 | - |
dc.identifier.doi | 10.1016/j.engappai.2023.106311 | - |
dc.identifier.scopusid | 2-s2.0-85153096861 | - |
dc.identifier.wosid | 000985365200001 | - |
dc.identifier.bibliographicCitation | Engineering Applications of Artificial Intelligence, v.123, pp 1 - 11 | - |
dc.citation.title | Engineering Applications of Artificial Intelligence | - |
dc.citation.volume | 123 | - |
dc.citation.startPage | 1 | - |
dc.citation.endPage | 11 | - |
dc.type.docType | Article | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Automation & Control Systems | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Automation & Control Systems | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Engineering, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.subject.keywordAuthor | Cycle-GAN | - |
dc.subject.keywordAuthor | Mask R-CNN | - |
dc.subject.keywordAuthor | Robotic de-palletising | - |
dc.subject.keywordAuthor | Computer vision | - |
dc.subject.keywordAuthor | Box surface segmentation | - |
dc.subject.keywordAuthor | RGB-D image | - |
dc.identifier.url | https://www.sciencedirect.com/science/article/pii/S0952197623004955 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
55 Hanyangdeahak-ro, Sangnok-gu, Ansan, Gyeonggi-do, 15588, Korea+82-31-400-4269 sweetbrain@hanyang.ac.kr
COPYRIGHT © 2021 HANYANG UNIVERSITY. ALL RIGHTS RESERVED.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.