Vision-Based Activity Classification of Excavators by Bidirectional LSTM
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, In-Sup | - |
dc.contributor.author | Latif, Kamran | - |
dc.contributor.author | Kim, Jeonghwan | - |
dc.contributor.author | Sharafat, Abubakar | - |
dc.contributor.author | Lee, Dong-Eun | - |
dc.contributor.author | Seo, Jongwon | - |
dc.date.accessioned | 2023-02-21T05:30:40Z | - |
dc.date.available | 2023-02-21T05:30:40Z | - |
dc.date.created | 2023-02-08 | - |
dc.date.issued | 2023-01 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/182341 | - |
dc.description.abstract | Advancements in deep learning and vision-based activity recognition development have significantly improved the safety, continuous monitoring, productivity, and cost of the earthwork site. The construction industry has adopted the CNN and RNN models to classify the different activities of construction equipment and automate the construction operations. However, the currently available methods in the industry classify the activities based on the visual information of current frames. To date, the adjacent visual information of current frames has not been simultaneously examined to recognize the activity in the construction industry. This paper proposes a novel methodology to classify the activities of the excavator by processing the visual information of video frames adjacent to the current frame. This paper follows the CNN-BiLSTM standard deep learning pipeline for excavator activity recognition. First, the pre-trained CNN model extracted the sequential pattern of visual features from the video frames. Then BiLSTM classified the different activities of the excavator by analyzing the output of the pre-trained convolutional neural network. The forward and backward LSTM layers stacked on help the algorithm compute the output by considering previous and upcoming frames' visual information. Experimental results have shown the average precision and recall to be 87.5% and 88.52%, respectively. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | MDPI | - |
dc.title | Vision-Based Activity Classification of Excavators by Bidirectional LSTM | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Seo, Jongwon | - |
dc.identifier.doi | 10.3390/app13010272 | - |
dc.identifier.scopusid | 2-s2.0-85145850254 | - |
dc.identifier.wosid | 000909096400001 | - |
dc.identifier.bibliographicCitation | APPLIED SCIENCES-BASEL, v.13, no.1, pp.1 - 19 | - |
dc.relation.isPartOf | APPLIED SCIENCES-BASEL | - |
dc.citation.title | APPLIED SCIENCES-BASEL | - |
dc.citation.volume | 13 | - |
dc.citation.number | 1 | - |
dc.citation.startPage | 1 | - |
dc.citation.endPage | 19 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | Y | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Chemistry | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Materials Science | - |
dc.relation.journalResearchArea | Physics | - |
dc.relation.journalWebOfScienceCategory | Chemistry, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Engineering, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Materials Science, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Physics, Applied | - |
dc.subject.keywordPlus | CONVOLUTIONAL NEURAL-NETWORK | - |
dc.subject.keywordPlus | ACTION RECOGNITION | - |
dc.subject.keywordPlus | EARTHMOVING EXCAVATORS | - |
dc.subject.keywordPlus | CONSTRUCTION WORKERS | - |
dc.subject.keywordPlus | EQUIPMENT | - |
dc.subject.keywordPlus | MODEL | - |
dc.subject.keywordPlus | WORKFORCE | - |
dc.subject.keywordPlus | FEATURES | - |
dc.subject.keywordPlus | TIME | - |
dc.subject.keywordAuthor | computer vision | - |
dc.subject.keywordAuthor | activity recognition | - |
dc.subject.keywordAuthor | convolution neural network (CNN) | - |
dc.subject.keywordAuthor | long short-term memory (LSTM) | - |
dc.subject.keywordAuthor | Googlenet | - |
dc.subject.keywordAuthor | visual features | - |
dc.identifier.url | https://www.mdpi.com/2076-3417/13/1/272 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.