Video object detection using object's motion context and spatio-temporal feature aggregation
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Jaekyum | - |
dc.contributor.author | Koh, Junho | - |
dc.contributor.author | Lee, Byeongwon | - |
dc.contributor.author | Yang, Seungji | - |
dc.contributor.author | Choi, Jun Won | - |
dc.date.accessioned | 2022-07-07T01:20:08Z | - |
dc.date.available | 2022-07-07T01:20:08Z | - |
dc.date.created | 2021-11-22 | - |
dc.date.issued | 2021-01 | - |
dc.identifier.issn | 1051-4651 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/142432 | - |
dc.description.abstract | The deep learning technique has recently led to significant improvement in object detection accuracy. In many applications, object detection is performed on video data consisting of a sequence of two-dimensional (2D) image frames. Numerous object detection schemes have been designed to detect objects independently in each video frame. Though temporal information within adjacent image frames can be exploited in subsequent object tracking stage, it has been shown that the object detection accuracy can be significantly improved by exploiting the temporal structure in the image sequence in the object detection stage. In this paper, we propose a novel video object detection method that exploits both the motion context inferred from the adjacent frames and the spatio-temporal features aggregated over the image sequence. First, correlation between the spatial feature maps over two adjacent frames are computed and the embedding vector, representing the motion context, is obtained by encoding the N correlation maps using long short term memory (LSTM). In addition to utilizing the motion context, the spatial feature maps for (N + 1) consecutive frames are aggregated to boost the quality of the feature map. The gated attention network is employed to selectively combine the temporal feature maps based on their relevance to the feature map in the present image frame. While most video object detectors have been developed for two-stage object detectors, our proposed idea applies to one-stage detectors with the advantage of low computational complexity in practical real-time applications. Our numerical evaluation conducted on the ImageNet object detection from video (VID) dataset demonstrates that our proposed network achieves significant performance gain over the baseline algorithms and outperforms the existing one-stage video object detectors. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | - |
dc.title | Video object detection using object's motion context and spatio-temporal feature aggregation | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Choi, Jun Won | - |
dc.identifier.doi | 10.1109/ICPR48806.2021.9412715 | - |
dc.identifier.scopusid | 2-s2.0-85110473631 | - |
dc.identifier.bibliographicCitation | Proceedings - International Conference on Pattern Recognition, pp.1604 - 1610 | - |
dc.relation.isPartOf | Proceedings - International Conference on Pattern Recognition | - |
dc.citation.title | Proceedings - International Conference on Pattern Recognition | - |
dc.citation.startPage | 1604 | - |
dc.citation.endPage | 1610 | - |
dc.type.rims | ART | - |
dc.type.docType | Conference Paper | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scopus | - |
dc.subject.keywordPlus | Deep learning | - |
dc.subject.keywordPlus | Feature extraction | - |
dc.subject.keywordPlus | Image enhancement | - |
dc.subject.keywordPlus | Long short-term memory | - |
dc.subject.keywordPlus | Motion compensation | - |
dc.subject.keywordPlus | Object recognition | - |
dc.subject.keywordPlus | Object tracking | - |
dc.subject.keywordPlus | Learning techniques | - |
dc.subject.keywordPlus | Low computational complexity | - |
dc.subject.keywordPlus | Real-time application | - |
dc.subject.keywordPlus | Spatio temporal features | - |
dc.subject.keywordPlus | Temporal information | - |
dc.subject.keywordPlus | Temporal structures | - |
dc.subject.keywordPlus | Two dimensional (2D) image | - |
dc.subject.keywordPlus | Video object detections | - |
dc.subject.keywordPlus | Object detection | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.