DAFA: Diversity-Aware Feature Aggregation for Attention-Based Video Object Detectionopen access
- Authors
- Roh, Si-Dong; Chung, Ki-Seok
- Issue Date
- Sep-2022
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Feature extraction; Memory management; Object detection; Video recording; Termination of employment; Neural networks; Micromechanical devices; Attention mechanism; diversity-aware; neural networks; spatio-temporal; video object detection
- Citation
- IEEE ACCESS, v.10, pp 93453 - 93463
- Pages
- 11
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE ACCESS
- Volume
- 10
- Start Page
- 93453
- End Page
- 93463
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/193867
- DOI
- 10.1109/ACCESS.2022.3203399
- ISSN
- 2169-3536
- Abstract
- We present a framework for attention-based video object detection using a simple yet effective external memory management algorithm. An attention mechanism has been adopted in video object detection task to enrich the features of key frames using adjacent frames. Although several recent studies utilized frame-level first-in-first-out (FIFO) memory to collect global video information, such a memory structure suffers from collection inefficiency, which results in low attention performance and high computational cost. To address this issue, we developed a novel scheme called diversity-aware feature aggregation (DAFA). Whereas other methods do not store sufficient feature information without expanding memory capacity, DAFA efficiently collects diverse features while avoiding redundancy using a simple Euclidean distance-based metric. Experimental results on the ImageNet VID dataset demonstrate that our lightweight model with global attention achieves 83.5 mAP on the ResNet-101 backbone, which exceeds the accuracy levels of most existing methods with a minimum runtime. Our method with global and local attention stages obtains 84.5 and 85.9 mAP on ResNet-101 and ResNeXt-101, respectively, thus achieving state-of-the-art performance without requiring additional post-processing methods.
- Files in This Item
-
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/193867)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.