Background-Aware Robust Context Learning for Weakly-Supervised Temporal Action Localizationopen access
- Authors
- Kim, Jinah; Cho, Jungchan
- Issue Date
- Jun-2022
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Entropy; Feature extraction; Location awareness; Context modeling; Annotations; Training; Reliability; Temporal action localization; entropy maximization; context learning; feature adaptation
- Citation
- IEEE ACCESS, v.10, pp.65315 - 65325
- Journal Title
- IEEE ACCESS
- Volume
- 10
- Start Page
- 65315
- End Page
- 65325
- URI
- https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/85325
- DOI
- 10.1109/ACCESS.2022.3183789
- ISSN
- 2169-3536
- Abstract
- Weakly supervised temporal action localization (WTAL) aims to localize temporal intervals of actions in an untrimmed video using only video-level action labels. Although the learning of the background is an important issue in WTAL, most previous studies have not utilized an effective background. In this study, we propose a novel method for robustly separating contexts, e.g., action-like background, from the foreground to more accurately localize the action intervals. First, we detect background segments based on their probabilities to minimize the impact of background estimation errors. Second, we define the entropy boundary of the foreground and the positive distance between the boundary and background entropy. The background probability and entropy boundary allow the segment-level classifier to robustly learn the background. Third, we improve the performance of the overall actionness model based on a consensus of the RGB and flow features. The results of extensive experiments demonstrate that the proposed method learns the context separately from the action, consequently achieving new state-of-the-art results on the THUMOS-14 and ActivityNet-1.2 benchmarks. We also confirm that using feature adaptation helps overcome the limitation of a pretrained feature extractor on datasets that contain many backgrounds, such as THUMOS-14.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - IT융합대학 > 소프트웨어학과 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/85325)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.