조감도에서의 객체 움직임 및 환경 변화를 반영한 시공간 특징 결합 기반의 라이다 비디오 3차원 객체 검출LiDAR Video 3D Object Detection based on Spatio-temporal aggregation using Object’s movement and Environment change in a Bird’s eye view
- Other Titles
- LiDAR Video 3D Object Detection based on Spatio-temporal aggregation using Object’s movement and Environment change in a Bird’s eye view
- Authors
- 이준형; 고준호; 최준원
- Issue Date
- Jun-2022
- Publisher
- 한국자동차공학회
- Keywords
- Autonomous driving(자율주행); Deep learning(딥러닝); LiDAR point cloud(라이다 포인트 클라우드); 3D object detection(3차원 객체 검출); Video object detection(비디오 객체 검출); Spatio-temporal feature map(시공간 특징 지도)
- Citation
- 2922 한국자동차공학회 춘계학술대회, pp.1077 - 1081
- Indexed
- OTHER
- Journal Title
- 2922 한국자동차공학회 춘계학술대회
- Start Page
- 1077
- End Page
- 1081
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/188483
- ISSN
- 2713-7163
- Abstract
- This paper proposes an online 3D video object detection model based on deep learning using a sequential LiDAR point set. By utilizing sequential data as input, our proposed method aims to generate Spatio-temporal information and overcome the inherent limitations of point cloud data, such as sparsity and irregular acquisition due to distance and occlusion. The proposed method, called ST-FF, performs Spatio-temporal feature fusion between a bird"s eye view (BEV) feature maps obtained from each LiDAR point set. ST-FF first captures the movement of objects and changes in the surrounding environment over time. Based on the captured motion information, information suitable for the current feature map is selectively extracted from the past feature map. Then the final feature map is obtained by aggregating the feature map at the target frame and the extracted feature maps from the past frame. Finally, the detection head generates 3D bounding boxes for the target frame using the final feature map. Experiments were conducted on the nuScenes dataset to validate the contributions of the proposed method. Higher performance was obtained in LiDAR-based video object detection with ST-FF than 3D object detectors based on a single point set. In addition, by applying the proposed method to the 3D object detectors based on a single point set, we demonstrate that our methods are applicable to the existing LiDAR-based detectors.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 전기공학전공 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/188483)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.