Global Convolutional Neural Networks with Self-Attention for Fisheye Image Rectificationopen access
- Authors
- Kim, Byunghyun; Lee, Dohyun; Min, Kyeongyuk; Chong, Jongwha; Joe, Inwhee
- Issue Date
- Dec-2022
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Fisheye image rectification; dilated convolution; self-attention; deep learning
- Citation
- IEEE ACCESS, v.10, pp.129580 - 129587
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE ACCESS
- Volume
- 10
- Start Page
- 129580
- End Page
- 129587
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/182220
- DOI
- 10.1109/ACCESS.2022.3228297
- ISSN
- 2169-3536
- Abstract
- Fisheye images are attracting attention in computer vision such as autonomous vehicles and virtual reality because of the wide field of view (WFoV). However, fisheye images have geometric distortions caused by the refractive index of the lens. Conventional fisheye rectification methods require multiple images to calculate distortion coefficients and lens intrinsic parameters. This means that if the fisheye lens is changed, the same operation will have to be repeated. On the other hand, by using deep learning, images with different distortion coefficients can be rectified. Also, with end-to-end learning, no feature engineering is required. To improve the performance of fisheye image rectification, we propose global convolutional neural networks with self-attention to rectify the fisheye images. The proposed method employs dilated convolutional neural networks (D-CNNs) to enlarge receptive fields, and self-attention to extract the most important features of input images. In this way, the proposed method can extract global features from input images. To better train and evaluate the proposed method, we generate fisheye images from the Place2 dataset with Cartesian and polar coordinates, and label them with original images (ground-truth). we also schedule the learning rate with cosine annealing and use an integrated loss function. The experimental results show that the proposed method achieves an excellent performance in both qualitative and quantitative evaluations.
- Files in This Item
-
- Appears in
Collections - 서울 공과대학 > 서울 컴퓨터소프트웨어학부 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.