Triplanar convolution with shared 2D kernels for 3D classification and shape retrieval
- Authors
- Kim, Eu Young; Shin, Seung Yeon; Lee, Soochahn; Lee, Kyong Joon; Lee, Kyoung Ho; Lee, Kyoung Mu
- Issue Date
- Apr-2020
- Publisher
- Academic Press
- Keywords
- 3D vision; Medical image; Deep learning; Computer vision
- Citation
- Computer Vision and Image Understanding, v.193
- Journal Title
- Computer Vision and Image Understanding
- Volume
- 193
- URI
- https://scholarworks.bwise.kr/sch/handle/2021.sw.sch/19555
- DOI
- 10.1016/j.cviu.2019.102901
- ISSN
- 1077-3142
1090-235X
- Abstract
- Increasing the depth of Convolutional Neural Networks (CNNs) has been recognized to provide better generalization performance. However, in the case of 3D CNNs, stacking layers increases the number of learnable parameters linearly, making it more prone to learn redundant features. In this paper, we propose a novel 3D CNN structure that learns shared 2D triplanar features viewed from the three orthogonal planes, which we term S3PNet. Due to the reduced dimension of the convolutions, the proposed S3PNet is able to learn 3D representations with substantially fewer learnable parameters. Experimental evaluations show that the combination of 2D representations on the different orthogonal views learned through the S3PNet is sufficient and effective for 3D representation, with the results outperforming current methods based on fully 3D CNNs. We support this with extensive evaluations on widely used 3D data sources in computer vision: CAD models, LiDAR point clouds, RGB-D images, and 3D Computed Tomography scans. Experiments further demonstrate that S3PNet has better generalization capability for smaller training sets, and learns more of kernels with less redundancy compared to kernels learned from 3D CNNs.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > Department of Electronic Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.