Skip to main content
SpringerLink
Log in

RadialNet: a point cloud classification approach using local structure representation with radial basis function

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

The major challenge of 3D point cloud classification using a deep neural network is to handle the naturally unordered data structure. Recently, the PointNet has achieved promising results by directly learning on point sets. However, it does not take full advantage of its local neighborhood that contains fine-grained structural information, which turns out to be helpful toward better semantic learning. To tackle this challenge, this paper proposes a new deep neural network architecture, called RadialNet, which applies radial basis function to exploit local structure representation point cloud data and then further incorporates into the conventional neural network classification framework. More specifically, the proposed architecture exploits a novel type of representation that uses evenly spaced centroids, which uses radial basis function to get weight for each input point to have order invariant and retain the global information of the point cloud. By the effective exploration of the point cloud local structure using the RadialNet, the proposed architecture achieves competitive performance on the 3D object classification benchmark ModelNet dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Nguyen, A., Le, B.: 3D point cloud segmentation: a survey. In: IEEE International Conference on Robotics, Automation and Mechatronics, Manila, Philippines, pp. 225–230 (2013)

  2. Grilli, E., Menna, F., Remondino, F.: A review of point clouds segmentation and classification algorithms. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, pp. 339–344 (2017)

  3. Bronstein, M.M., Bruna, J., LeCun, Y., Szlam, A., Vandergheynst, P.: Geometric deep learning: Going beyond euclidean data. IEEE Signal Process. Mag. 34(4), 18–42 (2017)

    Article  Google Scholar 

  4. Zhou, Y., Tuzel, O.: VoxelNet: end-to-end learning for point cloud based 3D object detection. In: IEEE International Conference on Computer Vision and Pattern Recognition, Salt Lake City, Utah, pp. 4490–4499 (2018)

  5. Pang, G., Neumann, U.: 3D point cloud object detection with multi-view convolutional neural network. In: International Conference on Pattern Recognition, Cancun, Mexico, pp. 585–590 (2016)

  6. Su, H., Maji, S., Kalogerakis, E., Learned-Miller, E.: Multi-view convolutional neural networks for 3D shape recognition. In: IEEE International Conference on Computer Vision, Araucano Park, Las Condes, Chile, pp. 945–953 (2015)

  7. Johns, E., Leutenegger, S., Davison, A.J.: Pairwise decomposition of image sequences for active multi-view recognition. In: IEEE International Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, pp. 3813–3822 (2016)

  8. Hegde, V., Zadeh, R.: FusionNet: 3D object classification using multiple data representations. In: 3D Deep Learning Workshop, Neural Information Processing Systems, Barcelona, Spain (2016)

  9. Wang, C., Pelillo, M., Siddiqi, K.: Dominant set clustering and pooling for multi-view 3D object recognition. In: British Machine Vision Conference, London, UK (2017)

  10. Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., Xiao, J.: 3D shapeNets: a deep representation for volumetric shapes. In: IEEE International Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, pp. 1912–1920 (2015)

  11. Brock, A., Lim, T., Ritchie, J.M., Weston, N.: Generative and discriminative voxel modeling with convolutional neural networks. In: Neural Information Processing Systems, Barcelona, Spain (2016)

  12. Chen, S., Tian, D., Feng, C., Vetro, A., Kovacevic, J.: Contour-enhanced resampling of 3D point clouds via graphs. In: IEEE International Conference on Acoustics, Speech and Signal Processing, New Orleans, LA, USA, pp. 2941–2945 (2017)

  13. Chen, S., Tian, D., Feng, C., Vetro, A., Kovaevi, J.: Fast resampling of three-dimensional point clouds via graphs. IEEE Transactions on Signal Processing 66(3), 666–681 (2018)

    Article  MathSciNet  Google Scholar 

  14. Zhang, Y., Rabbat, M.: A graph-CNN for 3D point cloud classification. In: IEEE International Conference on Acoustics, Speech and Signal Processing, Calgary, Canada, pp. 6279–6283 (2018)

  15. Charles, R.Q., Su, H., Kaichun, M., Guibas, L.J.: Pointnet: deep learning on point sets for 3D classification and segmentation. In: IEEE International Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, pp. 77–85 (2017)

  16. Qi, C.R., Yi, L., Su, H., Guibas, L.J.: PointNet++: deep hierarchical feature learning on point sets in a metric space. In: Advances in Neural Information Processing Systems, pp. 5100–5109 (2017)

  17. Jaderberg, M., Simonyan, K., Zisserman, A., Kavukcuoglu, K.: Spatial transformer networks. In: Advances in Neural Information Processing Systems, Montreal, Canada, pp. 2017–2025 (2015)

  18. Ben-Shabat, Y., Lindenbaum, M., Fischer, A.: 3DMFV: Three-Dimensional Point Cloud Classification in Real-Time Using Convolutional Neural Networks. IEEE Robot. Autom. Lett. 4(4), 3145–3152 (2018)

    Article  Google Scholar 

  19. Lin, M., Chen, Q., Yan, S.: Network in network. In: International Conference on Learning Representations, Banff, Canada, (2014)

  20. Kanezaki, A., Matsushita, Y., Nishida, Y.: RotationNet: joint object categorization and pose estimation using multiviews from unsupervised viewpoints. In: IEEE International Conference on Computer Vision and Pattern Recognition, Salt Lake City, Utah, United States, pp. 5010–5019 (2018)

  21. Su, H., Maji, S., Kalogerakis, E., Learned-Miller, E.: Multi-view convolutional neural networks for 3D shape recognition. In: IEEE International Conference on Computer Vision, Araucano Park, Las Condes, Chile, pp. 945–953, (2015)

  22. Yavartanoo, M., Kim, E.Y., Lee, K.M.: SPNet: deep 3D object classification and retrieval using stereographic projection. In: Asian Conference on Computer Vision, Perth, Australia, pp. 691–706 (2018)

  23. Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., Xiao, J.: 3D ShapeNets: a deep representation for volumetric shapes. In: IEEE International Conference on Computer Vision, Boston, Massachusetts, USA, pp. 1912–1920 (2015)

  24. Ravanbakhsh, S., Schneider, J.G., Poczos, B.: Deep learning with sets and point clouds. In: International Conference on Learning Representations, Toulon, France (2017)

  25. Klokov, R., Lempitsky, V.: Escape from cells: deep Kd-networks for the recognition of 3D point cloud models. In: IEEE International Conference on Computer Vision, Venice, Italy, pp. 863–872, (2017)

  26. Kazhdan, M., Funkhouser, T., Rusinkiewicz, S.: Rotation invariant spherical harmonic representation of 3D shape descriptors. In: Eurographics/ACM SIGGRAPH Symposium on Geometry Processing, Aachen, Germany, pp. 156-164 (2003)

  27. Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., Xiao, J.: 3D shapenets: a deep representation for volumetric shapes. In: IEEE International Conference on Computer Vision and Pattern Recognition, Boston, Massachusett, USA, pp. 1912–1920 (2015)

  28. Qi, C.R., Su, H., Nieayner, M., Dai, A., Yan, M., Guibas, L.: Volumetric and multi-view CNNs for object classification on 3D data. In: IEEE International Conference on Computer Vision and Pattern Recognition, Las Vegas, Nevada, USA, pp. 5648–5656 (2016)

  29. Su, H., Maji, S., Kalogerakis, E., Learned-Miller, E.G.: Multi-view convolutional neural networks for 3D shape recognition. In: IEEE International Conference on Computer Vision, Santiago, Chile, pp. 945–953 (2015)

  30. Ravanbakhsh, S., Schneider, J., Poczos, B.: Deep learning with sets and point clouds. In: International Conference on Learning Representations, San Juan, Puerto Rico (2016)

  31. Klokov, R., Lempitsky, V.S.: Escape from cells: deep kd-networks for the recognition of 3D point cloud models. In: IEEE International Conference on Computer Vision, Venice, Italy, pp. 863–872 (2017)

  32. Wang, P.-S., Liu, Y., Guo, Y.-X., Sun, C.-Y., Tong, X.: O-CNN: octree-based convolutional neural networks for 3D shape analysis. In: ACM Transaction on Graphics, vol. 36, No. 4 (2017)

  33. Le, T., Duan, Y.: PointGrid: a deep network for 3D shape understanding. In: IEEE International Conference on Computer Vision and Pattern Recognition, Salt Lake City, USA, pp. 9204–9214 (2018)

Download references

Author information

Authors and Affiliations

  1. Institute of Systems Science, National University of Singapore, 119615, Singapore, Singapore

    Yong Thiang Ng, Chung Ming Huang, Qing Tao Li & Jing Tian

Authors
  1. Yong Thiang Ng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chung Ming Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qing Tao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jing Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jing Tian.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ng, Y.T., Huang, C.M., Li, Q.T. et al. RadialNet: a point cloud classification approach using local structure representation with radial basis function. SIViP 14, 747–752 (2020). https://doi.org/10.1007/s11760-019-01607-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01607-0

Keywords

Search

Navigation