Skip to main content
SpringerLink
Log in

A novel high precision mosaic method for sonar video sequence

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The mosaic of sonar images is more difficult than the mosaic of traditional optical images due to their poor quality and the difficulty in extracting feature points. The existing mosaic methods of sonar images have a series of problems, such as low correct matching rate, large cumulative errors and high requirements for the quality of collected sonar images. In this paper, we proposed a high precision method to implement the mosaic of the underwater sonar video image sequence. Firstly, Accelerated Unsharp Masking (AUSM) algorithm is proposed to preprocess the original image. Then we extract KAZE feature points from preprocessed sonar images. A matching method combining multiple matching strategies with Progressive Sample Consensus (PROSAC) algorithm is followed to complete the image registration. Weighted fusion method and a region of interest (ROI) acquisition method based on the slope of right border is used to optimize the mosaicked image. Finally, we can obtain a high-quality panoramic image of underwater sonar video by a global mosaic strategy. Mosaic experiments on the sonar video image sequence collected by multi-beam sonar demonstrate that the proposed method in this paper can increase the number of feature points by about 70% and make the correct matching rate higher than 70%. The proposed method also has good robustness and the cumulative error during multi-image mosaic is less.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

References

  1. Alcantarilla PF, Bartoli A, Davison AJ (2012) KAZE features. European Conference on Computer Vision. Springer, Berlin

    Google Scholar 

  2. Chen D, et al (2017) A variational approach for adaptive underwater sonar image denoising. 2017 4th International Conference on Transportation Information and Safety (ICTIS). IEEE

  3. Deng G (2010) A generalized unsharp masking algorithm. IEEE Trans Image Process 20.5:1249–1261

    MathSciNet  MATH  Google Scholar 

  4. Ferreira F et al (2015) Forward looking sonar mosaicing for mine countermeasures. Annual Rev Control 40:212–226

    Article  Google Scholar 

  5. Franchi M, Ridolfi A, Zacchini L (2018) A Forward-Looking Sonar-Based System for Underwater Mosaicing and Acoustic Odometry. 2018 IEEE/OES Autonomous Underwater Vehicle Workshop (AUV). IEEE

  6. Fu Q, Jung C, Xu K (2018) Retinex-based perceptual contrast enhancement in images using luminance adaptation[J]. IEEE Access 6:61277–61286

    Article  Google Scholar 

  7. Hurtós N, et al. (2013) Evaluation of registration methods on two-dimensional forward-looking sonar imagery. 2013 MTS/IEEE OCEANS-Bergen. IEEE

  8. Issartel M, et al. (2017) Robust SLAM for side scan sonar image mosaicking." OCEANS 2017-Anchorage. IEEE

  9. Lee D-H et al (2017) Robust LFM target detection in wideband sonar systems. IEEE Trans Aerospace Electron Syst 53.5:2399–2412

    Article  Google Scholar 

  10. Li J et al (2018) Pose-graph SLAM using Forward-looking Sonar. IEEE Robot Automation Lett 3.3:2330–2337

    Article  Google Scholar 

  11. Qu Z, et al. (2015) The improved algorithm of fast panorama stitching for image sequence and reducing the distortion errors. Mathematical Problems in Engineering 2015:1–12. https://doi.org/10.1155/2015/428076

  12. Reggiannini M, Salvetti O (2017) Seafloor analysis and understanding for underwater archeology. J Cultural Heritage 24:147–156

    Article  Google Scholar 

  13. Rehman A, Wang Z (2010) Reduced-reference SSIM estimation. 2010 IEEE International Conference on Image Processing. IEEE

  14. Sha Q, et al. (2017) Classification and mosaicking of side scan sonar image. OCEANS 2017-Aberdeen. IEEE

  15. Song S et al (2017) Two-dimensional forward-looking sonar image registration by maximization of peripheral mutual information. Int J Advanced Robotic Syst 14.6:1729881417746270

    Google Scholar 

  16. Tang C, Dandan L, Ao Li (2014) The Sonar Image Sequence Movement Target Detection Based on Surfacelet Transform at Complex Background. 2014 Sixth International Conference on Intelligent Human-Machine Systems and Cybernetics. Vol 2. IEEE

  17. Tao W, Liu Y (2017) Combined imaging matching method of side scan sonar images with prior position knowledge. IET Image Process 12.2:194–199

    Google Scholar 

  18. Tao W, Liu Y, Hu W (2017) Inversion of side scan sonar motion and posture in seabed geomorphology. Polish Maritime Res 24.s2:81–88

    Article  Google Scholar 

  19. Wang H-N et al (2004) Research of measurement for digital image definition. J Image Graphics 9.7:828–831

    Google Scholar 

  20. Weickert J, Romeny BMTH, Viergever MA (1998) Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Trans Image Process 7.3:398–410

    Article  Google Scholar 

  21. West G, Swift N (2017) Enhancing ship safety with the navigation and obstacle avoidance sonar. OCEANS 2017-Anchorage. IEEE

  22. Ya-Qiong C, Chen W-L, Yuan F (2016) Underwater acoustic image compressive sensing algorithm research based on Bandelets transform." OCEANS 2016-Shanghai. IEEE

  23. Ye X-F et al (2016) A feature-matching method for side-scan sonar images based on nonlinear scale space. J Marine Sci Technol 21.1:38–47

    Article  Google Scholar 

  24. Young IT, Van Vliet LJ (1995) Recursive implementation of the Gaussian filter. Signal Process 44.2:139–151

    Article  Google Scholar 

  25. Zhang J et al (2017) NSCT-based fusion method for forward-looking sonar image mosaic. IET Radar Sonar Navig 11.10:1512–1522

    Article  Google Scholar 

  26. Zhao J et al (2013) Mosaic method of side-scan sonar strip images using corresponding features. IET Image Process 7.6:616–623

    Article  Google Scholar 

  27. Zhao J, et al. (2017) The Design and Research of Intelligent Search and Rescue Device Based on Sonar Detection and Marine Battery. 2017 International Conference on Computer Network, Electronic and Automation (ICCNEA). IEEE :383–387. https://doi.org/10.1109/ICCNEA.2017.73

  28. Zhao J, Shang X, Zhang H (2018) Side-Scan Sonar Image Mosaic Using Couple Feature Points with Constraint of Track Line Positions. Remote Sens 10.6:953

    Article  Google Scholar 

Download references

Acknowledgements

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Natural Science Foundation of China (No. 51005142), the Innovation Program of Shanghai Municipal Education Commission (No.14YZ010), and the Natural Science Foundation of Shanghai (No. 14ZR1414900, No.19ZR1419300) for providing financial support for this work.

Author information

Authors and Affiliations

  1. School of Mechatronic Engineering and Automation, Shanghai University, No. 99 Shangda Road, Shanghai, China

    Zhijie Tang, Zhihang Luo, Lizhou Jiang & Gaoqian Ma

Authors
  1. Zhijie Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhihang Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lizhou Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gaoqian Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhihang Luo.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tang, Z., Luo, Z., Jiang, L. et al. A novel high precision mosaic method for sonar video sequence. Multimed Tools Appl 80, 14429–14458 (2021). https://doi.org/10.1007/s11042-020-10433-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10433-3

Keywords

Search

Navigation