Skip to main content
SpringerLink
Log in

Image Stitching using AKAZE Features

  • Research Article
  • Published:
Journal of the Indian Society of Remote Sensing Aims and scope Submit manuscript

Abstract

Accelerated KAZE (AKAZE) is a multi-scale 2D feature detection and description algorithm in nonlinear scale spaces proposed recently. This paper presents an image stitching algorithm which uses a feature detection and description algorithm; AKAZE and an image blending algorithm; weighted average blending. The whole process is divided into the following steps: First of all, detect feature points in the image and then get feature descriptors of detected points using AKAZE. Next, obtain corresponding matching pairs by using K-NN (K nearest neighbors) algorithm and remove the false matched points by MSAC (M-estimator SAmple Consensus) algorithm. MSAC is a variant of the RANSAC (Random Sample Consensus) algorithm and more accurate than RANSAC. Thereafter, calculate the homography matrix from correct matches. At last, blend the images by using weighted average blending algorithm. Comparison of proposed AKAZE-based algorithm with SIFT-, SURF- and ORB-based algorithms is also presented. According to the experiments, the proposed AKAZE-based image stitching algorithm minimizes stitching seam and generates a perfect stitched image, and also this algorithm is faster than previous algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. MATLAB vision toolbox dataset.

  2. VLFeat dataset.

References

  • Adel, E., Elmogy, M., Elbakry, H. (2015). Image stitching system based on orb feature-based technique and compensation blending. International Journal of Advanced Computer Science and Applications, 6(9).

  • Adel, E., Elmogy, M., Elbakry, H. (2014). Real time image mosaicing system based on feature extraction techniques. In 9th International conference computer engineering and systems (ICCES), https://ieeexplore.ieee.org/document/7030983/.

  • Alcantarilla, P. F., Bartoli, A., Davison, A. J. (2012) KAZE Features. ECCV 2012. Lecture Notes in Computer Science, vol 7577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33783-3_16.

  • Alcantarilla, PF., Nuevo, J., Bartoli, A. (2013). Fast explicit diffusion for accelerated features in nonlinear scale spaces. In: British Machine Vision Conference (BMVC).

  • Ali, I. H., & Salman, S. (2018). A Performance Analysis Of Various Feature Detectors And Their Descriptors For Panorama Image Stitching. International Journal of Pure and Applied Mathematics, 119(15), 147–161.

    Google Scholar 

  • Andersson, O., Marquez, SR. (2016). A comparison of object detection algorithms using unmanipulated testing images. Retrived 25 August 2019, from, https://kth.diva-portal.org/smash/get/diva2:927480/FULLTEXT01.pdf.

  • Bay, H., Ess, A., Tuytelaars, T., et al. (2008). Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110, 346–359.

    Article  Google Scholar 

  • Benoit, R., & Thierry, T. (1995). A mosaic of airborne SAR imagery for geological mapping in rolling topography. Canadian Journal of Remote Sensing, 21(1), 75–78.

    Article  Google Scholar 

  • Bind, VS., Muduli, PR., Pati, UC. (2013). A robust technique for feature-based image mosaicing using image fusion. International Journal of Advanced Computer Research (IJACR), 3(8).

  • Brown, M., & Lowe, D. (2007). Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, 74(1), 59–77.

    Article  Google Scholar 

  • Calonder, M., Lepetit, V., Strecha, C., et al. (2010). BRIEF: binary robust independent elementary features. Proceedings of the European Conference on Computer Vision, pp. 778–792.

  • Choi, S., Kim, T., & Yu, W. (2009). Performance evaluation of RANSAC family. Proceedings of the British Machine Vision Conference, 12, 81–82.

    Google Scholar 

  • Ghosh, D., & Kaabouch, N. (2016). A survey on image mosaicing techniques. Journal of Visual Communication and Image Representation, 34, 1–11.

    Article  Google Scholar 

  • Irani, M., Anandan, P. (2000). About Direct Methods. In: TB, ZA, SR, editors. Vision Algorithms: Theory and Practice. IWVA, Vol. 1883.

  • Jeon, HK., Jeong, JM., Lee, KY. (2016). An implementation of the real-time panoramic image stitching using orb and prosac. Soc Design Conference, pp. 91–92.

  • Jolhip, M., Minoi, J., & Lim, T. (2017). A comparative analysis of feature detection and matching algorithms for aerial image stitching. Journal of Telecommunication, Electronic and Computer Engineering, 9(2), 10–10.

    Google Scholar 

  • Kwok, R., Curlander, J. C., & Pang, S. (1990). An automated system for mosaicking spaceborne SAR imagery. International Journal of Remote Sensing, 11, 209–223.

    Article  Google Scholar 

  • Lin, C., Pankanti S.O, Ramamurthy KN., et al. (2015). Adaptive as-natural as-possible image stitching. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1155–1163.

  • Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60, 91–110.

    Article  Google Scholar 

  • Majumdar, J., Vanathy, N., Varshney, R., et al. (2002). Image mosaicing from video sequences. IETE Journal of Research., 48, 303–310.

    Article  Google Scholar 

  • Masoud, G., Mohsen, F. S., Pojui, C., & Javier, I. (2016). Integrating BIM and panorama to create a semi-augmented-reality experience of a construction site. International Journal of Construction Education and Research, 12(4), 303–316.

    Article  Google Scholar 

  • Mclauchlan, P., & Jaenicke, A. (2002). Image mosaicing using sequential bundle adjustment. Image and Vision Computing, 20(9), 751–759.

    Article  Google Scholar 

  • Mehmet, S. G. (2015). Performance evaluation for feature extractors on street view images. The Imaging Science Journal, 64(1), 26–33.

    Google Scholar 

  • Meneghetti, G., Danelljan, M., Felsberg. M., et al. (2015). Image alignment for panorama stitching in sparsely structured environments. In: Scandinavian Conference on Image Analysis Image, Vol. 9127.

  • Opozda, S., & Sochan, A. (2014). The survey of subjective and objective methods for quality assessment of 2D and 3D images. Theoretical and Applied Informatics, 26(2), 39–67.

    Google Scholar 

  • Rosten, E., & Drummond, T. (2006). Machine learning for high-speed corner detection. European Conference on Computer Vision, 3951, 430–443.

    Google Scholar 

  • Rublee, E., Rabaud, V., Konolige, K., et al. (2011). ORB: an efficient alternative to SIFT or SURF. In: IEEE International Conference on Computer Vision, pp. 2564–2571.

  • Sharma, S.K., Jain, K., Suresh, M. (2019). Quantitative evaluation of panorama softwares. In: ICCCE 2018. Lecture Notes in Electrical Engineering, vol. 500.

  • Szeliski, R. (2006). Image alignment and stitching: A tutorial. Found Trends Comput Graph Vis, 2(1), 1–104.

    Article  Google Scholar 

  • Szeliski, R., Kang, S., Marr, D., et al. (1980). Direct methods for visual scene reconstruction. IEEE Workshop on Representations of Visual Scenes, 207, 187–217.

    Google Scholar 

  • Truong, L., Nguyen, Y. B., Dongyeob, H., & Jungwon, H. (2018). Efficient seamline determination for UAV image mosaicking using edge detection. Remote Sensing Letters, 9(8), 763–769.

    Article  Google Scholar 

  • Tsai, V. J. D., & Huang, Y. T. (2004). Automated image mosaicking. Journal of the Chinese Institute of Engineers, 28(2), 329–340.

    Article  Google Scholar 

  • Wang, J., Fang, J., Liu, X., et al. (2014). A fast mosaic method for airborne images: the new Template-Convolution Speed-Up Robust Features (TSURF) algorithm. International Journal of Remote Sensing, 35, 5959–5970.

    Article  Google Scholar 

  • Wang, M., Niu, S., Yang, X. (2017). A novel panoramic image stitching algorithm based on ORB. International Conference on Applied System Innovation, pp. 818–821.

  • Wang, Z., Bovik, A. C., Sheikh, H. R., et al. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.

    Article  Google Scholar 

  • Wu, J., Cui, Z., Sheng, V. S., et al. (2013). A comparative study of SIFT and its variants. Measurement Science Review, 13(3), 122–131.

    Article  Google Scholar 

  • Zaragoza, J., Chin, TJ., Brown, M., and Suter, D. (2013). As-projective-as-possible Image Stitching with Moving DLT. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2339–2346.

  • Zhang, L., Shen, Y., & LH., (2014). VSI: A visual saliency induced index for perceptual image quality assessment. IEEE Transactions on Image Processing, 23(10), 4270–4281.

    Article  Google Scholar 

  • Zhang, L., Zhang, D., & Mou, X. (2011). FSIM: a feature similarity index for image quality assessment. IEEE Transactions on Image Processing, 20(8), 2378–2386.

    Article  Google Scholar 

  • Zoghlami, I., Faugeras, O., Deriche, R. (1997). Using geometric corners to build a 2D mosaic from a set of images. In: Proc. of the International Conference on Computer Vision and Pattern Recognition, https://ieeexplore.ieee.org/document/609359.

Download references

Author information

Authors and Affiliations

  1. Urban and Regional Studies Department, Indian Institute of Remote Sensing Dehradun, Dehradun, Uttarakhand, India

    Surendra Kumar Sharma

  2. Department of Civil Engineering, Indian Institute of Technology Roorkee, Roorkee, Uttarakhand, India

    Surendra Kumar Sharma & Kamal Jain

Authors
  1. Surendra Kumar Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kamal Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Surendra Kumar Sharma.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sharma, S.K., Jain, K. Image Stitching using AKAZE Features. J Indian Soc Remote Sens 48, 1389–1401 (2020). https://doi.org/10.1007/s12524-020-01163-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12524-020-01163-y

Keywords

Search

Navigation