Skip to main content
Log in

Obtaining Super-Resolution Satellites Images Based on Enhancement Deep Convolutional Neural Network

  • Original Paper
  • Published:
International Journal of Aeronautical and Space Sciences Aims and scope Submit manuscript

Abstract

Super-resolution reconstruction refers to the technique of reconstructing a high-resolution image from a single or a series of low-resolution images by digital image processing. This technology can not only increase the high-frequency information of the image, but also eliminate the low-resolution. Deep Learning has made breakthroughs in modern digital image processing. Compared to traditional algorithms, deep convolutional neural networks (DCNN) achieve superior performance on a series of challenging image-processing problems such as image classification and target detection. Enhancement Deep convolutional neural networks (EDCNN) learn through a large number of training samples, obtain relevant information within the image, and then use the information to achieve specific functions. EDCNN also has an excellent performance with remote sensing data. Performance evaluation was made with bicubic and other deep learning methods, EDCNN outperformed other deep learning algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data Availability

The satellite image data used to support the findings of this study may be released upon application to the National Authority for Remote Sensing and Space Science, who can be contacted at Data Reception, Analysis and Receiving Station Affairs.

References

  1. Jian C, Huibin G, Weiguo W, Xun Bi (2015) Image super resolution restoration method and its application. Adv Laser Optoelectr 52(02):47–56

    Google Scholar 

  2. Keshk HM, Yin X (2017) Satellite super-resolution images depending on deep learning methods: a comparative study. 2017 IEEE Int Conf Signal Process Commun Comput (ICSPCC) Xiamen. https://doi.org/10.1109/ICSPCC.2017.8242625

    Article  Google Scholar 

  3. Maiseli B, Wu C, Mei J, Liu Q, Gao H (2014) A robust super-resolution method with improved high-frequency components estimation and aliasing correction capabilities. J Franklin Inst 351(1):513–527

    Article  Google Scholar 

  4. Makwana RR, Mehta ND (2013) Survey on single image super resolution techniques. IOSR J Electr Commun Eng 5(5):23–33

    Article  Google Scholar 

  5. Keshk HM, Abdel-Aziem MM, Ali AS, Assal MA (2014) Performance evaluation of quality measurement for super-resolution satellite images. 2014 Sci Inf Conf Lond. https://doi.org/10.1109/SAI.2014.6918212

    Article  Google Scholar 

  6. Yu L, Cao S, He J, Sun B, Dai F (2017) Single-image super-resolution based on regularization with stationary gradient fidelity. In: 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Shanghai, pp 1–5

  7. Khattab MM, Zeki AM, Alwan AA, Badawy AS (2018) Regularization-based multi-frame super-resolution: a systematic review. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/j.jksuci.2018.11.010

    Article  Google Scholar 

  8. Shin DK, Moon YS (2015) Super-resolution image reconstruction using wavelet based patch and discrete wavelet transform. J Sign Process Syst 81:71–81

    Article  Google Scholar 

  9. Guo T, Mousavi HS, Vu TH, Monga V (2017) Deep wavelet prediction for image super-resolution. In: 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), Honolulu, HI, pp 1100–1109.

  10. Yang J, Wright J, Huang TS et al (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873

    Article  MathSciNet  Google Scholar 

  11. Ren S, Girshick R, Girshick R et al (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149

    Article  Google Scholar 

  12. Dong C, Loy CC, He K et al (2014) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307

    Article  Google Scholar 

  13. Kim J, Lee JK, Lee KM (2016) Accurate image super-resolution using very deep convolutional networks. In: IEEE conference on computer vision and pattern recognition, pp 1646–1654

  14. Timofte R, Agustsson E, Gool LV et al (2017) NTIRE 2017 challenge on single image super-resolution: methods and results. In: IEEE conference on computer vision and pattern recognition workshops, pp 1110–1121

  15. Liu D, Wang Z, Wen B et al (2016) Robust single image super-resolution via deep networks with sparse prior. IEEE Trans Image Process 25(7):3194–3207

    Article  MathSciNet  Google Scholar 

  16. Keshk H, Yin X-C (2019) Classification of EgyptSat-1 images using deep learning methods. Int J Sens Wireless Commun Control 9:1. https://doi.org/10.2174/2210327909666190207153858

    Article  Google Scholar 

  17. Li H, Lin Z, Shen X et al (2015) A convolutional neural network cascade for face detection. In: Computer vision and pattern recognition, IEEE, pp 5325–5334

  18. Wang Z, Bovik AC, Sheikh HR et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  19. Martin D, Fowlkes C, Tal D et al (2002) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Computer vision, 2001. ICCV 2001. IEEE Proceedings, pp 416–423

  20. He K, Zhang X, Ren S et al (2016) Deep residual learning for image recognition. In: Computer vision and pattern recognition. IEEE, pp 770–778

  21. Tong T, Xiaodong Mu, Zhang Li, Yi Z, Pei Hu (2017) MBVCNN: joint convolutional neural networks method for image recognition. AIP Conf Proc 1839:020091. https://doi.org/10.1063/1.4982456

    Article  Google Scholar 

  22. Ioffe S, Batch SC (2015) Normalization: accelerating deep network training by reducing internal covariate shift. In: IEEE conference on computer vision and pattern recognition, pp 448–456

  23. Mairal J, Bach F, Ponce J et al (2010) Non-local sparse models for image restoration, In: IEEE, international conference on computer vision, 2272–2279

  24. Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer vision—ECCV 2014. Lecture notes in computer science, vol 8692. Springer, New York

    Google Scholar 

  25. Caballero J, Ledig C, Aitken A et al (2016) Real-time video super-resolution with spatio-temporal networks and motion compensation. In: IEEE conference on computer vision and pattern recognition workshops, pp 2848–2857

  26. Ahn H, Chung B, Yim C (2019) Super-resolution convolutional neural networks using modified and bilateral ReLU. In: 2019 international conference on electronics, information, and communication (ICEIC), Auckland, New Zealand, pp 1–4

  27. Fratter C, Moulin M, Ruiz H, Charvet P, Zobler D (2001) The SPOT5 mission. 52nd Int Astronaut Congress Toulouse France 35(911):651660

    Google Scholar 

  28. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  29. Dong C, Chen CL, Tang X (2016) Accelerating the super-resolution convolutional neural network. In: IEEE conference on computer vision and pattern recognition, pp 391–407

  30. Hinton GE, Osindero S, Teh YW (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554

    Article  MathSciNet  Google Scholar 

  31. Wang W, Cui Z, Chang H, Shan S, Chen X (2014) Deeply coupled auto-encoder networks for cross-view classification. arXiv preprint arXiv,1402.2031

Download references

Acknowledgements

This study was partially supported by National Authority for Remote Sensing and Space Science.

Author information

Authors and Affiliations

Authors

Contributions

HMK conceived, designed, performed the experiments; HMK and X-CY analyzed the data; HMK wrote the paper.

Corresponding author

Correspondence to Hatem Magdy Keshk.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Keshk, H.M., Yin, XC. Obtaining Super-Resolution Satellites Images Based on Enhancement Deep Convolutional Neural Network. Int. J. Aeronaut. Space Sci. 22, 195–202 (2021). https://doi.org/10.1007/s42405-020-00297-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42405-020-00297-0

Keywords

Navigation